You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2017/11/22 18:53:20 UTC
[JENKINS-EA] Lucene-Solr-7.x-Linux (64bit/jdk-10-ea+32) - Build #
880 - Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/880/
Java: 64bit/jdk-10-ea+32 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
3 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.core.TestLazyCores
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores: 1) Thread[id=6440, name=searcherExecutor-2467-thread-1, state=WAITING, group=TGRP-TestLazyCores] at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method) at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074) at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435) at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061) at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121) at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores:
1) Thread[id=6440, name=searcherExecutor-2467-thread-1, state=WAITING, group=TGRP-TestLazyCores]
at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)
at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
at __randomizedtesting.SeedInfo.seed([A5C1989B1686FFEA]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.core.TestLazyCores
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=6440, name=searcherExecutor-2467-thread-1, state=WAITING, group=TGRP-TestLazyCores] at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method) at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074) at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435) at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061) at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121) at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=6440, name=searcherExecutor-2467-thread-1, state=WAITING, group=TGRP-TestLazyCores]
at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)
at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
at __randomizedtesting.SeedInfo.seed([A5C1989B1686FFEA]:0)
FAILED: org.apache.solr.core.TestLazyCores.testNoCommit
Error Message:
Exception during query
Stack Trace:
java.lang.RuntimeException: Exception during query
at __randomizedtesting.SeedInfo.seed([A5C1989B1686FFEA:7AA1394ADDA19C4F]:0)
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:901)
at org.apache.solr.core.TestLazyCores.check10(TestLazyCores.java:847)
at org.apache.solr.core.TestLazyCores.testNoCommit(TestLazyCores.java:829)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound='10']
xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int><lst name="params"><str name="q">*:*</str></lst></lst><result name="response" numFound="0" start="0"></result>
</response>
request was:q=*:*
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:894)
... 40 more
Build Log:
[...truncated 1721 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/test/temp/junit4-J1-20171122_175540_9459791451876890773289.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/test/temp/junit4-J2-20171122_175540_9454751620590527027723.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 9 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/test/temp/junit4-J0-20171122_175540_94518355130248585129901.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 293 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/test/temp/junit4-J0-20171122_180151_89515437925606215041360.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/test/temp/junit4-J2-20171122_180151_89517394637301374396839.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 9 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/test/temp/junit4-J1-20171122_180151_89510489400881208838288.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 1054 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/common/test/temp/junit4-J1-20171122_180304_3477258822215798046513.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/common/test/temp/junit4-J0-20171122_180304_34718394831652352971030.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/common/test/temp/junit4-J2-20171122_180304_3479673225431930959193.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 228 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/icu/test/temp/junit4-J1-20171122_180431_7481143415298546315322.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/icu/test/temp/junit4-J2-20171122_180431_7478490949931450912649.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/icu/test/temp/junit4-J0-20171122_180431_7474745962365685287610.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 241 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J1-20171122_180440_89716637933945211980339.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 11 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J0-20171122_180440_89711658946950563825652.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J2-20171122_180440_8977886864593554421852.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 154 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J1-20171122_180503_6187841678461700798218.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J0-20171122_180503_61815843861124994567646.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J2-20171122_180503_6183300687409633250451.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 166 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J2-20171122_180507_20018383623868823203933.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J0-20171122_180507_20011617578430318738618.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J1-20171122_180507_2002995057672927401492.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 153 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J0-20171122_180516_71110488128945651588742.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J1-20171122_180516_71112459326724462881745.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 154 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/stempel/test/temp/junit4-J2-20171122_180523_2401578183089996294929.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/stempel/test/temp/junit4-J1-20171122_180523_2403425578454369770262.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/stempel/test/temp/junit4-J0-20171122_180523_2405151849536760747771.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 169 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/uima/test/temp/junit4-J0-20171122_180525_5424360009109986494231.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 190 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/backward-codecs/test/temp/junit4-J2-20171122_180533_1061431125863354048133.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 24 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/backward-codecs/test/temp/junit4-J0-20171122_180533_10612222695699313169135.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 10 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/backward-codecs/test/temp/junit4-J1-20171122_180533_1067594902857139194410.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 1274 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/benchmark/test/temp/junit4-J1-20171122_181333_9648433123734773317615.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/benchmark/test/temp/junit4-J2-20171122_181333_96410195251041709502148.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/benchmark/test/temp/junit4-J0-20171122_181333_96417805724440690145448.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 230 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/classification/test/temp/junit4-J1-20171122_181341_3275221698927318479242.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/classification/test/temp/junit4-J2-20171122_181341_32711426143193493833784.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/classification/test/temp/junit4-J0-20171122_181341_32715071613625439414546.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 259 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/test/temp/junit4-J2-20171122_181352_47912232411406413896264.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/test/temp/junit4-J1-20171122_181352_47915364108296887846239.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/test/temp/junit4-J0-20171122_181352_47917407457324277986205.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 241 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/demo/test/temp/junit4-J1-20171122_181610_0069293715595638443133.syserr
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/demo/test/temp/junit4-J2-20171122_181610_0069272574612154072834.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/demo/test/temp/junit4-J0-20171122_181610_0069143553660495646172.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 170 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/expressions/test/temp/junit4-J1-20171122_181612_64815930534722437558574.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/expressions/test/temp/junit4-J2-20171122_181612_6486791290356523553524.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/expressions/test/temp/junit4-J0-20171122_181612_6482439032653989885807.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 223 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/facet/test/temp/junit4-J0-20171122_181617_5803383621896613463996.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/facet/test/temp/junit4-J2-20171122_181617_58017830640077284645563.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 6 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/facet/test/temp/junit4-J1-20171122_181617_58016846371095131973682.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 179 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/grouping/test/temp/junit4-J2-20171122_181643_61211076341762239487968.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/grouping/test/temp/junit4-J1-20171122_181643_61213086589559424302792.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/grouping/test/temp/junit4-J0-20171122_181643_61211607335757819798802.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 243 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/highlighter/test/temp/junit4-J1-20171122_181652_2588072349584488122726.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/highlighter/test/temp/junit4-J2-20171122_181652_25812188189623884316099.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 6 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/highlighter/test/temp/junit4-J0-20171122_181652_2586947688147147583695.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 160 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/join/test/temp/junit4-J2-20171122_181713_36111610194552216022552.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 6 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/join/test/temp/junit4-J0-20171122_181713_3616068439168625652280.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/join/test/temp/junit4-J1-20171122_181713_3619324038019703312916.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 149 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/memory/test/temp/junit4-J0-20171122_181736_51212600178126889528451.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/memory/test/temp/junit4-J1-20171122_181736_51216810066036273509784.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 182 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/misc/test/temp/junit4-J1-20171122_181744_4507239155002324828828.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/misc/test/temp/junit4-J0-20171122_181744_4506947421301258036060.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/misc/test/temp/junit4-J2-20171122_181744_4505536414760553561586.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 326 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queries/test/temp/junit4-J0-20171122_181756_75017055390307475966643.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 6 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queries/test/temp/junit4-J2-20171122_181756_7509386592971921834017.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queries/test/temp/junit4-J1-20171122_181756_75012557366126730383303.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 230 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queryparser/test/temp/junit4-J0-20171122_181803_8767701058891924460151.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queryparser/test/temp/junit4-J2-20171122_181803_8761826095259330655192.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queryparser/test/temp/junit4-J1-20171122_181803_87612977333652439486697.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 207 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/replicator/test/temp/junit4-J1-20171122_181809_96413366133697774169269.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/replicator/test/temp/junit4-J0-20171122_181809_9641270191567969492049.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/replicator/test/temp/junit4-J2-20171122_181809_96418221580203655805656.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 213 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/sandbox/test/temp/junit4-J2-20171122_181821_7185502653573016695651.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/sandbox/test/temp/junit4-J1-20171122_181821_66813411892916472421857.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 10 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/sandbox/test/temp/junit4-J0-20171122_181821_66813148195927506308137.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 412 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial-extras/test/temp/junit4-J0-20171122_181909_412310816492837489434.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial-extras/test/temp/junit4-J1-20171122_181909_4121857791657727055119.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 6 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial-extras/test/temp/junit4-J2-20171122_181909_41212141609982342623806.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 148 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial/test/temp/junit4-J0-20171122_181923_6346492155708615303446.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 166 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial3d/test/temp/junit4-J2-20171122_181925_4175304182841954965090.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 9 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial3d/test/temp/junit4-J0-20171122_181925_417604675283099110756.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 5 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial3d/test/temp/junit4-J1-20171122_181925_41715424857752793984206.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 250 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/suggest/test/temp/junit4-J2-20171122_182006_4608536715282082234754.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/suggest/test/temp/junit4-J0-20171122_182006_46011233470359627970778.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/suggest/test/temp/junit4-J1-20171122_182006_46014827114937534580816.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 2404 lines...]
[junit4] Suite: org.apache.solr.core.TestLazyCores
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/init-core-data-001
[junit4] 2> 756375 INFO (SUITE-TestLazyCores-seed#[A5C1989B1686FFEA]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 756378 INFO (SUITE-TestLazyCores-seed#[A5C1989B1686FFEA]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 756378 INFO (SUITE-TestLazyCores-seed#[A5C1989B1686FFEA]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 756378 INFO (TEST-TestLazyCores.testMidUseUnload-seed#[A5C1989B1686FFEA]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testMidUseUnload
[junit4] 2> 756387 INFO (TEST-TestLazyCores.testMidUseUnload-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-001/solr.xml
[junit4] 2> 756389 INFO (TEST-TestLazyCores.testMidUseUnload-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 756389 INFO (TEST-TestLazyCores.testMidUseUnload-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 756389 INFO (TEST-TestLazyCores.testMidUseUnload-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6b9e8cb6, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 756408 INFO (TEST-TestLazyCores.testMidUseUnload-seed#[A5C1989B1686FFEA]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6b9e8cb6
[junit4] 2> 756413 INFO (TEST-TestLazyCores.testMidUseUnload-seed#[A5C1989B1686FFEA]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6b9e8cb6
[junit4] 2> 756413 INFO (TEST-TestLazyCores.testMidUseUnload-seed#[A5C1989B1686FFEA]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6b9e8cb6
[junit4] 2> 756414 INFO (TEST-TestLazyCores.testMidUseUnload-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 756422 INFO (coreLoadExecutor-2413-thread-2) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 756422 INFO (coreLoadExecutor-2413-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 756423 INFO (coreLoadExecutor-2413-thread-3) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 756427 INFO (coreLoadExecutor-2413-thread-1) [ ] o.a.s.s.IndexSchema [collection1] Schema name=tiny
[junit4] 2> 756427 INFO (coreLoadExecutor-2413-thread-2) [ ] o.a.s.s.IndexSchema [collection2] Schema name=tiny
[junit4] 2> 756428 INFO (coreLoadExecutor-2413-thread-2) [ ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
[junit4] 2> 756428 INFO (coreLoadExecutor-2413-thread-1) [ ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
[junit4] 2> 756428 INFO (coreLoadExecutor-2413-thread-2) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection2' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-001/./collection2, trusted=true
[junit4] 2> 756428 INFO (coreLoadExecutor-2413-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-001/./collection1, trusted=true
[junit4] 2> 756428 INFO (coreLoadExecutor-2413-thread-1) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6b9e8cb6
[junit4] 2> 756428 INFO (coreLoadExecutor-2413-thread-2) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection2' (registry 'solr.core.collection2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6b9e8cb6
[junit4] 2> 756428 INFO (coreLoadExecutor-2413-thread-1) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 756428 INFO (coreLoadExecutor-2413-thread-2) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 756428 INFO (coreLoadExecutor-2413-thread-1) [ ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-001/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-001/./collection1/data/]
[junit4] 2> 756429 INFO (coreLoadExecutor-2413-thread-2) [ ] o.a.s.c.SolrCore [[collection2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-001/collection2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-001/./collection2/data/]
[junit4] 2> 756429 INFO (coreLoadExecutor-2413-thread-3) [ ] o.a.s.s.IndexSchema [collection5] Schema name=tiny
[junit4] 2> 756430 INFO (coreLoadExecutor-2413-thread-2) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=22, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.23583958468392607]
[junit4] 2> 756430 INFO (coreLoadExecutor-2413-thread-1) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=22, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.23583958468392607]
[junit4] 2> 756431 INFO (coreLoadExecutor-2413-thread-3) [ ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
[junit4] 2> 756431 INFO (coreLoadExecutor-2413-thread-3) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection5' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-001/./collection5, trusted=true
[junit4] 2> 756431 INFO (coreLoadExecutor-2413-thread-3) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection5' (registry 'solr.core.collection5') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6b9e8cb6
[junit4] 2> 756431 INFO (coreLoadExecutor-2413-thread-3) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 756431 INFO (coreLoadExecutor-2413-thread-3) [ ] o.a.s.c.SolrCore [[collection5] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-001/collection5], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-001/./collection5/data/]
[junit4] 2> 756435 INFO (coreLoadExecutor-2413-thread-3) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=22, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.23583958468392607]
[junit4] 2> 756476 INFO (coreLoadExecutor-2413-thread-2) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 756476 INFO (coreLoadExecutor-2413-thread-2) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 756476 INFO (coreLoadExecutor-2413-thread-2) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=84.10546875, floorSegmentMB=0.25, forceMergeDeletesPctAllowed=19.69339632850992, segmentsPerTier=29.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.16154912630865514
[junit4] 2> 756477 INFO (coreLoadExecutor-2413-thread-2) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@a6ec777[collection2] main]
[junit4] 2> 756477 INFO (coreLoadExecutor-2413-thread-2) [ ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-001/collection2/conf
[junit4] 2> 756477 INFO (coreLoadExecutor-2413-thread-2) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 756478 INFO (searcherExecutor-2414-thread-1) [ ] o.a.s.c.SolrCore [collection2] Registered new searcher Searcher@a6ec777[collection2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 756482 INFO (coreLoadExecutor-2413-thread-1) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 756482 INFO (coreLoadExecutor-2413-thread-1) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 756483 INFO (coreLoadExecutor-2413-thread-1) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=84.10546875, floorSegmentMB=0.25, forceMergeDeletesPctAllowed=19.69339632850992, segmentsPerTier=29.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.16154912630865514
[junit4] 2> 756483 INFO (coreLoadExecutor-2413-thread-1) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@7d545f19[collection1] main]
[junit4] 2> 756483 INFO (coreLoadExecutor-2413-thread-1) [ ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-001/collection1/conf
[junit4] 2> 756483 INFO (coreLoadExecutor-2413-thread-1) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 756484 INFO (searcherExecutor-2415-thread-1) [ ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7d545f19[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 756487 INFO (coreLoadExecutor-2413-thread-3) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 756487 INFO (coreLoadExecutor-2413-thread-3) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 756487 INFO (coreLoadExecutor-2413-thread-3) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=84.10546875, floorSegmentMB=0.25, forceMergeDeletesPctAllowed=19.69339632850992, segmentsPerTier=29.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.16154912630865514
[junit4] 2> 756488 INFO (coreLoadExecutor-2413-thread-3) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@5b25a2db[collection5] main]
[junit4] 2> 756488 INFO (coreLoadExecutor-2413-thread-3) [ ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-001/collection5/conf
[junit4] 2> 756488 INFO (coreLoadExecutor-2413-thread-3) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 756489 INFO (searcherExecutor-2416-thread-1) [ ] o.a.s.c.SolrCore [collection5] Registered new searcher Searcher@5b25a2db[collection5] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 756490 INFO (TEST-TestLazyCores.testMidUseUnload-seed#[A5C1989B1686FFEA]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=null
[junit4] 2> 756490 INFO (TEST-TestLazyCores.testMidUseUnload-seed#[A5C1989B1686FFEA]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2f9febe5: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@4bafa807
[junit4] 2> 756501 INFO (TEST-TestLazyCores.testMidUseUnload-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.SolrCore Core collection1 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 756601 INFO (TEST-TestLazyCores.testMidUseUnload-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.SolrCore Core collection1 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 756701 INFO (TEST-TestLazyCores.testMidUseUnload-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.SolrCore Core collection1 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 756801 INFO (TEST-TestLazyCores.testMidUseUnload-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.SolrCore Core collection1 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 756901 INFO (TEST-TestLazyCores.testMidUseUnload-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.SolrCore Core collection1 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 757001 INFO (TEST-TestLazyCores.testMidUseUnload-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.SolrCore Core collection1 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 757101 INFO (TEST-TestLazyCores.testMidUseUnload-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.SolrCore Core collection1 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 757132 INFO (Thread-2160) [ ] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@40a6e4ea
[junit4] 2> 757132 INFO (Thread-2160) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=1084679402
[junit4] 2> 757202 INFO (TEST-TestLazyCores.testMidUseUnload-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=761649604
[junit4] 2> 757202 INFO (TEST-TestLazyCores.testMidUseUnload-seed#[A5C1989B1686FFEA]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 757202 INFO (TEST-TestLazyCores.testMidUseUnload-seed#[A5C1989B1686FFEA]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@30e23f51: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@6f9fae19
[junit4] 2> 757204 INFO (TEST-TestLazyCores.testMidUseUnload-seed#[A5C1989B1686FFEA]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 757204 INFO (TEST-TestLazyCores.testMidUseUnload-seed#[A5C1989B1686FFEA]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@26c6bf52: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@7be9aa20
[junit4] 2> 757207 INFO (TEST-TestLazyCores.testMidUseUnload-seed#[A5C1989B1686FFEA]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 757207 INFO (TEST-TestLazyCores.testMidUseUnload-seed#[A5C1989B1686FFEA]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3e13bfe6: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6e3deccd
[junit4] 2> 757207 INFO (coreCloseExecutor-2427-thread-1) [ ] o.a.s.c.SolrCore [collection5] CLOSING SolrCore org.apache.solr.core.SolrCore@6ae077af
[junit4] 2> 757207 INFO (coreCloseExecutor-2427-thread-2) [ ] o.a.s.c.SolrCore [collection2] CLOSING SolrCore org.apache.solr.core.SolrCore@305140cd
[junit4] 2> 757207 INFO (coreCloseExecutor-2427-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection5, tag=1793095599
[junit4] 2> 757207 INFO (coreCloseExecutor-2427-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1b31f50b: rootName = null, domain = solr.core.collection5, service url = null, agent id = null] for registry solr.core.collection5 / com.codahale.metrics.MetricRegistry@7c2f36bc
[junit4] 2> 757211 INFO (coreCloseExecutor-2427-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection2, tag=810631373
[junit4] 2> 757211 INFO (coreCloseExecutor-2427-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@12038587: rootName = null, domain = solr.core.collection2, service url = null, agent id = null] for registry solr.core.collection2 / com.codahale.metrics.MetricRegistry@15c41f0a
[junit4] 2> 757216 INFO (TEST-TestLazyCores.testMidUseUnload-seed#[A5C1989B1686FFEA]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testMidUseUnload
[junit4] 2> 757217 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testNoCommit
[junit4] 2> 757229 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-002/solr.xml
[junit4] 2> 757238 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 757238 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 757239 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6b9e8cb6, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 757264 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6b9e8cb6
[junit4] 2> 757270 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6b9e8cb6
[junit4] 2> 757270 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6b9e8cb6
[junit4] 2> 757272 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 757277 INFO (coreLoadExecutor-2434-thread-2) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 757277 INFO (coreLoadExecutor-2434-thread-3) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 757277 INFO (coreLoadExecutor-2434-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 757291 INFO (coreLoadExecutor-2434-thread-3) [ ] o.a.s.s.IndexSchema [collection5] Schema name=tiny
[junit4] 2> 757291 INFO (coreLoadExecutor-2434-thread-1) [ ] o.a.s.s.IndexSchema [collection1] Schema name=tiny
[junit4] 2> 757291 INFO (coreLoadExecutor-2434-thread-2) [ ] o.a.s.s.IndexSchema [collection2] Schema name=tiny
[junit4] 2> 757292 INFO (coreLoadExecutor-2434-thread-1) [ ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
[junit4] 2> 757292 INFO (coreLoadExecutor-2434-thread-2) [ ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
[junit4] 2> 757293 INFO (coreLoadExecutor-2434-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-002/./collection1, trusted=true
[junit4] 2> 757293 INFO (coreLoadExecutor-2434-thread-2) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection2' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-002/./collection2, trusted=true
[junit4] 2> 757292 INFO (coreLoadExecutor-2434-thread-3) [ ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
[junit4] 2> 757293 INFO (coreLoadExecutor-2434-thread-3) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection5' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-002/./collection5, trusted=true
[junit4] 2> 757293 INFO (coreLoadExecutor-2434-thread-3) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection5' (registry 'solr.core.collection5') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6b9e8cb6
[junit4] 2> 757293 INFO (coreLoadExecutor-2434-thread-2) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection2' (registry 'solr.core.collection2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6b9e8cb6
[junit4] 2> 757293 INFO (coreLoadExecutor-2434-thread-1) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6b9e8cb6
[junit4] 2> 757293 INFO (coreLoadExecutor-2434-thread-2) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 757293 INFO (coreLoadExecutor-2434-thread-3) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 757293 INFO (coreLoadExecutor-2434-thread-1) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 757293 INFO (coreLoadExecutor-2434-thread-2) [ ] o.a.s.c.SolrCore [[collection2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-002/collection2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-002/./collection2/data/]
[junit4] 2> 757293 INFO (coreLoadExecutor-2434-thread-3) [ ] o.a.s.c.SolrCore [[collection5] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-002/collection5], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-002/./collection5/data/]
[junit4] 2> 757293 INFO (coreLoadExecutor-2434-thread-1) [ ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-002/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-002/./collection1/data/]
[junit4] 2> 757295 INFO (coreLoadExecutor-2434-thread-2) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=22, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.23583958468392607]
[junit4] 2> 757298 INFO (coreLoadExecutor-2434-thread-3) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=22, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.23583958468392607]
[junit4] 2> 757298 INFO (coreLoadExecutor-2434-thread-1) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=22, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.23583958468392607]
[junit4] 2> 757335 INFO (coreLoadExecutor-2434-thread-2) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 757335 INFO (coreLoadExecutor-2434-thread-2) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 757336 INFO (coreLoadExecutor-2434-thread-2) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=84.10546875, floorSegmentMB=0.25, forceMergeDeletesPctAllowed=19.69339632850992, segmentsPerTier=29.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.16154912630865514
[junit4] 2> 757336 INFO (coreLoadExecutor-2434-thread-2) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@6b71bbf6[collection2] main]
[junit4] 2> 757336 INFO (coreLoadExecutor-2434-thread-2) [ ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-002/collection2/conf
[junit4] 2> 757337 INFO (coreLoadExecutor-2434-thread-2) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 757337 INFO (searcherExecutor-2436-thread-1) [ ] o.a.s.c.SolrCore [collection2] Registered new searcher Searcher@6b71bbf6[collection2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 757340 INFO (coreLoadExecutor-2434-thread-1) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 757340 INFO (coreLoadExecutor-2434-thread-1) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 757340 INFO (coreLoadExecutor-2434-thread-3) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 757340 INFO (coreLoadExecutor-2434-thread-3) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 757341 INFO (coreLoadExecutor-2434-thread-1) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=84.10546875, floorSegmentMB=0.25, forceMergeDeletesPctAllowed=19.69339632850992, segmentsPerTier=29.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.16154912630865514
[junit4] 2> 757341 INFO (coreLoadExecutor-2434-thread-3) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=84.10546875, floorSegmentMB=0.25, forceMergeDeletesPctAllowed=19.69339632850992, segmentsPerTier=29.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.16154912630865514
[junit4] 2> 757341 INFO (coreLoadExecutor-2434-thread-1) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@2d174402[collection1] main]
[junit4] 2> 757341 INFO (coreLoadExecutor-2434-thread-3) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@497d7a1c[collection5] main]
[junit4] 2> 757341 INFO (coreLoadExecutor-2434-thread-1) [ ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-002/collection1/conf
[junit4] 2> 757341 INFO (coreLoadExecutor-2434-thread-3) [ ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-002/collection5/conf
[junit4] 2> 757341 INFO (coreLoadExecutor-2434-thread-1) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 757341 INFO (coreLoadExecutor-2434-thread-3) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 757342 INFO (searcherExecutor-2435-thread-1) [ ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@2d174402[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 757342 INFO (searcherExecutor-2437-thread-1) [ ] o.a.s.c.SolrCore [collection5] Registered new searcher Searcher@497d7a1c[collection5] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 757346 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 757350 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.s.IndexSchema [collection3] Schema name=tiny
[junit4] 2> 757351 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
[junit4] 2> 757351 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection3' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-002/./collection3, trusted=true
[junit4] 2> 757351 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection3' (registry 'solr.core.collection3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6b9e8cb6
[junit4] 2> 757351 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 757351 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.SolrCore [[collection3] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-002/collection3], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-002/./collection3/data/]
[junit4] 2> 757353 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=15, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4590364987436393]
[junit4] 2> 757385 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 757385 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 757386 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=46.5576171875, floorSegmentMB=1.29296875, forceMergeDeletesPctAllowed=17.874244490780445, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 757386 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@2a17868e[collection3] main]
[junit4] 2> 757386 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-002/collection3/conf
[junit4] 2> 757387 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 757387 INFO (searcherExecutor-2447-thread-1) [ ] o.a.s.c.SolrCore [collection3] Registered new searcher Searcher@2a17868e[collection3] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 757391 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 757400 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.s.IndexSchema [collection6] Schema name=tiny
[junit4] 2> 757401 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
[junit4] 2> 757401 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection6' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-002/./collection6, trusted=true
[junit4] 2> 757401 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection6' (registry 'solr.core.collection6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6b9e8cb6
[junit4] 2> 757401 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 757401 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.SolrCore [[collection6] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-002/collection6], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-002/./collection6/data/]
[junit4] 2> 757403 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=31, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5323586131812758]
[junit4] 2> 757465 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 757465 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 757467 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@45f07333
[junit4] 2> 757467 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@17e9e131[collection6] main]
[junit4] 2> 757467 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-002/collection6/conf
[junit4] 2> 757468 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 757469 INFO (searcherExecutor-2451-thread-1) [ ] o.a.s.c.SolrCore [collection6] Registered new searcher Searcher@17e9e131[collection6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 757475 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 757481 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.s.IndexSchema [collection7] Schema name=tiny
[junit4] 2> 757483 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
[junit4] 2> 757483 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection7' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-002/./collection7, trusted=true
[junit4] 2> 757484 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection7' (registry 'solr.core.collection7') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6b9e8cb6
[junit4] 2> 757484 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 757484 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.SolrCore [[collection7] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-002/collection7], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-002/./collection7/data/]
[junit4] 2> 757487 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=35, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.15804958603850316]
[junit4] 2> 757550 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 757550 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 757552 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=306330413, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 757552 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@3dc26754[collection7] main]
[junit4] 2> 757553 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_A5C1989B1686FFEA-001/tempDir-002/collection7/conf
[junit4] 2> 757554 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 757554 INFO (searcherExecutor-2455-thread-1) [ ] o.a.s.c.SolrCore [collection7] Registered new searcher Searcher@3dc26754[collection7] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 757560 INFO (TEST-TestLazyCores.testNoCommit-seed#[A5C1989B1686FFEA]) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[
[...truncated too long message...]
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-analytics/test/temp/junit4-J0-20171122_184652_8488547793274564701838.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-analytics/test/temp/junit4-J1-20171122_184652_84811981910436528665307.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 553 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J2-20171122_184744_09216744703152534141310.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J1-20171122_184744_09211054236293428556684.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J0-20171122_184744_0929610558885603442557.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 1259 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J1-20171122_184756_6524839552670347088483.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J0-20171122_184756_6526451297751466277639.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 644 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J0-20171122_184802_6106558219211963056355.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 6 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J2-20171122_184802_6105000115593479412919.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J1-20171122_184802_6104860143134653660048.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 557 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J1-20171122_184820_7949828402923041521108.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J2-20171122_184820_7941841446463038769868.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J0-20171122_184820_7942254405515131746350.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 563 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J1-20171122_184829_58317247610691096234730.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J0-20171122_184829_5823985497630335924905.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 649 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J1-20171122_184835_1729522813042570835968.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J2-20171122_184835_17217988372810021783877.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J0-20171122_184835_1726360175380619516704.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 596 lines...]
[junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J1-20171122_184858_27814091922617308900176.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J1: EOF ----
[...truncated 3 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J0-20171122_184858_27811728073299625581903.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 548 lines...]
[junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-velocity/test/temp/junit4-J0-20171122_184907_6811622280961352821426.syserr
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[junit4] <<< JVM J0: EOF ----
[...truncated 31673 lines...]
[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk-9.0.1) - Build # 888 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/888/
Java: 64bit/jdk-9.0.1 -XX:-UseCompressedOops -XX:+UseSerialGC
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.analytics.facet.QueryFacetTest
Error Message:
Error from server at http://127.0.0.1:42965/solr: Could not fully create collection: collection1
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:42965/solr: Could not fully create collection: collection1
at __randomizedtesting.SeedInfo.seed([C1C2584EF1755A77]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1103)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:883)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:816)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.analytics.SolrAnalyticsTestCase.setupCollection(SolrAnalyticsTestCase.java:62)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:874)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.cloud.RemoteQueryErrorTest.test
Error Message:
Error from server at https://127.0.0.1:37993/solr: create the collection time out:180s
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:37993/solr: create the collection time out:180s
at __randomizedtesting.SeedInfo.seed([D4810B6A60123671:5CD534B0CEEE5B89]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1103)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:883)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:816)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.cloud.RemoteQueryErrorTest.test(RemoteQueryErrorTest.java:46)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 13407 lines...]
[junit4] Suite: org.apache.solr.cloud.RemoteQueryErrorTest
[junit4] 2> 2317950 INFO (SUITE-RemoteQueryErrorTest-seed#[D4810B6A60123671]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.RemoteQueryErrorTest_D4810B6A60123671-001/init-core-data-001
[junit4] 2> 2317950 WARN (SUITE-RemoteQueryErrorTest-seed#[D4810B6A60123671]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=19 numCloses=19
[junit4] 2> 2317950 INFO (SUITE-RemoteQueryErrorTest-seed#[D4810B6A60123671]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 2317950 INFO (SUITE-RemoteQueryErrorTest-seed#[D4810B6A60123671]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 2317951 INFO (SUITE-RemoteQueryErrorTest-seed#[D4810B6A60123671]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.RemoteQueryErrorTest_D4810B6A60123671-001/tempDir-001
[junit4] 2> 2317951 INFO (SUITE-RemoteQueryErrorTest-seed#[D4810B6A60123671]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2317951 INFO (Thread-4006) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2317952 INFO (Thread-4006) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2317953 ERROR (Thread-4006) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2318052 INFO (SUITE-RemoteQueryErrorTest-seed#[D4810B6A60123671]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:46385
[junit4] 2> 2318055 INFO (jetty-launcher-5078-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2318055 INFO (jetty-launcher-5078-thread-3) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2318055 INFO (jetty-launcher-5078-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2318057 INFO (jetty-launcher-5078-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1503520d{/solr,null,AVAILABLE}
[junit4] 2> 2318057 INFO (jetty-launcher-5078-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@19baabf6{/solr,null,AVAILABLE}
[junit4] 2> 2318057 INFO (jetty-launcher-5078-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6a3b8298{SSL,[ssl, http/1.1]}{127.0.0.1:37993}
[junit4] 2> 2318057 INFO (jetty-launcher-5078-thread-1) [ ] o.e.j.s.Server Started @2319876ms
[junit4] 2> 2318057 INFO (jetty-launcher-5078-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37993}
[junit4] 2> 2318058 ERROR (jetty-launcher-5078-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2318058 INFO (jetty-launcher-5078-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@36b9b1c0{SSL,[ssl, http/1.1]}{127.0.0.1:40683}
[junit4] 2> 2318057 INFO (jetty-launcher-5078-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5015b180{/solr,null,AVAILABLE}
[junit4] 2> 2318061 INFO (jetty-launcher-5078-thread-3) [ ] o.e.j.s.Server Started @2319880ms
[junit4] 2> 2318061 INFO (jetty-launcher-5078-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40683}
[junit4] 2> 2318061 ERROR (jetty-launcher-5078-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2318061 INFO (jetty-launcher-5078-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.2.0
[junit4] 2> 2318061 INFO (jetty-launcher-5078-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@27472a64{SSL,[ssl, http/1.1]}{127.0.0.1:41371}
[junit4] 2> 2318061 INFO (jetty-launcher-5078-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2318062 INFO (jetty-launcher-5078-thread-2) [ ] o.e.j.s.Server Started @2319880ms
[junit4] 2> 2318062 INFO (jetty-launcher-5078-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2318062 INFO (jetty-launcher-5078-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41371}
[junit4] 2> 2318062 INFO (jetty-launcher-5078-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-23T21:16:10.450082Z
[junit4] 2> 2318062 ERROR (jetty-launcher-5078-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2318062 INFO (jetty-launcher-5078-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.2.0
[junit4] 2> 2318062 INFO (jetty-launcher-5078-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2318062 INFO (jetty-launcher-5078-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2318062 INFO (jetty-launcher-5078-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-23T21:16:10.450403Z
[junit4] 2> 2318061 INFO (jetty-launcher-5078-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.2.0
[junit4] 2> 2318062 INFO (jetty-launcher-5078-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2318062 INFO (jetty-launcher-5078-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2318062 INFO (jetty-launcher-5078-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-23T21:16:10.450570Z
[junit4] 2> 2318063 INFO (jetty-launcher-5078-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2318063 INFO (jetty-launcher-5078-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2318075 INFO (jetty-launcher-5078-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2318078 INFO (jetty-launcher-5078-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46385/solr
[junit4] 2> 2318078 INFO (jetty-launcher-5078-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46385/solr
[junit4] 2> 2318080 INFO (jetty-launcher-5078-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46385/solr
[junit4] 2> 2318120 INFO (jetty-launcher-5078-thread-2) [n:127.0.0.1:41371_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2318121 INFO (jetty-launcher-5078-thread-2) [n:127.0.0.1:41371_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41371_solr
[junit4] 2> 2318121 INFO (jetty-launcher-5078-thread-1) [n:127.0.0.1:37993_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2318121 INFO (jetty-launcher-5078-thread-2) [n:127.0.0.1:41371_solr ] o.a.s.c.Overseer Overseer (id=99055813941067785-127.0.0.1:41371_solr-n_0000000000) starting
[junit4] 2> 2318121 INFO (jetty-launcher-5078-thread-1) [n:127.0.0.1:37993_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37993_solr
[junit4] 2> 2318122 INFO (zkCallback-5091-thread-1-processing-n:127.0.0.1:37993_solr) [n:127.0.0.1:37993_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2318126 INFO (zkCallback-5095-thread-1-processing-n:127.0.0.1:41371_solr) [n:127.0.0.1:41371_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2318133 INFO (jetty-launcher-5078-thread-3) [n:127.0.0.1:40683_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2318134 INFO (jetty-launcher-5078-thread-3) [n:127.0.0.1:40683_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2318135 INFO (jetty-launcher-5078-thread-3) [n:127.0.0.1:40683_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40683_solr
[junit4] 2> 2318135 INFO (zkCallback-5091-thread-1-processing-n:127.0.0.1:37993_solr) [n:127.0.0.1:37993_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2318135 INFO (zkCallback-5095-thread-1-processing-n:127.0.0.1:41371_solr) [n:127.0.0.1:41371_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2318140 INFO (zkCallback-5093-thread-1-processing-n:127.0.0.1:40683_solr) [n:127.0.0.1:40683_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2318146 INFO (jetty-launcher-5078-thread-2) [n:127.0.0.1:41371_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41371_solr
[junit4] 2> 2318147 INFO (zkCallback-5091-thread-1-processing-n:127.0.0.1:37993_solr) [n:127.0.0.1:37993_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2318165 INFO (zkCallback-5095-thread-1-processing-n:127.0.0.1:41371_solr) [n:127.0.0.1:41371_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2318166 INFO (zkCallback-5093-thread-1-processing-n:127.0.0.1:40683_solr) [n:127.0.0.1:40683_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2318170 INFO (jetty-launcher-5078-thread-1) [n:127.0.0.1:37993_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37993.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@594255a5
[junit4] 2> 2318175 INFO (jetty-launcher-5078-thread-1) [n:127.0.0.1:37993_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37993.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@594255a5
[junit4] 2> 2318175 INFO (jetty-launcher-5078-thread-1) [n:127.0.0.1:37993_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37993.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@594255a5
[junit4] 2> 2318176 INFO (jetty-launcher-5078-thread-1) [n:127.0.0.1:37993_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.RemoteQueryErrorTest_D4810B6A60123671-001/tempDir-001/node1/.
[junit4] 2> 2318193 INFO (jetty-launcher-5078-thread-3) [n:127.0.0.1:40683_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40683.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@594255a5
[junit4] 2> 2318198 INFO (jetty-launcher-5078-thread-3) [n:127.0.0.1:40683_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40683.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@594255a5
[junit4] 2> 2318198 INFO (jetty-launcher-5078-thread-3) [n:127.0.0.1:40683_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40683.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@594255a5
[junit4] 2> 2318199 INFO (jetty-launcher-5078-thread-3) [n:127.0.0.1:40683_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.RemoteQueryErrorTest_D4810B6A60123671-001/tempDir-001/node3/.
[junit4] 2> 2318202 INFO (jetty-launcher-5078-thread-2) [n:127.0.0.1:41371_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41371.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@594255a5
[junit4] 2> 2318207 INFO (jetty-launcher-5078-thread-2) [n:127.0.0.1:41371_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41371.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@594255a5
[junit4] 2> 2318207 INFO (jetty-launcher-5078-thread-2) [n:127.0.0.1:41371_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41371.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@594255a5
[junit4] 2> 2318208 INFO (jetty-launcher-5078-thread-2) [n:127.0.0.1:41371_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.RemoteQueryErrorTest_D4810B6A60123671-001/tempDir-001/node2/.
[junit4] 2> 2318250 INFO (SUITE-RemoteQueryErrorTest-seed#[D4810B6A60123671]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 2318251 INFO (SUITE-RemoteQueryErrorTest-seed#[D4810B6A60123671]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46385/solr ready
[junit4] 2> 2318258 INFO (TEST-RemoteQueryErrorTest.test-seed#[D4810B6A60123671]) [ ] o.a.s.SolrTestCaseJ4 ###Starting test
[junit4] 2> 2318277 INFO (qtp1348605820-20704) [n:127.0.0.1:37993_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&name=collection&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2318285 INFO (OverseerThreadFactory-7449-thread-1-processing-n:127.0.0.1:41371_solr) [n:127.0.0.1:41371_solr ] o.a.s.c.CreateCollectionCmd Create collection collection
[junit4] 2> 2318389 INFO (OverseerStateUpdate-99055813941067785-127.0.0.1:41371_solr-n_0000000000) [n:127.0.0.1:41371_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"collection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:40683/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2318391 INFO (OverseerStateUpdate-99055813941067785-127.0.0.1:41371_solr-n_0000000000) [n:127.0.0.1:41371_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"collection",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"collection_shard2_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:41371/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2318604 INFO (qtp35990933-20705) [n:127.0.0.1:40683_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=collection_shard1_replica_n1&action=CREATE&numShards=2&collection=collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2318604 INFO (qtp35990933-20705) [n:127.0.0.1:40683_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2318605 INFO (qtp1771646843-20707) [n:127.0.0.1:41371_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=collection_shard2_replica_n2&action=CREATE&numShards=2&collection=collection&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2318605 INFO (qtp1771646843-20707) [n:127.0.0.1:41371_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2318707 INFO (zkCallback-5095-thread-1-processing-n:127.0.0.1:41371_solr) [n:127.0.0.1:41371_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection/state.json] for collection [collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 2318707 INFO (zkCallback-5093-thread-1-processing-n:127.0.0.1:40683_solr) [n:127.0.0.1:40683_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection/state.json] for collection [collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 2318707 INFO (zkCallback-5095-thread-2-processing-n:127.0.0.1:41371_solr) [n:127.0.0.1:41371_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection/state.json] for collection [collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 2318707 INFO (zkCallback-5093-thread-2-processing-n:127.0.0.1:40683_solr) [n:127.0.0.1:40683_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection/state.json] for collection [collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 2319611 INFO (qtp35990933-20705) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 2319627 INFO (qtp1771646843-20707) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 2319631 INFO (qtp35990933-20705) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.s.IndexSchema [collection_shard1_replica_n1] Schema name=minimal
[junit4] 2> 2319632 INFO (qtp35990933-20705) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2319632 INFO (qtp35990933-20705) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'collection_shard1_replica_n1' using configuration from collection collection, trusted=true
[junit4] 2> 2319632 INFO (qtp35990933-20705) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40683.solr.core.collection.shard1.replica_n1' (registry 'solr.core.collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@594255a5
[junit4] 2> 2319632 INFO (qtp35990933-20705) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2319632 INFO (qtp35990933-20705) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.c.SolrCore [[collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.RemoteQueryErrorTest_D4810B6A60123671-001/tempDir-001/node3/collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.RemoteQueryErrorTest_D4810B6A60123671-001/tempDir-001/node3/./collection_shard1_replica_n1/data/]
[junit4] 2> 2319633 INFO (qtp1771646843-20707) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.s.IndexSchema [collection_shard2_replica_n2] Schema name=minimal
[junit4] 2> 2319634 INFO (qtp1771646843-20707) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2319634 INFO (qtp1771646843-20707) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'collection_shard2_replica_n2' using configuration from collection collection, trusted=true
[junit4] 2> 2319634 INFO (qtp1771646843-20707) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41371.solr.core.collection.shard2.replica_n2' (registry 'solr.core.collection.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@594255a5
[junit4] 2> 2319634 INFO (qtp1771646843-20707) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2319634 INFO (qtp1771646843-20707) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.c.SolrCore [[collection_shard2_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.RemoteQueryErrorTest_D4810B6A60123671-001/tempDir-001/node2/collection_shard2_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.RemoteQueryErrorTest_D4810B6A60123671-001/tempDir-001/node2/./collection_shard2_replica_n2/data/]
[junit4] 2> 2319687 INFO (qtp35990933-20705) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2319687 INFO (qtp35990933-20705) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2319689 INFO (qtp35990933-20705) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2319689 INFO (qtp35990933-20705) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2319689 INFO (qtp1771646843-20707) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2319690 INFO (qtp1771646843-20707) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2319690 INFO (qtp35990933-20705) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4e414e64[collection_shard1_replica_n1] main]
[junit4] 2> 2319691 INFO (qtp1771646843-20707) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2319691 INFO (qtp1771646843-20707) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2319692 INFO (qtp1771646843-20707) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@5dd02ef5[collection_shard2_replica_n2] main]
[junit4] 2> 2319694 INFO (qtp35990933-20705) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 2319694 INFO (qtp35990933-20705) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 2319695 INFO (qtp35990933-20705) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2319695 INFO (searcherExecutor-7456-thread-1-processing-n:127.0.0.1:40683_solr x:collection_shard1_replica_n1 s:shard1 c:collection r:core_node3) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.c.SolrCore [collection_shard1_replica_n1] Registered new searcher Searcher@4e414e64[collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2319695 INFO (qtp35990933-20705) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1584893024883703808
[junit4] 2> 2319697 INFO (qtp1771646843-20707) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 2319697 INFO (qtp1771646843-20707) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 2319698 INFO (qtp1771646843-20707) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2319699 INFO (searcherExecutor-7457-thread-1-processing-n:127.0.0.1:41371_solr x:collection_shard2_replica_n2 s:shard2 c:collection r:core_node4) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.c.SolrCore [collection_shard2_replica_n2] Registered new searcher Searcher@5dd02ef5[collection_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2319699 INFO (qtp1771646843-20707) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1584893024887898112
[junit4] 2> 2319699 INFO (qtp35990933-20705) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2319699 INFO (qtp35990933-20705) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2319699 INFO (qtp35990933-20705) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:40683/solr/collection_shard1_replica_n1/
[junit4] 2> 2319699 INFO (qtp35990933-20705) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 2319699 INFO (qtp35990933-20705) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:40683/solr/collection_shard1_replica_n1/ has no replicas
[junit4] 2> 2319699 INFO (qtp35990933-20705) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2319701 INFO (qtp35990933-20705) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:40683/solr/collection_shard1_replica_n1/ shard1
[junit4] 2> 2319701 INFO (qtp1771646843-20707) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2319701 INFO (qtp1771646843-20707) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2319701 INFO (qtp1771646843-20707) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:41371/solr/collection_shard2_replica_n2/
[junit4] 2> 2319701 INFO (qtp1771646843-20707) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 2319701 INFO (qtp1771646843-20707) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.c.SyncStrategy https://127.0.0.1:41371/solr/collection_shard2_replica_n2/ has no replicas
[junit4] 2> 2319701 INFO (qtp1771646843-20707) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2319703 INFO (qtp1771646843-20707) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:41371/solr/collection_shard2_replica_n2/ shard2
[junit4] 2> 2498283 ERROR (qtp1348605820-20704) [n:127.0.0.1:37993_solr ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: create the collection time out:180s
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:312)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:244)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:222)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2>
[junit4] 2> 2498283 INFO (qtp1348605820-20704) [n:127.0.0.1:37993_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf&name=collection&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2} status=500 QTime=180006
[junit4] 2> 2498283 ERROR (qtp1348605820-20704) [n:127.0.0.1:37993_solr ] o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: create the collection time out:180s
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:312)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:244)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:222)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2>
[junit4] 2> 2498284 INFO (TEST-RemoteQueryErrorTest.test-seed#[D4810B6A60123671]) [ ] o.a.s.SolrTestCaseJ4 ###Ending test
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=RemoteQueryErrorTest -Dtests.method=test -Dtests.seed=D4810B6A60123671 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en-150 -Dtests.timezone=Pacific/Fiji -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 180s J0 | RemoteQueryErrorTest.test <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:37993/solr: create the collection time out:180s
[junit4] > at __randomizedtesting.SeedInfo.seed([D4810B6A60123671:5CD534B0CEEE5B89]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1103)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:883)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:816)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
[junit4] > at org.apache.solr.cloud.RemoteQueryErrorTest.test(RemoteQueryErrorTest.java:46)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:564)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 2498288 INFO (jetty-closer-5079-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@6a3b8298{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 2498289 INFO (jetty-closer-5079-thread-1) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=398900517
[junit4] 2> 2498289 INFO (jetty-closer-5079-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 2498289 INFO (jetty-closer-5079-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@698c2b3f: rootName = solr_37993, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@6903bb9
[junit4] 2> 2498289 INFO (jetty-closer-5079-thread-2) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@36b9b1c0{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 2498290 INFO (jetty-closer-5079-thread-2) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=359980097
[junit4] 2> 2498290 ERROR (OverseerThreadFactory-7449-thread-1-processing-n:127.0.0.1:41371_solr) [n:127.0.0.1:41371_solr ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: https://127.0.0.1:40683/solr
[junit4] 2> org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:40683/solr
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
[junit4] 2> at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
[junit4] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] 2> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
[junit4] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] 2> at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:40683 failed to respond
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
[junit4] 2> at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
[junit4] 2> at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
[junit4] 2> at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
[junit4] 2> at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
[junit4] 2> at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
[junit4] 2> at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
[junit4] 2> at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
[junit4] 2> at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
[junit4] 2> at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
[junit4] 2> at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
[junit4] 2> at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
[junit4] 2> ... 12 more
[junit4] 2> 2498290 INFO (jetty-closer-5079-thread-3) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@27472a64{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 2498290 INFO (jetty-closer-5079-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 2498292 ERROR (OverseerThreadFactory-7449-thread-1-processing-n:127.0.0.1:41371_solr) [n:127.0.0.1:41371_solr ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: https://127.0.0.1:41371/solr
[junit4] 2> org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:41371/solr
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
[junit4] 2> at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
[junit4] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] 2> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
[junit4] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] 2> at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:41371 failed to respond
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
[junit4] 2> at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
[junit4] 2> at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
[junit4] 2> at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
[junit4] 2> at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
[junit4] 2> at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
[junit4] 2> at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
[junit4] 2> at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
[junit4] 2> at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
[junit4] 2> at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
[junit4] 2> at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
[junit4] 2> at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
[junit4] 2> ... 12 more
[junit4] 2> 2498293 ERROR (OverseerThreadFactory-7449-thread-1-processing-n:127.0.0.1:41371_solr) [n:127.0.0.1:41371_solr ] o.a.s.c.OverseerCollectionMessageHandler Cleaning up collection [collection].
[junit4] 2> 2498292 INFO (jetty-closer-5079-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@179a612: rootName = solr_40683, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@54c561aa
[junit4] 2> 2498292 INFO (jetty-closer-5079-thread-3) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=410804684
[junit4] 2> 2498293 INFO (jetty-closer-5079-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 2498293 INFO (OverseerThreadFactory-7449-thread-1-processing-n:127.0.0.1:41371_solr) [n:127.0.0.1:41371_solr ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
[junit4] 2> 2498293 INFO (jetty-closer-5079-thread-3) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@56ddb767: rootName = solr_41371, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@49c7b500
[junit4] 2> 2498294 ERROR (OverseerThreadFactory-7449-thread-1-processing-n:127.0.0.1:41371_solr) [n:127.0.0.1:41371_solr ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: https://127.0.0.1:41371/solr
[junit4] 2> org.apache.solr.client.solrj.SolrServerException: Server refused connection at: https://127.0.0.1:41371/solr
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:650)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
[junit4] 2> at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
[junit4] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] 2> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
[junit4] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] 2> at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> Caused by: org.apache.http.conn.HttpHostConnectException: Connect to 127.0.0.1:41371 [/127.0.0.1] failed: Connection refused (Connection refused)
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
[junit4] 2> at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
[junit4] 2> at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
[junit4] 2> at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
[junit4] 2> at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
[junit4] 2> at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
[junit4] 2> at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
[junit4] 2> at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
[junit4] 2> ... 12 more
[junit4] 2> Caused by: java.net.ConnectException: Connection refused (Connection refused)
[junit4] 2> at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
[junit4] 2> at java.base/java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:400)
[junit4] 2> at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:243)
[junit4] 2> at java.base/java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:225)
[junit4] 2> at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:402)
[junit4] 2> at java.base/java.net.Socket.connect(Socket.java:591)
[junit4] 2> at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
[junit4] 2> ... 22 more
[junit4] 2> 2498295 ERROR (OverseerThreadFactory-7449-thread-1-processing-n:127.0.0.1:41371_solr) [n:127.0.0.1:41371_solr ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: https://127.0.0.1:40683/solr
[junit4] 2> org.apache.solr.client.solrj.SolrServerException: Server refused connection at: https://127.0.0.1:40683/solr
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:650)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
[junit4] 2> at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
[junit4] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] 2> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
[junit4] 2> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] 2> at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
[junit4] 2> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> Caused by: org.apache.http.conn.HttpHostConnectException: Connect to 127.0.0.1:40683 [/127.0.0.1] failed: Connection refused (Connection refused)
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:159)
[junit4] 2> at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:359)
[junit4] 2> at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
[junit4] 2> at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
[junit4] 2> at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
[junit4] 2> at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
[junit4] 2> at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
[junit4] 2> at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
[junit4] 2> ... 12 more
[junit4] 2> Caused by: java.net.ConnectException: Connection refused (Connection refused)
[junit4] 2> at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
[junit4] 2> at java.base/java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:400)
[junit4] 2> at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:243)
[junit4] 2> at java.base/java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:225)
[junit4] 2> at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:402)
[junit4] 2> at java.base/java.net.Socket.connect(Socket.java:591)
[junit4] 2> at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:339)
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
[junit4] 2> ... 22 more
[junit4] 2> 2498301 INFO (jetty-closer-5079-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 2498301 INFO (jetty-closer-5079-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4493a425: rootName = solr_37993, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@2cab566d
[junit4] 2> 2498305 INFO (jetty-closer-5079-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 2498305 INFO (jetty-closer-5079-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@29147fc2: rootName = solr_40683, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@2cab566d
[junit4] 2> 2498305 INFO (jetty-closer-5079-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 2498306 INFO (jetty-closer-5079-thread-3) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2f45b729: rootName = solr_41371, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@2cab566d
[junit4] 2> 2498308 INFO (jetty-closer-5079-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 2498308 INFO (jetty-closer-5079-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@71938f7d: rootName = solr_37993, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@7b68d631
[junit4] 2> 2498309 INFO (jetty-closer-5079-thread-1) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:37993_solr
[junit4] 2> 2498310 INFO (jetty-closer-5079-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 2498310 INFO (zkCallback-5095-thread-4-processing-n:127.0.0.1:41371_solr) [n:127.0.0.1:41371_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 2498310 INFO (zkCallback-5091-thread-2-processing-n:127.0.0.1:37993_solr) [n:127.0.0.1:37993_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 2498310 INFO (jetty-closer-5079-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2498310 INFO (zkCallback-5093-thread-3-processing-n:127.0.0.1:40683_solr) [n:127.0.0.1:40683_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 2498312 INFO (jetty-closer-5079-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 2498312 INFO (jetty-closer-5079-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1b34676c: rootName = solr_40683, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@7b68d631
[junit4] 2> 2498312 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15feabceae50006, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 2498313 INFO (jetty-closer-5079-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 2498313 INFO (jetty-closer-5079-thread-3) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6ac3554c: rootName = solr_41371, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@7b68d631
[junit4] 2> 2498313 INFO (jetty-closer-5079-thread-2) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:40683_solr
[junit4] 2> 2498314 INFO (jetty-closer-5079-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 2498314 INFO (jetty-closer-5079-thread-3) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:41371_solr
[junit4] 2> 2498314 INFO (zkCallback-5095-thread-4-processing-n:127.0.0.1:41371_solr) [n:127.0.0.1:41371_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2498314 INFO (zkCallback-5093-thread-4-processing-n:127.0.0.1:40683_solr) [n:127.0.0.1:40683_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2498315 INFO (jetty-closer-5079-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 2498317 INFO (coreCloseExecutor-7467-thread-1) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.c.SolrCore [collection_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@570e345b
[junit4] 2> 2498318 INFO (coreCloseExecutor-7467-thread-1) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection.shard1.replica_n1, tag=1460548699
[junit4] 2> 2498318 INFO (coreCloseExecutor-7467-thread-1) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@50fb69: rootName = solr_40683, domain = solr.core.collection.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.collection.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@9ffe64a
[junit4] 2> 2498318 INFO (zkCallback-5093-thread-3-processing-n:127.0.0.1:40683_solr) [n:127.0.0.1:40683_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 2498318 INFO (zkCallback-5095-thread-5-processing-n:127.0.0.1:41371_solr) [n:127.0.0.1:41371_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 2498321 INFO (coreCloseExecutor-7468-thread-1) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.c.SolrCore [collection_shard2_replica_n2] CLOSING SolrCore org.apache.solr.core.SolrCore@524c1656
[junit4] 2> 2498322 INFO (coreCloseExecutor-7468-thread-1) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection.shard2.replica_n2, tag=1380718166
[junit4] 2> 2498322 INFO (coreCloseExecutor-7468-thread-1) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@16c95353: rootName = solr_41371, domain = solr.core.collection.shard2.replica_n2, service url = null, agent id = null] for registry solr.core.collection.shard2.replica_n2 / com.codahale.metrics.MetricRegistry@84cdb9a
[junit4] 2> 2498332 INFO (coreCloseExecutor-7467-thread-1) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection.shard1.leader, tag=1460548699
[junit4] 2> 2498333 INFO (jetty-closer-5079-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@19baabf6{/solr,null,UNAVAILABLE}
[junit4] 2> 2498334 INFO (coreCloseExecutor-7468-thread-1) [n:127.0.0.1:41371_solr c:collection s:shard2 r:core_node4 x:collection_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection.shard2.leader, tag=1380718166
[junit4] 2> 2498334 INFO (jetty-closer-5079-thread-3) [ ] o.a.s.c.Overseer Overseer (id=99055813941067785-127.0.0.1:41371_solr-n_0000000000) closing
[junit4] 2> 2498334 INFO (OverseerStateUpdate-99055813941067785-127.0.0.1:41371_solr-n_0000000000) [n:127.0.0.1:41371_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:41371_solr
[junit4] 2> 2498363 ERROR (qtp35990933-20705) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.c.ZkController Error getting leader from zk
[junit4] 2> org.apache.solr.common.SolrException: No registered leader was found after waiting for 1220000ms , collection: collection slice: shard1 saw state=DocCollection(collection//collections/collection/state.json/2)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "shards":{
[junit4] 2> "shard1":{
[junit4] 2> "range":"80000000-ffffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node3":{
[junit4] 2> "core":"collection_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:40683/solr",
[junit4] 2> "node_name":"127.0.0.1:40683_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"}}},
[junit4] 2> "shard2":{
[junit4] 2> "range":"0-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node4":{
[junit4] 2> "core":"collection_shard2_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:41371/solr",
[junit4] 2> "node_name":"127.0.0.1:41371_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"}}}},
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"1",
[junit4] 2> "tlogReplicas":"0"} with live_nodes=[]
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:771)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:736)
[junit4] 2> at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1178)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:1079)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:1014)
[junit4] 2> at org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:181)
[junit4] 2> at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:208)
[junit4] 2> at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:886)
[junit4] 2> at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1047)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:948)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 2498363 ERROR (qtp35990933-20705) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.c.ZkContainer :org.apache.solr.common.SolrException: Error getting leader from zk for shard shard1
[junit4] 2> at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1207)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:1079)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:1014)
[junit4] 2> at org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:181)
[junit4] 2> at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:208)
[junit4] 2> at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:886)
[junit4] 2> at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1047)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:948)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> Caused by: org.apache.solr.common.SolrException: No registered leader was found after waiting for 1220000ms , collection: collection slice: shard1 saw state=DocCollection(collection//collections/collection/state.json/2)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "shards":{
[junit4] 2> "shard1":{
[junit4] 2> "range":"80000000-ffffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node3":{
[junit4] 2> "core":"collection_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:40683/solr",
[junit4] 2> "node_name":"127.0.0.1:40683_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"}}},
[junit4] 2> "shard2":{
[junit4] 2> "range":"0-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node4":{
[junit4] 2> "core":"collection_shard2_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:41371/solr",
[junit4] 2> "node_name":"127.0.0.1:41371_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"}}}},
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"1",
[junit4] 2> "tlogReplicas":"0"} with live_nodes=[]
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:771)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:736)
[junit4] 2> at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1178)
[junit4] 2> ... 44 more
[junit4] 2>
[junit4] 2> 2498371 INFO (qtp35990933-20705) [n:127.0.0.1:40683_solr c:collection s:shard1 r:core_node3 x:collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=collection_shard1_replica_n1&action=CREATE&numShards=2&collection=collection&shard=
[...truncated too long message...]
e changes
[junit4] 2> 2528391 INFO (SUITE-RemoteQueryErrorTest-seed#[D4810B6A60123671]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46385 46385
[junit4] 2> 2534340 INFO (Thread-4006) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46385 46385
[junit4] 2> 2534340 WARN (Thread-4006) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/aliases.json
[junit4] 2> 3 /solr/security.json
[junit4] 2> 2 /solr/configs/conf
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/collections/collection/state.json
[junit4] 2> 4 /solr/clusterstate.json
[junit4] 2> 4 /solr/clusterprops.json
[junit4] 2> 2 /solr/overseer_elect/election/99055813941067785-127.0.0.1:41371_solr-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/live_nodes
[junit4] 2> 4 /solr/collections
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.RemoteQueryErrorTest_D4810B6A60123671-001
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarity(queryNorm=false): {}, locale=en-150, timezone=Pacific/Fiji
[junit4] 2> NOTE: Linux 4.10.0-37-generic amd64/Oracle Corporation 9.0.1 (64-bit)/cpus=8,threads=1,free=203398360,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [HdfsSyncSliceTest, TermVectorComponentTest, TestSha256AuthenticationProvider, TestCSVLoader, TestRebalanceLeaders, TestSolrCloudWithDelegationTokens, OverseerTaskQueueTest, SpellCheckCollatorTest, SolrShardReporterTest, NoCacheHeaderTest, TestCryptoKeys, SimpleCollectionCreateDeleteTest, GraphQueryTest, HdfsUnloadDistributedZkTest, SpatialFilterTest, MoveReplicaTest, EnumFieldTest, TestCollectionAPIs, SpatialHeatmapFacetsTest, TestLuceneIndexBackCompat, TestSolrFieldCacheBean, TestStressVersions, TestConfigSetsAPI, TestObjectReleaseTracker, OutOfBoxZkACLAndCredentialsProvidersTest, StatelessScriptUpdateProcessorFactoryTest, TestBinaryField, TestUpdate, RestartWhileUpdatingTest, PrimitiveFieldTypeTest, TestCodecSupport, ZkFailoverTest, TestHalfAndHalfDocValues, TestFieldSortValues, ResponseHeaderTest, LeaderInitiatedRecoveryOnShardRestartTest, TestSolrDeletionPolicy1, TestShortCircuitedRequests, TestJsonFacetRefinement, CursorPagingTest, SolrCoreTest, TestIndexingPerformance, ExplicitHLLTest, CollectionStateFormat2Test, TestFieldCacheReopen, TestBadConfig, TestDistributedSearch, TestBackupRepositoryFactory, BasicFunctionalityTest, CleanupOldIndexTest, BigEndianAscendingWordDeserializerTest, TestNumericRangeQuery64, BasicZkTest, CdcrReplicationHandlerTest, TestManagedStopFilterFactory, TestTrieFacet, BadCopyFieldTest, AnalyticsMergeStrategyTest, AutoScalingHandlerTest, IndexSchemaRuntimeFieldTest, SoftAutoCommitTest, TestCrossCoreJoin, TestPullReplicaErrorHandling, ConfigureRecoveryStrategyTest, SegmentsInfoRequestHandlerTest, LeaderFailoverAfterPartitionTest, DeleteInactiveReplicaTest, BlockJoinFacetDistribTest, CacheHeaderTest, TestClusterStateMutator, TestConfigSetProperties, SearchHandlerTest, TestNumericTerms32, TestLegacyTerms, TestMaxScoreQueryParser, CollectionsAPISolrJTest, TestClusterProperties, ActionThrottleTest, ClassificationUpdateProcessorTest, DistribCursorPagingTest, DocumentBuilderTest, TestHighlightDedupGrouping, TestNoOpRegenerator, TestRandomFaceting, TestAuthorizationFramework, TestRawTransformer, TestPostingsSolrHighlighter, TestUtils, PeerSyncTest, TestSQLHandler, TestSweetSpotSimilarityFactory, BlobRepositoryCloudTest, CurrencyFieldTypeTest, SaslZkACLProviderTest, HLLUtilTest, DataDrivenBlockJoinTest, TestDFRSimilarityFactory, TestQueryUtils, TestSolrConfigHandlerConcurrent, TestSort, MultiTermTest, TestJoin, UpdateRequestProcessorFactoryTest, ConnectionManagerTest, MinimalSchemaTest, SliceStateTest, TestReloadDeadlock, TestCloudInspectUtil, TestCloudPseudoReturnFields, TestSolrJ, DistributedFacetPivotLargeTest, AssignBackwardCompatibilityTest, CdcrBidirectionalTest, CoreAdminRequestStatusTest, DocValuesTest, SolrPluginUtilsTest, SolrXmlInZkTest, ResourceLoaderTest, HdfsAutoAddReplicasIntegrationTest, TestEmbeddedSolrServerSchemaAPI, TestReloadAndDeleteDocs, TestSubQueryTransformerDistrib, UnloadDistributedZkTest, OverseerTest, LeaderElectionTest, ZkSolrClientTest, TestRecovery, DistributedTermsComponentTest, StatsComponentTest, SolrCmdDistributorTest, BadIndexSchemaTest, ConvertedLegacyTest, TestFunctionQuery, HighlighterTest, DistributedQueryElevationComponentTest, AnalysisAfterCoreReloadTest, SignatureUpdateProcessorFactoryTest, TestExtendedDismaxParser, SuggesterFSTTest, SolrRequestParserTest, TestFoldingMultitermQuery, SuggesterTSTTest, SuggesterWFSTTest, FieldMutatingUpdateProcessorTest, TestAtomicUpdateErrorCases, TestWordDelimiterFilterFactory, SortByFunctionTest, TestWriterPerf, TestQueryTypes, FileBasedSpellCheckerTest, XmlUpdateRequestHandlerTest, TestValueSourceCache, MoreLikeThisHandlerTest, FieldAnalysisRequestHandlerTest, RegexBoostProcessorTest, ReturnFieldsTest, TestAnalyzedSuggestions, BinaryUpdateRequestHandlerTest, TestPHPSerializedResponseWriter, HighlighterConfigTest, SOLR749Test, TestQuerySenderListener, UpdateParamsTest, AlternateDirectoryTest, TestSolrIndexConfig, TestQuerySenderNoQuery, ResponseLogComponentTest, BadComponentTest, TestStressRecovery, PrimUtilsTest, TestSuggestSpellingConverter, DateFieldTest, SpellingQueryConverterTest, DOMUtilTest, RAMDirectoryFactoryTest, ClusterStateTest, ZkNodePropsTest, UUIDFieldTest, FileUtilsTest, CircularListTest, DistributedMLTComponentTest, TestRTGBase, TestCursorMarkWithoutUniqueKey, TestEmbeddedSolrServerAdminHandler, AddReplicaTest, AliasIntegrationTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, ConcurrentDeleteAndCreateCollectionTest, CustomCollectionTest, DeleteNodeTest, DeleteStatusTest, DistributedQueueTest, HttpPartitionTest, LegacyCloudClusterPropTest, MoveReplicaHDFSFailoverTest, OverseerCollectionConfigSetProcessorTest, OverseerModifyCollectionTest, OverseerStatusTest, PeerSyncReplicationTest, RecoveryAfterSoftCommitTest, RemoteQueryErrorTest]
[junit4] Completed [526/749 (1!)] on J0 in 216.40s, 1 test, 1 error <<< FAILURES!
[...truncated 3697 lines...]
[junit4] Suite: org.apache.solr.analytics.facet.QueryFacetTest
[junit4] 2> log4j:WARN No appenders could be found for logger (org.apache.solr.SolrTestCaseJ4).
[junit4] 2> log4j:WARN Please initialize the log4j system properly.
[junit4] 2> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-analytics/test/J1/temp/solr.analytics.facet.QueryFacetTest_C1C2584EF1755A77-001/init-core-data-001
[junit4] 2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=11592, maxDocsPerChunk=9, blockSize=789), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=11592, blockSize=789)), sim=RandomSimilarity(queryNorm=false): {}, locale=teo-UG, timezone=America/Argentina/Salta
[junit4] 2> NOTE: Linux 4.10.0-37-generic amd64/Oracle Corporation 9.0.1 (64-bit)/cpus=8,threads=1,free=345489240,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [QueryFacetTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=QueryFacetTest -Dtests.seed=C1C2584EF1755A77 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=teo-UG -Dtests.timezone=America/Argentina/Salta -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J1 | QueryFacetTest (suite) <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:42965/solr: Could not fully create collection: collection1
[junit4] > at __randomizedtesting.SeedInfo.seed([C1C2584EF1755A77]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1103)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:883)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:816)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
[junit4] > at org.apache.solr.analytics.SolrAnalyticsTestCase.setupCollection(SolrAnalyticsTestCase.java:62)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:564)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] Completed [51/78 (1!)] on J1 in 42.19s, 0 tests, 1 error <<< FAILURES!
[...truncated 37145 lines...]
[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk-9.0.1) - Build # 887 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/887/
Java: 64bit/jdk-9.0.1 -XX:+UseCompressedOops -XX:+UseSerialGC
2 tests failed.
FAILED: org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test
Error Message:
Expected 2 of 3 replicas to be active but only found 1; [core_node5:{"core":"c8n_1x3_lf_shard1_replica_t2","base_url":"http://127.0.0.1:35241","node_name":"127.0.0.1:35241_","state":"active","type":"TLOG","leader":"true"}]; clusterState: DocCollection(c8n_1x3_lf//collections/c8n_1x3_lf/state.json/16)={ "pullReplicas":"0", "replicationFactor":"1", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{ "core_node4":{ "state":"down", "base_url":"http://127.0.0.1:34453", "core":"c8n_1x3_lf_shard1_replica_t1", "node_name":"127.0.0.1:34453_", "type":"TLOG"}, "core_node5":{ "core":"c8n_1x3_lf_shard1_replica_t2", "base_url":"http://127.0.0.1:35241", "node_name":"127.0.0.1:35241_", "state":"active", "type":"TLOG", "leader":"true"}, "core_node6":{ "core":"c8n_1x3_lf_shard1_replica_t3", "base_url":"http://127.0.0.1:45287", "node_name":"127.0.0.1:45287_", "state":"down", "type":"TLOG"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"0", "tlogReplicas":"3"}
Stack Trace:
java.lang.AssertionError: Expected 2 of 3 replicas to be active but only found 1; [core_node5:{"core":"c8n_1x3_lf_shard1_replica_t2","base_url":"http://127.0.0.1:35241","node_name":"127.0.0.1:35241_","state":"active","type":"TLOG","leader":"true"}]; clusterState: DocCollection(c8n_1x3_lf//collections/c8n_1x3_lf/state.json/16)={
"pullReplicas":"0",
"replicationFactor":"1",
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{
"core_node4":{
"state":"down",
"base_url":"http://127.0.0.1:34453",
"core":"c8n_1x3_lf_shard1_replica_t1",
"node_name":"127.0.0.1:34453_",
"type":"TLOG"},
"core_node5":{
"core":"c8n_1x3_lf_shard1_replica_t2",
"base_url":"http://127.0.0.1:35241",
"node_name":"127.0.0.1:35241_",
"state":"active",
"type":"TLOG",
"leader":"true"},
"core_node6":{
"core":"c8n_1x3_lf_shard1_replica_t3",
"base_url":"http://127.0.0.1:45287",
"node_name":"127.0.0.1:45287_",
"state":"down",
"type":"TLOG"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false",
"nrtReplicas":"0",
"tlogReplicas":"3"}
at __randomizedtesting.SeedInfo.seed([9B469A8D814180D1:1312A5572FBDED29]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.testRf3WithLeaderFailover(LeaderFailoverAfterPartitionTest.java:169)
at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test(LeaderFailoverAfterPartitionTest.java:56)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigReplication
Error Message:
Index 0 out-of-bounds for length 0
Stack Trace:
java.lang.IndexOutOfBoundsException: Index 0 out-of-bounds for length 0
at __randomizedtesting.SeedInfo.seed([9B469A8D814180D1:8F0EC1D8A2463DCF]:0)
at java.base/jdk.internal.util.Preconditions.outOfBounds(Preconditions.java:64)
at java.base/jdk.internal.util.Preconditions.outOfBoundsCheckIndex(Preconditions.java:70)
at java.base/jdk.internal.util.Preconditions.checkIndex(Preconditions.java:248)
at java.base/java.util.Objects.checkIndex(Objects.java:372)
at java.base/java.util.ArrayList.get(ArrayList.java:440)
at org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigReplication(TestReplicationHandler.java:561)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 12455 lines...]
[junit4] Suite: org.apache.solr.handler.TestReplicationHandler
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_9B469A8D814180D1-001/init-core-data-001
[junit4] 2> 1217800 WARN (SUITE-TestReplicationHandler-seed#[9B469A8D814180D1]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=10 numCloses=10
[junit4] 2> 1217800 INFO (SUITE-TestReplicationHandler-seed#[9B469A8D814180D1]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 1217801 INFO (SUITE-TestReplicationHandler-seed#[9B469A8D814180D1]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="None")
[junit4] 2> 1217801 INFO (SUITE-TestReplicationHandler-seed#[9B469A8D814180D1]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1217803 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.SolrTestCaseJ4 ###Starting doTestReplicateAfterStartup
[junit4] 2> 1217803 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_9B469A8D814180D1-001/solr-instance-001/collection1
[junit4] 2> 1217807 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1217808 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@20507cc8{/solr,null,AVAILABLE}
[junit4] 2> 1217810 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@27ddc602{HTTP/1.1,[http/1.1]}{127.0.0.1:44035}
[junit4] 2> 1217810 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.e.j.s.Server Started @1220180ms
[junit4] 2> 1217810 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_9B469A8D814180D1-001/solr-instance-001/collection1/data, hostPort=44035}
[junit4] 2> 1217810 ERROR (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1217810 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.2.0
[junit4] 2> 1217811 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 1217811 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1217811 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-23T17:35:25.475255Z
[junit4] 2> 1217811 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_9B469A8D814180D1-001/solr-instance-001/solr.xml
[junit4] 2> 1217816 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1217816 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1217817 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@447a74cf, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1217867 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@447a74cf
[junit4] 2> 1217873 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@447a74cf
[junit4] 2> 1217873 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@447a74cf
[junit4] 2> 1217875 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_9B469A8D814180D1-001/solr-instance-001/.
[junit4] 2> 1217875 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 1217875 INFO (coreLoadExecutor-4712-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1217878 INFO (coreLoadExecutor-4712-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 1217881 INFO (coreLoadExecutor-4712-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1217882 INFO (coreLoadExecutor-4712-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 1217882 INFO (coreLoadExecutor-4712-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_9B469A8D814180D1-001/solr-instance-001/./collection1, trusted=true
[junit4] 2> 1217882 INFO (coreLoadExecutor-4712-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@447a74cf
[junit4] 2> 1217882 INFO (coreLoadExecutor-4712-thread-1) [ x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1217882 INFO (coreLoadExecutor-4712-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_9B469A8D814180D1-001/solr-instance-001/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_9B469A8D814180D1-001/solr-instance-001/./collection1/data/]
[junit4] 2> 1217883 INFO (coreLoadExecutor-4712-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=39, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=62.3505859375, floorSegmentMB=0.3232421875, forceMergeDeletesPctAllowed=24.977294607144763, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1217902 INFO (coreLoadExecutor-4712-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1217902 INFO (coreLoadExecutor-4712-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1217902 INFO (coreLoadExecutor-4712-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=19, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5062161678342293]
[junit4] 2> 1217903 INFO (coreLoadExecutor-4712-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@105ba4b9[collection1] main]
[junit4] 2> 1217903 INFO (coreLoadExecutor-4712-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_9B469A8D814180D1-001/solr-instance-001/collection1/conf
[junit4] 2> 1217903 INFO (coreLoadExecutor-4712-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4] 2> 1217903 INFO (coreLoadExecutor-4712-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1217904 INFO (searcherExecutor-4713-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@105ba4b9[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1217904 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_9B469A8D814180D1-001/solr-instance-002/collection1
[junit4] 2> 1217905 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1217905 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3857809a{/solr,null,AVAILABLE}
[junit4] 2> 1217906 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@459d21ce{HTTP/1.1,[http/1.1]}{127.0.0.1:42591}
[junit4] 2> 1217906 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.e.j.s.Server Started @1220276ms
[junit4] 2> 1217906 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_9B469A8D814180D1-001/solr-instance-002/collection1/data, hostPort=42591}
[junit4] 2> 1217906 ERROR (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1217906 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.2.0
[junit4] 2> 1217906 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 1217906 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1217906 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-23T17:35:25.570786Z
[junit4] 2> 1217906 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_9B469A8D814180D1-001/solr-instance-002/solr.xml
[junit4] 2> 1217908 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1217908 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1217908 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@447a74cf, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1217924 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@447a74cf
[junit4] 2> 1217930 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@447a74cf
[junit4] 2> 1217930 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@447a74cf
[junit4] 2> 1217932 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_9B469A8D814180D1-001/solr-instance-002/.
[junit4] 2> 1217932 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 1217932 INFO (coreLoadExecutor-4722-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1217935 INFO (coreLoadExecutor-4722-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 1217948 INFO (coreLoadExecutor-4722-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1217949 INFO (coreLoadExecutor-4722-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 1217949 INFO (coreLoadExecutor-4722-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_9B469A8D814180D1-001/solr-instance-002/./collection1, trusted=true
[junit4] 2> 1217949 INFO (coreLoadExecutor-4722-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@447a74cf
[junit4] 2> 1217949 INFO (coreLoadExecutor-4722-thread-1) [ x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1217949 INFO (coreLoadExecutor-4722-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_9B469A8D814180D1-001/solr-instance-002/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_9B469A8D814180D1-001/solr-instance-002/./collection1/data/]
[junit4] 2> 1217950 INFO (coreLoadExecutor-4722-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=39, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=62.3505859375, floorSegmentMB=0.3232421875, forceMergeDeletesPctAllowed=24.977294607144763, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1217972 INFO (coreLoadExecutor-4722-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1217972 INFO (coreLoadExecutor-4722-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1217972 INFO (coreLoadExecutor-4722-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=19, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5062161678342293]
[junit4] 2> 1217972 INFO (coreLoadExecutor-4722-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@52d1d9f4[collection1] main]
[junit4] 2> 1217973 INFO (coreLoadExecutor-4722-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_9B469A8D814180D1-001/solr-instance-002/collection1/conf
[junit4] 2> 1217973 INFO (coreLoadExecutor-4722-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms
[junit4] 2> 1217973 INFO (coreLoadExecutor-4722-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1217974 INFO (searcherExecutor-4723-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@52d1d9f4[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1217975 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@459d21ce{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 1217975 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=109698619
[junit4] 2> 1217975 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 1217975 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@17d53128: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@138d423d
[junit4] 2> 1217979 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1217979 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@49a156a8: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@243af000
[junit4] 2> 1217981 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1217982 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4957f05d: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@312d866c
[junit4] 2> 1217982 INFO (coreCloseExecutor-4728-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@7876839e
[junit4] 2> 1217982 INFO (coreCloseExecutor-4728-thread-1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=2021032862
[junit4] 2> 1217982 INFO (coreCloseExecutor-4728-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2c2748f5: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@1f98b2e3
[junit4] 2> 1217987 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3857809a{/solr,null,UNAVAILABLE}
[junit4] 2> 1217987 INFO (qtp437608020-10958) [ x:collection1] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
[junit4] 2> 1217987 INFO (qtp437608020-10958) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{deleteByQuery=*:*} 0 0
[junit4] 2> 1217988 INFO (qtp437608020-10959) [ x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 1217988 INFO (qtp437608020-10959) [ x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@55056a7d commitCommandVersion:0
[junit4] 2> 1217988 INFO (qtp437608020-10959) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1aff8496[collection1] main]
[junit4] 2> 1217988 INFO (qtp437608020-10959) [ x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 1217989 INFO (searcherExecutor-4713-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1aff8496[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1217989 INFO (qtp437608020-10959) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 1
[junit4] 2> 1217997 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@27ddc602{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 1217997 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1470050951
[junit4] 2> 1217997 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 1217997 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@35b3ae45: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@3a11b311
[junit4] 2> 1217998 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1217998 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6cf825be: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@243af000
[junit4] 2> 1218000 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1218000 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@65bc1d3f: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@312d866c
[junit4] 2> 1218000 INFO (coreCloseExecutor-4730-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@32b46404
[junit4] 2> 1218000 INFO (coreCloseExecutor-4730-thread-1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=850682884
[junit4] 2> 1218001 INFO (coreCloseExecutor-4730-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3b0c6c1b: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@2110408f
[junit4] 2> 1218002 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@20507cc8{/solr,null,UNAVAILABLE}
[junit4] 2> 1218003 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1218004 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1b40001e{/solr,null,AVAILABLE}
[junit4] 2> 1218004 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@79d0accd{HTTP/1.1,[http/1.1]}{127.0.0.1:44881}
[junit4] 2> 1218004 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.e.j.s.Server Started @1220374ms
[junit4] 2> 1218004 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_9B469A8D814180D1-001/solr-instance-001/collection1/data, hostPort=44881}
[junit4] 2> 1218004 ERROR (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1218005 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.2.0
[junit4] 2> 1218005 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 1218005 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1218005 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-23T17:35:25.669154Z
[junit4] 2> 1218005 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_9B469A8D814180D1-001/solr-instance-001/solr.xml
[junit4] 2> 1218006 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1218006 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1218007 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@447a74cf, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1218022 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@447a74cf
[junit4] 2> 1218028 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@447a74cf
[junit4] 2> 1218028 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@447a74cf
[junit4] 2> 1218029 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_9B469A8D814180D1-001/solr-instance-001/.
[junit4] 2> 1218029 INFO (TEST-TestReplicationHandler.doTestReplicateAfterStartup-seed#[9B469A8D814180D1]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 1218030 INFO (coreLoadExecutor-4737-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1218034 INFO (coreLoadExecutor-4737-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 1218038 INFO (coreLoadExecutor-4737-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1218039 INFO (coreLoadExecutor-4737-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
[junit4] 2> 1218039 INFO (coreLoadExecutor-4737-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_9B469A8D814180D1-001/solr-instance-001/./collection1, trusted=true
[junit4] 2> 1218039 INFO (coreLoadExecutor-4737-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@447a74cf
[junit4] 2> 1218039 INFO (coreLoadExecutor-4737-thread-1) [ x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1218039 INFO (coreLoadExecutor-4737-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_9B469A8D814180D1-001/solr-instance-001/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_9B469A8D814180D1-001/solr-instance-001/./collection1/data/]
[junit4] 2> 1218040 INFO (coreLoadExecutor-4737-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=39, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=62.3505859375, floorSegmentMB=0.3232421875, forceMergeDeletesPctAllowed=24.977294607144763, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1218069 INFO (coreLoadExecutor-4737-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1218069 INFO (coreLoadExecutor-4737-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1218070 INFO (coreLoadExecutor-4737-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=19, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5062161678342293]
[junit4] 2> 1218070 INFO (coreLoadExecutor-4737-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4cf6d5a5[collection1] main]
[junit4] 2> 1218070 INFO (coreLoadExecutor-4737-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_9B469A8D814180D1-001/solr-instance-001/collection1/conf
[junit4] 2> 1218070 INFO (coreLoadExecutor-4737-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml
[junit4] 2> 1218070 INFO (coreLoadExecutor-4737-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1218071 INFO (searcherExecutor-4738-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4cf6d5a5[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1218072 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[0]} 0 0
[junit4] 2> 1218072 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[1]} 0 0
[junit4] 2> 1218073 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[2]} 0 0
[junit4] 2> 1218073 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[3]} 0 0
[junit4] 2> 1218073 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[4]} 0 0
[junit4] 2> 1218073 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[5]} 0 0
[junit4] 2> 1218074 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[6]} 0 0
[junit4] 2> 1218074 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[7]} 0 0
[junit4] 2> 1218074 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[8]} 0 0
[junit4] 2> 1218074 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[9]} 0 0
[junit4] 2> 1218074 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[10]} 0 0
[junit4] 2> 1218074 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[11]} 0 0
[junit4] 2> 1218075 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[12]} 0 0
[junit4] 2> 1218075 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[13]} 0 0
[junit4] 2> 1218075 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[14]} 0 0
[junit4] 2> 1218075 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[15]} 0 0
[junit4] 2> 1218075 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[16]} 0 0
[junit4] 2> 1218075 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[17]} 0 0
[junit4] 2> 1218076 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[18]} 0 0
[junit4] 2> 1218076 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[19]} 0 0
[junit4] 2> 1218076 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[20]} 0 0
[junit4] 2> 1218076 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[21]} 0 0
[junit4] 2> 1218076 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[22]} 0 0
[junit4] 2> 1218076 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[23]} 0 0
[junit4] 2> 1218077 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[24]} 0 0
[junit4] 2> 1218077 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[25]} 0 0
[junit4] 2> 1218077 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[26]} 0 0
[junit4] 2> 1218077 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[27]} 0 0
[junit4] 2> 1218077 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[28]} 0 0
[junit4] 2> 1218077 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[29]} 0 0
[junit4] 2> 1218077 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[30]} 0 0
[junit4] 2> 1218078 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[31]} 0 0
[junit4] 2> 1218078 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[32]} 0 0
[junit4] 2> 1218078 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[33]} 0 0
[junit4] 2> 1218078 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[34]} 0 0
[junit4] 2> 1218078 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[35]} 0 0
[junit4] 2> 1218078 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[36]} 0 0
[junit4] 2> 1218078 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[37]} 0 0
[junit4] 2> 1218078 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[38]} 0 0
[junit4] 2> 1218079 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[39]} 0 0
[junit4] 2> 1218079 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[40]} 0 0
[junit4] 2> 1218079 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[41]} 0 0
[junit4] 2> 1218079 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[42]} 0 0
[junit4] 2> 1218079 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[43]} 0 0
[junit4] 2> 1218079 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[44]} 0 0
[junit4] 2> 1218079 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[45]} 0 0
[junit4] 2> 1218079 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[46]} 0 0
[junit4] 2> 1218079 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[47]} 0 0
[junit4] 2> 1218080 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[48]} 0 0
[junit4] 2> 1218080 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[49]} 0 0
[junit4] 2> 1218080 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[50]} 0 0
[junit4] 2> 1218080 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[51]} 0 0
[junit4] 2> 1218080 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[52]} 0 0
[junit4] 2> 1218080 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[53]} 0 0
[junit4] 2> 1218080 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[54]} 0 0
[junit4] 2> 1218080 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[55]} 0 0
[junit4] 2> 1218081 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[56]} 0 0
[junit4] 2> 1218081 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[57]} 0 0
[junit4] 2> 1218081 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[58]} 0 0
[junit4] 2> 1218081 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[59]} 0 0
[junit4] 2> 1218081 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[60]} 0 0
[junit4] 2> 1218081 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[61]} 0 0
[junit4] 2> 1218081 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[62]} 0 0
[junit4] 2> 1218082 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[63]} 0 0
[junit4] 2> 1218082 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[64]} 0 0
[junit4] 2> 1218082 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[65]} 0 0
[junit4] 2> 1218082 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[66]} 0 0
[junit4] 2> 1218082 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[67]} 0 0
[junit4] 2> 1218082 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[68]} 0 0
[junit4] 2> 1218082 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[69]} 0 0
[junit4] 2> 1218082 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[70]} 0 0
[junit4] 2> 1218083 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[71]} 0 0
[junit4] 2> 1218083 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[72]} 0 0
[junit4] 2> 1218083 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[73]} 0 0
[junit4] 2> 1218083 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[74]} 0 0
[junit4] 2> 1218083 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[75]} 0 0
[junit4] 2> 1218083 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[76]} 0 0
[junit4] 2> 1218083 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[77]} 0 0
[junit4] 2> 1218084 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[78]} 0 0
[junit4] 2> 1218084 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[79]} 0 0
[junit4] 2> 1218084 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[80]} 0 0
[junit4] 2> 1218084 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[81]} 0 0
[junit4] 2> 1218084 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[82]} 0 0
[junit4] 2> 1218084 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[83]} 0 0
[junit4] 2> 1218084 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[84]} 0 0
[junit4] 2> 1218085 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[85]} 0 0
[junit4] 2> 1218085 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[86]} 0 0
[junit4] 2> 1218085 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[87]} 0 0
[junit4] 2> 1218085 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[88]} 0 0
[junit4] 2> 1218085 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[89]} 0 0
[junit4] 2> 1218085 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[90]} 0 0
[junit4] 2> 1218085 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[91]} 0 0
[junit4] 2> 1218086 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[92]} 0 0
[junit4] 2> 1218086 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[93]} 0 0
[junit4] 2> 1218086 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[94]} 0 0
[junit4] 2> 1218086 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[95]} 0 0
[junit4] 2> 1218086 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[96]} 0 0
[junit4] 2> 1218086 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[97]} 0 0
[junit4] 2> 1218086 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[98]} 0 0
[junit4] 2> 1218087 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[99]} 0 0
[junit4] 2> 1218087 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[100]} 0 0
[junit4] 2> 1218087 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[101]} 0 0
[junit4] 2> 1218087 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[102]} 0 0
[junit4] 2> 1218087 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[103]} 0 0
[junit4] 2> 1218087 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[104]} 0 0
[junit4] 2> 1218087 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[105]} 0 0
[junit4] 2> 1218088 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[106]} 0 0
[junit4] 2> 1218088 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[107]} 0 0
[junit4] 2> 1218088 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[108]} 0 0
[junit4] 2> 1218088 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[109]} 0 0
[junit4] 2> 1218088 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[110]} 0 0
[junit4] 2> 1218088 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[111]} 0 0
[junit4] 2> 1218088 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[112]} 0 0
[junit4] 2> 1218089 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[113]} 0 0
[junit4] 2> 1218089 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[114]} 0 0
[junit4] 2> 1218089 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[115]} 0 0
[junit4] 2> 1218089 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[116]} 0 0
[junit4] 2> 1218089 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[117]} 0 0
[junit4] 2> 1218089 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[118]} 0 0
[junit4] 2> 1218089 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[119]} 0 0
[junit4] 2> 1218090 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[120]} 0 0
[junit4] 2> 1218090 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[121]} 0 0
[junit4] 2> 1218090 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[122]} 0 0
[junit4] 2> 1218090 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[123]} 0 0
[junit4] 2> 1218090 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[124]} 0 0
[junit4] 2> 1218091 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[125]} 0 0
[junit4] 2> 1218091 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[126]} 0 0
[junit4] 2> 1218091 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[127]} 0 0
[junit4] 2> 1218091 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[128]} 0 0
[junit4] 2> 1218091 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[129]} 0 0
[junit4] 2> 1218091 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[130]} 0 0
[junit4] 2> 1218092 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[131]} 0 0
[junit4] 2> 1218092 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[132]} 0 0
[junit4] 2> 1218092 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[133]} 0 0
[junit4] 2> 1218092 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[134]} 0 0
[junit4] 2> 1218092 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[135]} 0 0
[junit4] 2> 1218092 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[136]} 0 0
[junit4] 2> 1218092 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[137]} 0 0
[junit4] 2> 1218093 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[138]} 0 0
[junit4] 2> 1218093 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[139]} 0 0
[junit4] 2> 1218093 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[140]} 0 0
[junit4] 2> 1218093 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[141]} 0 0
[junit4] 2> 1218093 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[142]} 0 0
[junit4] 2> 1218093 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[143]} 0 0
[junit4] 2> 1218093 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[144]} 0 0
[junit4] 2> 1218093 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[145]} 0 0
[junit4] 2> 1218094 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[146]} 0 0
[junit4] 2> 1218094 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[147]} 0 0
[junit4] 2> 1218094 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[148]} 0 0
[junit4] 2> 1218094 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[149]} 0 0
[junit4] 2> 1218094 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[150]} 0 0
[junit4] 2> 1218094 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[151]} 0 0
[junit4] 2> 1218094 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[152]} 0 0
[junit4] 2> 1218095 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[153]} 0 0
[junit4] 2> 1218095 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[154]} 0 0
[junit4] 2> 1218095 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[155]} 0 0
[junit4] 2> 1218095 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[156]} 0 0
[junit4] 2> 1218095 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[157]} 0 0
[junit4] 2> 1218095 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[158]} 0 0
[junit4] 2> 1218095 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[159]} 0 0
[junit4] 2> 1218095 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[160]} 0 0
[junit4] 2> 1218095 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[161]} 0 0
[junit4] 2> 1218096 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[162]} 0 0
[junit4] 2> 1218096 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[163]} 0 0
[junit4] 2> 1218096 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[164]} 0 0
[junit4] 2> 1218096 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[165]} 0 0
[junit4] 2> 1218096 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[166]} 0 0
[junit4] 2> 1218096 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[167]} 0 0
[junit4] 2> 1218096 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[168]} 0 0
[junit4] 2> 1218097 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[169]} 0 0
[junit4] 2> 1218097 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[170]} 0 0
[junit4] 2> 1218097 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[171]} 0 0
[junit4] 2> 1218097 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[172]} 0 0
[junit4] 2> 1218097 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[173]} 0 0
[junit4] 2> 1218097 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[174]} 0 0
[junit4] 2> 1218097 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[175]} 0 0
[junit4] 2> 1218097 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[176]} 0 0
[junit4] 2> 1218098 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[177]} 0 0
[junit4] 2> 1218098 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[178]} 0 0
[junit4] 2> 1218098 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[179]} 0 0
[junit4] 2> 1218098 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[180]} 0 0
[junit4] 2> 1218098 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[181]} 0 0
[junit4] 2> 1218098 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[182]} 0 0
[junit4] 2> 1218098 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[183]} 0 0
[junit4] 2> 1218098 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[184]} 0 0
[junit4] 2> 1218099 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[185]} 0 0
[junit4] 2> 1218099 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[186]} 0 0
[junit4] 2> 1218099 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[187]} 0 0
[junit4] 2> 1218099 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[188]} 0 0
[junit4] 2> 1218099 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[189]} 0 0
[junit4] 2> 1218099 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[190]} 0 0
[junit4] 2> 1218099 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[191]} 0 0
[junit4] 2> 1218099 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[192]} 0 0
[junit4] 2> 1218100 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[193]} 0 0
[junit4] 2> 1218100 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[194]} 0 0
[junit4] 2> 1218100 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[195]} 0 0
[junit4] 2> 1218100 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[196]} 0 0
[junit4] 2> 1218100 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[197]} 0 0
[junit4] 2> 1218100 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[198]} 0 0
[junit4] 2> 1218100 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[199]} 0 0
[junit4] 2> 1218101 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[200]} 0 0
[junit4] 2> 1218101 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[201]} 0 0
[junit4] 2> 1218101 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[202]} 0 0
[junit4] 2> 1218101 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[203]} 0 0
[junit4] 2> 1218101 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[204]} 0 0
[junit4] 2> 1218101 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[205]} 0 0
[junit4] 2> 1218101 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[206]} 0 0
[junit4] 2> 1218102 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[207]} 0 0
[junit4] 2> 1218102 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[208]} 0 0
[junit4] 2> 1218102 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[209]} 0 0
[junit4] 2> 1218102 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[210]} 0 0
[junit4] 2> 1218102 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[211]} 0 0
[junit4] 2> 1218102 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[212]} 0 0
[junit4] 2> 1218103 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[213]} 0 0
[junit4] 2> 1218103 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[214]} 0 0
[junit4] 2> 1218103 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[215]} 0 0
[junit4] 2> 1218103 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[216]} 0 0
[junit4] 2> 1218103 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[217]} 0 0
[junit4] 2> 1218103 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[218]} 0 0
[junit4] 2> 1218103 INFO (qtp26275982-10995) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[219]} 0 0
[junit4] 2> 1218103 INFO (qtp26275982-11000) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[220]} 0 0
[junit4] 2> 1218104 INFO (qtp26275982-11001) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[221]} 0 0
[junit4] 2> 1218104 INFO (qtp26275982-11002) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[222]} 0 0
[junit4] 2> 1218104 INFO (qtp26275982-10995) [
[...truncated too long message...]
3 /solr/overseer/queue-work
[junit4] 2> 3 /solr/overseer/collection-queue-work
[junit4] 2> 2 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2>
[junit4] 2> 1906477 WARN (TEST-LeaderFailoverAfterPartitionTest.test-seed#[9B469A8D814180D1]) [ ] o.a.s.c.SocketProxy Closing 5 connections to: http://127.0.0.1:35777/, target: http://127.0.0.1:41339/
[junit4] 2> 1906477 WARN (TEST-LeaderFailoverAfterPartitionTest.test-seed#[9B469A8D814180D1]) [ ] o.a.s.c.SocketProxy Closing 6 connections to: http://127.0.0.1:35241/, target: http://127.0.0.1:36215/
[junit4] 2> 1906477 WARN (TEST-LeaderFailoverAfterPartitionTest.test-seed#[9B469A8D814180D1]) [ ] o.a.s.c.SocketProxy Closing 0 connections to: http://127.0.0.1:34453/, target: http://127.0.0.1:38735/
[junit4] 2> 1906477 WARN (TEST-LeaderFailoverAfterPartitionTest.test-seed#[9B469A8D814180D1]) [ ] o.a.s.c.SocketProxy Closing 0 connections to: http://127.0.0.1:45287/, target: http://127.0.0.1:39769/
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=LeaderFailoverAfterPartitionTest -Dtests.method=test -Dtests.seed=9B469A8D814180D1 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es-VE -Dtests.timezone=Asia/Ho_Chi_Minh -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] FAILURE 173s J1 | LeaderFailoverAfterPartitionTest.test <<<
[junit4] > Throwable #1: java.lang.AssertionError: Expected 2 of 3 replicas to be active but only found 1; [core_node5:{"core":"c8n_1x3_lf_shard1_replica_t2","base_url":"http://127.0.0.1:35241","node_name":"127.0.0.1:35241_","state":"active","type":"TLOG","leader":"true"}]; clusterState: DocCollection(c8n_1x3_lf//collections/c8n_1x3_lf/state.json/16)={
[junit4] > "pullReplicas":"0",
[junit4] > "replicationFactor":"1",
[junit4] > "shards":{"shard1":{
[junit4] > "range":"80000000-7fffffff",
[junit4] > "state":"active",
[junit4] > "replicas":{
[junit4] > "core_node4":{
[junit4] > "state":"down",
[junit4] > "base_url":"http://127.0.0.1:34453",
[junit4] > "core":"c8n_1x3_lf_shard1_replica_t1",
[junit4] > "node_name":"127.0.0.1:34453_",
[junit4] > "type":"TLOG"},
[junit4] > "core_node5":{
[junit4] > "core":"c8n_1x3_lf_shard1_replica_t2",
[junit4] > "base_url":"http://127.0.0.1:35241",
[junit4] > "node_name":"127.0.0.1:35241_",
[junit4] > "state":"active",
[junit4] > "type":"TLOG",
[junit4] > "leader":"true"},
[junit4] > "core_node6":{
[junit4] > "core":"c8n_1x3_lf_shard1_replica_t3",
[junit4] > "base_url":"http://127.0.0.1:45287",
[junit4] > "node_name":"127.0.0.1:45287_",
[junit4] > "state":"down",
[junit4] > "type":"TLOG"}}}},
[junit4] > "router":{"name":"compositeId"},
[junit4] > "maxShardsPerNode":"1",
[junit4] > "autoAddReplicas":"false",
[junit4] > "nrtReplicas":"0",
[junit4] > "tlogReplicas":"3"}
[junit4] > at __randomizedtesting.SeedInfo.seed([9B469A8D814180D1:1312A5572FBDED29]:0)
[junit4] > at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.testRf3WithLeaderFailover(LeaderFailoverAfterPartitionTest.java:169)
[junit4] > at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test(LeaderFailoverAfterPartitionTest.java:56)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:564)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_9B469A8D814180D1-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70), sim=RandomSimilarity(queryNorm=false): {}, locale=es-VE, timezone=Asia/Ho_Chi_Minh
[junit4] 2> NOTE: Linux 4.10.0-37-generic amd64/Oracle Corporation 9.0.1 (64-bit)/cpus=8,threads=1,free=198677400,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [DocumentAnalysisRequestHandlerTest, LegacyCloudClusterPropTest, TestInitParams, ShowFileRequestHandlerTest, TestStressLucene, OpenExchangeRatesOrgProviderTest, TestSimpleTrackingShardHandler, TestXmlQParser, ManagedSchemaRoundRobinCloudTest, LukeRequestHandlerTest, DirectUpdateHandlerTest, TestBulkSchemaAPI, TestDocTermOrds, ZkStateReaderTest, TestAnalyzedSuggestions, BasicAuthStandaloneTest, CollectionTooManyReplicasTest, PeerSyncReplicationTest, CreateCollectionCleanupTest, FullHLLTest, TestLegacyFieldReuse, HighlighterConfigTest, TestCloudRecovery, TestDynamicFieldResource, SOLR749Test, ClassificationUpdateProcessorFactoryTest, ConvertedLegacyTest, MoreLikeThisHandlerTest, TestInitQParser, TestNonDefinedSimilarityFactory, SolrMetricReporterTest, AddSchemaFieldsUpdateProcessorFactoryTest, TermVectorComponentDistributedTest, TestFilteredDocIdSet, TestPointFields, SpatialRPTFieldTypeTest, TestFaceting, MultiThreadedOCPTest, TestInPlaceUpdatesStandalone, MetricsConfigTest, TestConfigSetsAPIExclusivity, TestAuthenticationFramework, SolrRequestParserTest, TestSolr4Spatial2, AnalyticsQueryTest, DistributedTermsComponentTest, HdfsRecoveryZkTest, TestSQLHandlerNonCloud, ChaosMonkeySafeLeaderTest, TestReRankQParserPlugin, SynonymTokenizerTest, TestJmxIntegration, DeleteShardTest, NotRequiredUniqueKeyTest, TestPseudoReturnFields, TestFieldTypeCollectionResource, TestMissingGroups, PolyFieldTest, ClusterStateUpdateTest, HdfsBasicDistributedZkTest, ZkCLITest, ComputePlanActionTest, DistribDocExpirationUpdateProcessorTest, TestManagedSynonymFilterFactory, TestConfigSets, TestSolrCloudWithKerberosAlt, TestZkAclsWithHadoopAuth, ShardRoutingCustomTest, TestStressRecovery, SimpleMLTQParserTest, TestUseDocValuesAsStored, TestNumericTerms64, TestDelegationWithHadoopAuth, TestSerializedLuceneMatchVersion, PreAnalyzedFieldTest, NumericFieldsTest, SolrGraphiteReporterTest, RequestLoggingTest, TestSearcherReuse, TestCollationField, DistributedFacetPivotLongTailTest, TestDefaultStatsCache, SuggesterTSTTest, CoreMergeIndexesAdminHandlerTest, AnalysisErrorHandlingTest, TestSolrQueryParser, TestSSLRandomization, TestEmbeddedSolrServerAdminHandler, TestReplicaProperties, DistributedVersionInfoTest, ParsingFieldUpdateProcessorsTest, TestUnifiedSolrHighlighter, CloneFieldUpdateProcessorFactoryTest, SuggesterFSTTest, TestSystemCollAutoCreate, TestBM25SimilarityFactory, TestTolerantUpdateProcessorCloud, ZkSolrClientTest, TestExactStatsCache, UtilsToolTest, TestSubQueryTransformer, TestWriterPerf, BigEndianAscendingWordSerializerTest, HdfsDirectoryFactoryTest, AutoAddReplicasIntegrationTest, TestAtomicUpdateErrorCases, CdcrRequestHandlerTest, BooleanFieldTest, TestConfigOverlay, SolrCLIZkUtilsTest, TestStressReorder, TestPushWriter, SolrIndexSplitterTest, TestRetrieveFieldsOptimizer, PeerSyncWithIndexFingerprintCachingTest, TestSolr4Spatial, TestMultiValuedNumericRangeQuery, TestBinaryResponseWriter, TestFastWriter, TestTrackingShardHandlerFactory, TestHighFrequencyDictionaryFactory, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, ShardRoutingTest, BasicZkTest, TestReplicationHandler, TestDistributedGrouping, TestRecovery, ZkControllerTest, TestRealTimeGet, TestRangeQuery, TestIndexSearcher, HighlighterTest, DistributedQueryElevationComponentTest, SignatureUpdateProcessorFactoryTest, TestFoldingMultitermQuery, SpatialFilterTest, WordBreakSolrSpellCheckerTest, QueryEqualityTest, TestRemoteStreaming, DistanceFunctionTest, SolrInfoBeanTest, DebugComponentTest, TestSurroundQueryParser, TestReversedWildcardFilterFactory, TestOmitPositions, TermsComponentTest, TestIndexingPerformance, RegexBoostProcessorTest, IndexSchemaTest, TestCSVResponseWriter, JsonLoaderTest, BinaryUpdateRequestHandlerTest, PingRequestHandlerTest, CSVRequestHandlerTest, TestComponentsName, SearchHandlerTest, TestQuerySenderListener, TestQuerySenderNoQuery, CopyFieldTest, SolrIndexConfigTest, TestMergePolicyConfig, SampleTest, TestDocSet, MinimalSchemaTest, TestElisionMultitermQuery, TestConfig, OutputWriterTest, TestSolrCoreProperties, TestPostingsSolrHighlighter, DirectSolrConnectionTest, TestLuceneMatchVersion, SpellPossibilityIteratorTest, TestCodecSupport, TestXIncludeConfig, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestLMJelinekMercerSimilarityFactory, TestFastOutputStream, TestFastLRUCache, TestSystemIdResolver, DOMUtilTest, TestDocumentBuilder, SystemInfoHandlerTest, UUIDFieldTest, CircularListTest, DistributedMLTComponentTest, DistributedIntervalFacetingTest, TestCrossCoreJoin, TestTolerantSearch, TestEmbeddedSolrServerConstructors, TestEmbeddedSolrServerSchemaAPI, TestJettySolrRunner, ConnectionReuseTest, AssignTest, ChaosMonkeySafeLeaderWithPullReplicasTest, CloudExitableDirectoryReaderTest, CollectionStateFormat2Test, ConcurrentDeleteAndCreateCollectionTest, DeleteLastCustomShardedReplicaTest, DeleteReplicaTest, DistribJoinFromCollectionTest, HttpPartitionTest, LeaderFailoverAfterPartitionTest]
[junit4] Completed [452/749 (2!)] on J1 in 172.88s, 1 test, 1 failure <<< FAILURES!
[...truncated 41234 lines...]
[JENKINS-EA] Lucene-Solr-7.x-Linux (64bit/jdk-10-ea+32) - Build #
886 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/886/
Java: 64bit/jdk-10-ea+32 -XX:+UseCompressedOops -XX:+UseParallelGC
3 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.core.TestLazyCores
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores: 1) Thread[id=2664, name=searcherExecutor-1379-thread-1, state=WAITING, group=TGRP-TestLazyCores] at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method) at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074) at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435) at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061) at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121) at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores:
1) Thread[id=2664, name=searcherExecutor-1379-thread-1, state=WAITING, group=TGRP-TestLazyCores]
at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)
at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
at __randomizedtesting.SeedInfo.seed([8C1406F5EF6C0FA1]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.core.TestLazyCores
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=2664, name=searcherExecutor-1379-thread-1, state=WAITING, group=TGRP-TestLazyCores] at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method) at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074) at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435) at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061) at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121) at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=2664, name=searcherExecutor-1379-thread-1, state=WAITING, group=TGRP-TestLazyCores]
at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)
at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
at __randomizedtesting.SeedInfo.seed([8C1406F5EF6C0FA1]:0)
FAILED: org.apache.solr.core.TestLazyCores.testNoCommit
Error Message:
Exception during query
Stack Trace:
java.lang.RuntimeException: Exception during query
at __randomizedtesting.SeedInfo.seed([8C1406F5EF6C0FA1:5374A724244B6C04]:0)
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:901)
at org.apache.solr.core.TestLazyCores.check10(TestLazyCores.java:847)
at org.apache.solr.core.TestLazyCores.testNoCommit(TestLazyCores.java:829)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound='10']
xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">1</int><lst name="params"><str name="q">*:*</str></lst></lst><result name="response" numFound="0" start="0"></result>
</response>
request was:q=*:*
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:894)
... 40 more
Build Log:
[...truncated 11853 lines...]
[junit4] Suite: org.apache.solr.core.TestLazyCores
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/init-core-data-001
[junit4] 2> 167238 WARN (SUITE-TestLazyCores-seed#[8C1406F5EF6C0FA1]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
[junit4] 2> 167238 INFO (SUITE-TestLazyCores-seed#[8C1406F5EF6C0FA1]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 167239 INFO (SUITE-TestLazyCores-seed#[8C1406F5EF6C0FA1]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 167240 INFO (SUITE-TestLazyCores-seed#[8C1406F5EF6C0FA1]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 167245 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCreateTransientFromAdmin
[junit4] 2> 167256 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/solr.xml
[junit4] 2> 167258 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 167258 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 167259 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6415df4c, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 167295 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6415df4c
[junit4] 2> 167302 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6415df4c
[junit4] 2> 167302 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6415df4c
[junit4] 2> 167304 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 167309 INFO (coreLoadExecutor-1115-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 167312 INFO (coreLoadExecutor-1115-thread-2) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 167314 INFO (coreLoadExecutor-1115-thread-1) [ ] o.a.s.s.IndexSchema [collection1] Schema name=tiny
[junit4] 2> 167316 INFO (coreLoadExecutor-1115-thread-1) [ ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
[junit4] 2> 167316 INFO (coreLoadExecutor-1115-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/./collection1, trusted=true
[junit4] 2> 167316 INFO (coreLoadExecutor-1115-thread-1) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6415df4c
[junit4] 2> 167316 INFO (coreLoadExecutor-1115-thread-1) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 167316 INFO (coreLoadExecutor-1115-thread-1) [ ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/./collection1/data/]
[junit4] 2> 167317 INFO (coreLoadExecutor-1115-thread-2) [ ] o.a.s.s.IndexSchema [collection2] Schema name=tiny
[junit4] 2> 167318 INFO (coreLoadExecutor-1115-thread-2) [ ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
[junit4] 2> 167319 INFO (coreLoadExecutor-1115-thread-2) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection2' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/./collection2, trusted=true
[junit4] 2> 167319 INFO (coreLoadExecutor-1115-thread-2) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection2' (registry 'solr.core.collection2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6415df4c
[junit4] 2> 167319 INFO (coreLoadExecutor-1115-thread-1) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=23, maxMergedSegmentMB=30.982421875, floorSegmentMB=0.2529296875, forceMergeDeletesPctAllowed=23.522589456668396, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 167319 INFO (coreLoadExecutor-1115-thread-2) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 167319 INFO (coreLoadExecutor-1115-thread-2) [ ] o.a.s.c.SolrCore [[collection2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/collection2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/./collection2/data/]
[junit4] 2> 167322 INFO (coreLoadExecutor-1115-thread-2) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=23, maxMergedSegmentMB=30.982421875, floorSegmentMB=0.2529296875, forceMergeDeletesPctAllowed=23.522589456668396, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 167327 INFO (coreLoadExecutor-1115-thread-3) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 167362 INFO (coreLoadExecutor-1115-thread-3) [ ] o.a.s.s.IndexSchema [collection5] Schema name=tiny
[junit4] 2> 167363 INFO (coreLoadExecutor-1115-thread-3) [ ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
[junit4] 2> 167363 INFO (coreLoadExecutor-1115-thread-3) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection5' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/./collection5, trusted=true
[junit4] 2> 167363 INFO (coreLoadExecutor-1115-thread-3) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection5' (registry 'solr.core.collection5') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6415df4c
[junit4] 2> 167363 INFO (coreLoadExecutor-1115-thread-3) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 167363 INFO (coreLoadExecutor-1115-thread-3) [ ] o.a.s.c.SolrCore [[collection5] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/collection5], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/./collection5/data/]
[junit4] 2> 167365 INFO (coreLoadExecutor-1115-thread-3) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=23, maxMergedSegmentMB=30.982421875, floorSegmentMB=0.2529296875, forceMergeDeletesPctAllowed=23.522589456668396, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 167410 INFO (coreLoadExecutor-1115-thread-1) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 167410 INFO (coreLoadExecutor-1115-thread-1) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 167411 INFO (coreLoadExecutor-1115-thread-1) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=64.451171875, floorSegmentMB=0.90625, forceMergeDeletesPctAllowed=16.34341308210975, segmentsPerTier=31.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4367250308299442
[junit4] 2> 167411 INFO (coreLoadExecutor-1115-thread-3) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 167411 INFO (coreLoadExecutor-1115-thread-3) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 167412 INFO (coreLoadExecutor-1115-thread-1) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@745b1d0b[collection1] main]
[junit4] 2> 167412 INFO (coreLoadExecutor-1115-thread-1) [ ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/collection1/conf
[junit4] 2> 167412 INFO (coreLoadExecutor-1115-thread-3) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=64.451171875, floorSegmentMB=0.90625, forceMergeDeletesPctAllowed=16.34341308210975, segmentsPerTier=31.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4367250308299442
[junit4] 2> 167413 INFO (coreLoadExecutor-1115-thread-3) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@2aee3d86[collection5] main]
[junit4] 2> 167413 INFO (coreLoadExecutor-1115-thread-1) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 167413 INFO (coreLoadExecutor-1115-thread-3) [ ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/collection5/conf
[junit4] 2> 167414 INFO (coreLoadExecutor-1115-thread-3) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 167414 INFO (searcherExecutor-1116-thread-1) [ ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@745b1d0b[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 167414 INFO (searcherExecutor-1118-thread-1) [ ] o.a.s.c.SolrCore [collection5] Registered new searcher Searcher@2aee3d86[collection5] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 167423 INFO (coreLoadExecutor-1115-thread-2) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 167423 INFO (coreLoadExecutor-1115-thread-2) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 167424 INFO (coreLoadExecutor-1115-thread-2) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=64.451171875, floorSegmentMB=0.90625, forceMergeDeletesPctAllowed=16.34341308210975, segmentsPerTier=31.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4367250308299442
[junit4] 2> 167425 INFO (coreLoadExecutor-1115-thread-2) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@49b9f15a[collection2] main]
[junit4] 2> 167425 INFO (coreLoadExecutor-1115-thread-2) [ ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/collection2/conf
[junit4] 2> 167426 INFO (coreLoadExecutor-1115-thread-2) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 167427 INFO (searcherExecutor-1117-thread-1) [ ] o.a.s.c.SolrCore [collection2] Registered new searcher Searcher@49b9f15a[collection2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 167435 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.h.a.CoreAdminOperation core create command loadOnStartup=true&transient=true&name=core1&action=CREATE&wt=xml
[junit4] 2> 167441 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 167445 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.IndexSchema [core1] Schema name=tiny
[junit4] 2> 167446 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
[junit4] 2> 167446 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.CoreContainer Creating SolrCore 'core1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/./core1, trusted=true
[junit4] 2> 167447 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.core1' (registry 'solr.core.core1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6415df4c
[junit4] 2> 167447 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 167447 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore [[core1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/core1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/./core1/data/]
[junit4] 2> 167448 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=22, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.16862467821350985]
[junit4] 2> 167480 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 167480 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 167480 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=23, maxMergedSegmentMB=49.6865234375, floorSegmentMB=0.39453125, forceMergeDeletesPctAllowed=26.05186076860957, segmentsPerTier=44.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 167481 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@2f4fc486[core1] main]
[junit4] 2> 167481 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/core1/conf
[junit4] 2> 167482 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 167482 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.h.a.CoreAdminOperation core create command loadOnStartup=false&transient=true&name=core2&action=CREATE&wt=xml
[junit4] 2> 167482 INFO (searcherExecutor-1129-thread-1) [ ] o.a.s.c.SolrCore [core1] Registered new searcher Searcher@2f4fc486[core1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 167486 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 167501 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.IndexSchema [core2] Schema name=tiny
[junit4] 2> 167501 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
[junit4] 2> 167501 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.CoreContainer Creating SolrCore 'core2' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/./core2, trusted=true
[junit4] 2> 167502 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.core2' (registry 'solr.core.core2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6415df4c
[junit4] 2> 167502 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 167502 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore [[core2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/core2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/./core2/data/]
[junit4] 2> 167504 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=311861055, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 167539 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 167539 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 167539 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=48, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7128981733468523]
[junit4] 2> 167540 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@4ed7679d[core2] main]
[junit4] 2> 167540 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/core2/conf
[junit4] 2> 167540 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 167541 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.h.a.CoreAdminOperation core create command loadOnStartup=true&transient=true&name=core3&action=CREATE&wt=xml
[junit4] 2> 167541 INFO (searcherExecutor-1134-thread-1) [ ] o.a.s.c.SolrCore [core2] Registered new searcher Searcher@4ed7679d[core2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 167544 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 167548 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.IndexSchema [core3] Schema name=tiny
[junit4] 2> 167549 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
[junit4] 2> 167549 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.CoreContainer Creating SolrCore 'core3' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/./core3, trusted=true
[junit4] 2> 167550 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.core3' (registry 'solr.core.core3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6415df4c
[junit4] 2> 167550 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 167550 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore [[core3] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/core3], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/./core3/data/]
[junit4] 2> 167552 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=1.7734375, floorSegmentMB=1.96484375, forceMergeDeletesPctAllowed=6.343201564759021, segmentsPerTier=22.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.46817399482595545
[junit4] 2> 167583 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 167583 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 167583 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=46, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=74.9501953125, floorSegmentMB=2.0390625, forceMergeDeletesPctAllowed=2.4724040425607727, segmentsPerTier=44.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7755650291696589
[junit4] 2> 167584 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@6d52d70[core3] main]
[junit4] 2> 167584 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/core3/conf
[junit4] 2> 167585 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 167585 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.h.a.CoreAdminOperation core create command loadOnStartup=false&transient=true&name=core4&action=CREATE&wt=xml
[junit4] 2> 167585 INFO (searcherExecutor-1139-thread-1) [ ] o.a.s.c.SolrCore [core3] Registered new searcher Searcher@6d52d70[core3] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 167590 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 167594 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.IndexSchema [core4] Schema name=tiny
[junit4] 2> 167594 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
[junit4] 2> 167594 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.CoreContainer Creating SolrCore 'core4' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/./core4, trusted=true
[junit4] 2> 167595 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.core4' (registry 'solr.core.core4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6415df4c
[junit4] 2> 167595 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 167595 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore [[core4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/core4], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/./core4/data/]
[junit4] 2> 167596 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=26, maxMergedSegmentMB=16.98046875, floorSegmentMB=0.5927734375, forceMergeDeletesPctAllowed=29.392053042219715, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6351130592417811
[junit4] 2> 167628 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 167628 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 167628 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=33, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8449240991620804]
[junit4] 2> 167629 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@9137034[core4] main]
[junit4] 2> 167629 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/core4/conf
[junit4] 2> 167629 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 167630 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Closing transient core [collection2]
[junit4] 2> 167630 INFO (Thread-561) [ ] o.a.s.c.SolrCore [collection2] CLOSING SolrCore org.apache.solr.core.SolrCore@3160b1c8
[junit4] 2> 167630 INFO (Thread-561) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection2, tag=828420552
[junit4] 2> 167630 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.h.a.CoreAdminOperation core create command loadOnStartup=false&transient=true&name=core5&action=CREATE&wt=xml
[junit4] 2> 167630 INFO (Thread-561) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1d04a57e: rootName = null, domain = solr.core.collection2, service url = null, agent id = null] for registry solr.core.collection2 / com.codahale.metrics.MetricRegistry@5861dc0c
[junit4] 2> 167630 INFO (searcherExecutor-1144-thread-1) [ ] o.a.s.c.SolrCore [core4] Registered new searcher Searcher@9137034[core4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 167639 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 167643 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.IndexSchema [core5] Schema name=tiny
[junit4] 2> 167643 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
[junit4] 2> 167643 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.CoreContainer Creating SolrCore 'core5' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/./core5, trusted=true
[junit4] 2> 167644 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.core5' (registry 'solr.core.core5') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6415df4c
[junit4] 2> 167644 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 167644 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore [[core5] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/core5], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/./core5/data/]
[junit4] 2> 167645 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=4.591796875, floorSegmentMB=2.046875, forceMergeDeletesPctAllowed=9.833976086110571, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 167678 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 167678 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 167679 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=58.6708984375, floorSegmentMB=1.8291015625, forceMergeDeletesPctAllowed=16.718051299743355, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.20618816513532742
[junit4] 2> 167679 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@26c92d3e[core5] main]
[junit4] 2> 167679 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/core5/conf
[junit4] 2> 167680 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 167680 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Closing transient core [core1]
[junit4] 2> 167680 INFO (Thread-561) [ ] o.a.s.c.SolrCore [core1] CLOSING SolrCore org.apache.solr.core.SolrCore@73094746
[junit4] 2> 167680 INFO (Thread-561) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.core1, tag=1929987910
[junit4] 2> 167680 INFO (Thread-561) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@18c6d7b7: rootName = null, domain = solr.core.core1, service url = null, agent id = null] for registry solr.core.core1 / com.codahale.metrics.MetricRegistry@5299b77c
[junit4] 2> 167680 INFO (searcherExecutor-1149-thread-1) [ ] o.a.s.c.SolrCore [core5] Registered new searcher Searcher@26c92d3e[core5] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 167688 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 167691 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.IndexSchema [core1] Schema name=tiny
[junit4] 2> 167692 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
[junit4] 2> 167692 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.CoreContainer Creating SolrCore 'core1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/./core1, trusted=true
[junit4] 2> 167701 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.core1' (registry 'solr.core.core1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6415df4c
[junit4] 2> 167701 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 167702 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore [[core1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/core1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/./core1/data/]
[junit4] 2> 167721 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 167721 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 167722 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=12, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 167722 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@27eb6bd5[core1] main]
[junit4] 2> 167722 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/core1/conf
[junit4] 2> 167723 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 167723 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Closing transient core [core2]
[junit4] 2> 167723 INFO (Thread-561) [ ] o.a.s.c.SolrCore [core2] CLOSING SolrCore org.apache.solr.core.SolrCore@4aee1642
[junit4] 2> 167723 INFO (Thread-561) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.core2, tag=1257117250
[junit4] 2> 167723 INFO (Thread-561) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2008b37: rootName = null, domain = solr.core.core2, service url = null, agent id = null] for registry solr.core.core2 / com.codahale.metrics.MetricRegistry@414c0c08
[junit4] 2> 167723 INFO (searcherExecutor-1153-thread-1) [ ] o.a.s.c.SolrCore [core1] Registered new searcher Searcher@27eb6bd5[core1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 167730 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 167733 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.IndexSchema [core2] Schema name=tiny
[junit4] 2> 167734 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
[junit4] 2> 167734 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.CoreContainer Creating SolrCore 'core2' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/./core2, trusted=true
[junit4] 2> 167743 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.core2' (registry 'solr.core.core2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6415df4c
[junit4] 2> 167743 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 167743 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore [[core2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/core2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/./core2/data/]
[junit4] 2> 167774 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 167774 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 167776 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=16, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.47662983812775817]
[junit4] 2> 167776 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@1c0b19ab[core2] main]
[junit4] 2> 167776 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/core2/conf
[junit4] 2> 167777 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 167777 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Closing transient core [core3]
[junit4] 2> 167777 INFO (Thread-561) [ ] o.a.s.c.SolrCore [core3] CLOSING SolrCore org.apache.solr.core.SolrCore@e678cc7
[junit4] 2> 167777 INFO (Thread-561) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.core3, tag=241667271
[junit4] 2> 167777 INFO (Thread-561) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@60cca055: rootName = null, domain = solr.core.core3, service url = null, agent id = null] for registry solr.core.core3 / com.codahale.metrics.MetricRegistry@397b211b
[junit4] 2> 167778 INFO (searcherExecutor-1157-thread-1) [ ] o.a.s.c.SolrCore [core2] Registered new searcher Searcher@1c0b19ab[core2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 167785 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 167788 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.IndexSchema [core3] Schema name=tiny
[junit4] 2> 167788 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
[junit4] 2> 167789 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.CoreContainer Creating SolrCore 'core3' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/./core3, trusted=true
[junit4] 2> 167798 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.core3' (registry 'solr.core.core3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6415df4c
[junit4] 2> 167798 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 167798 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore [[core3] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/core3], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/./core3/data/]
[junit4] 2> 167817 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 167817 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 167818 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=31, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=61.4453125, floorSegmentMB=1.333984375, forceMergeDeletesPctAllowed=27.85300936094375, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5552196741361296
[junit4] 2> 167818 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@3a36cbdb[core3] main]
[junit4] 2> 167818 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/core3/conf
[junit4] 2> 167819 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 167819 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Closing transient core [core4]
[junit4] 2> 167819 INFO (Thread-561) [ ] o.a.s.c.SolrCore [core4] CLOSING SolrCore org.apache.solr.core.SolrCore@7250e1a7
[junit4] 2> 167819 INFO (Thread-561) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.core4, tag=1917903271
[junit4] 2> 167819 INFO (Thread-561) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@95ff3f5: rootName = null, domain = solr.core.core4, service url = null, agent id = null] for registry solr.core.core4 / com.codahale.metrics.MetricRegistry@5639b2b6
[junit4] 2> 167820 INFO (searcherExecutor-1161-thread-1) [ ] o.a.s.c.SolrCore [core3] Registered new searcher Searcher@3a36cbdb[core3] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 167827 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 167830 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.IndexSchema [core4] Schema name=tiny
[junit4] 2> 167830 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
[junit4] 2> 167830 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.CoreContainer Creating SolrCore 'core4' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/./core4, trusted=true
[junit4] 2> 167840 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.core4' (registry 'solr.core.core4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6415df4c
[junit4] 2> 167840 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 167840 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore [[core4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/core4], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/./core4/data/]
[junit4] 2> 167863 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 167863 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 167866 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=125332535, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 167867 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@26d0c3df[core4] main]
[junit4] 2> 167867 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/core4/conf
[junit4] 2> 167872 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 167872 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Closing transient core [core5]
[junit4] 2> 167872 INFO (Thread-561) [ ] o.a.s.c.SolrCore [core5] CLOSING SolrCore org.apache.solr.core.SolrCore@46eeec97
[junit4] 2> 167872 INFO (Thread-561) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.core5, tag=1190063255
[junit4] 2> 167872 INFO (Thread-561) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@441dbdc5: rootName = null, domain = solr.core.core5, service url = null, agent id = null] for registry solr.core.core5 / com.codahale.metrics.MetricRegistry@227f6ba6
[junit4] 2> 167876 INFO (searcherExecutor-1165-thread-1) [ ] o.a.s.c.SolrCore [core4] Registered new searcher Searcher@26d0c3df[core4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 167883 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 167893 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.IndexSchema [core5] Schema name=tiny
[junit4] 2> 167894 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
[junit4] 2> 167894 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.CoreContainer Creating SolrCore 'core5' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/./core5, trusted=true
[junit4] 2> 167906 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.core5' (registry 'solr.core.core5') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6415df4c
[junit4] 2> 167907 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 167907 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore [[core5] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/core5], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/./core5/data/]
[junit4] 2> 167934 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 167934 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 167936 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=41, maxMergedSegmentMB=90.2041015625, floorSegmentMB=0.7373046875, forceMergeDeletesPctAllowed=15.795655745813008, segmentsPerTier=50.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 167936 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@300e1933[core5] main]
[junit4] 2> 167937 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-001/core5/conf
[junit4] 2> 167937 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 167937 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Closing transient core [core1]
[junit4] 2> 167938 INFO (searcherExecutor-1169-thread-1) [ ] o.a.s.c.SolrCore [core5] Registered new searcher Searcher@300e1933[core5] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 167939 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.core2, tag=null
[junit4] 2> 167939 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4922f8da: rootName = null, domain = solr.core.core2, service url = null, agent id = null] for registry solr.core.core2 / com.codahale.metrics.MetricRegistry@414c0c08
[junit4] 2> 167947 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore Core core2 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 168047 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore Core core2 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 168147 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore Core core2 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 168247 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore Core core2 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 168347 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore Core core2 is not yet closed, waiting 100 ms before checking again.
[junit4] 2> 168423 INFO (Thread-562) [ ] o.a.s.c.SolrCore [core1] CLOSING SolrCore org.apache.solr.core.SolrCore@63cf7b1f
[junit4] 2> 168423 INFO (Thread-562) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.core1, tag=1674541855
[junit4] 2> 168423 INFO (Thread-562) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@47dcc91e: rootName = null, domain = solr.core.core1, service url = null, agent id = null] for registry solr.core.core1 / com.codahale.metrics.MetricRegistry@5299b77c
[junit4] 2> 168427 INFO (Thread-562) [ ] o.a.s.c.SolrCore [core2] CLOSING SolrCore org.apache.solr.core.SolrCore@aa8e279
[junit4] 2> 168427 INFO (Thread-562) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.core2, tag=178840185
[junit4] 2> 168447 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.core3, tag=null
[junit4] 2> 168447 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1d827508: rootName = null, domain = solr.core.core3, service url = null, agent id = null] for registry solr.core.core3 / com.codahale.metrics.MetricRegistry@397b211b
[junit4] 2> 168453 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore [core3] CLOSING SolrCore org.apache.solr.core.SolrCore@718d34ca
[junit4] 2> 168453 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.core3, tag=1905079498
[junit4] 2> 168454 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.core4, tag=null
[junit4] 2> 168454 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@108101d2: rootName = null, domain = solr.core.core4, service url = null, agent id = null] for registry solr.core.core4 / com.codahale.metrics.MetricRegistry@5639b2b6
[junit4] 2> 168461 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore [core4] CLOSING SolrCore org.apache.solr.core.SolrCore@61f4250b
[junit4] 2> 168461 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.core4, tag=1643390219
[junit4] 2> 168462 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.core5, tag=null
[junit4] 2> 168462 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@13ec7e1a: rootName = null, domain = solr.core.core5, service url = null, agent id = null] for registry solr.core.core5 / com.codahale.metrics.MetricRegistry@227f6ba6
[junit4] 2> 168468 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore [core5] CLOSING SolrCore org.apache.solr.core.SolrCore@7bd5124c
[junit4] 2> 168469 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.core5, tag=2077561420
[junit4] 2> 168470 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=232170333
[junit4] 2> 168470 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 168470 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@985ee5d: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@3f26cceb
[junit4] 2> 168473 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 168473 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4e6c0265: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@63763b31
[junit4] 2> 168475 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 168475 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@44c9dcb6: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@49624bc9
[junit4] 2> 168475 INFO (coreCloseExecutor-1178-thread-1) [ ] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@13ee2432
[junit4] 2> 168476 INFO (coreCloseExecutor-1178-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=334373938
[junit4] 2> 168476 INFO (coreCloseExecutor-1178-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@69dffeb7: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@6943fa32
[junit4] 2> 168476 INFO (coreCloseExecutor-1178-thread-2) [ ] o.a.s.c.SolrCore [collection5] CLOSING SolrCore org.apache.solr.core.SolrCore@11ce3e43
[junit4] 2> 168479 INFO (coreCloseExecutor-1178-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection5, tag=298729027
[junit4] 2> 168479 INFO (coreCloseExecutor-1178-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@690ca705: rootName = null, domain = solr.core.collection5, service url = null, agent id = null] for registry solr.core.collection5 / com.codahale.metrics.MetricRegistry@590d4c3a
[junit4] 2> 168483 INFO (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testCreateTransientFromAdmin
[junit4] 2> 168484 INFO (TEST-TestLazyCores.testCachingLimit-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCachingLimit
[junit4] 2> 168498 INFO (TEST-TestLazyCores.testCachingLimit-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-002/solr.xml
[junit4] 2> 168500 INFO (TEST-TestLazyCores.testCachingLimit-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 168500 INFO (TEST-TestLazyCores.testCachingLimit-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 168500 INFO (TEST-TestLazyCores.testCachingLimit-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6415df4c, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 168515 INFO (TEST-TestLazyCores.testCachingLimit-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6415df4c
[junit4] 2> 168521 INFO (TEST-TestLazyCores.testCachingLimit-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6415df4c
[junit4] 2> 168521 INFO (TEST-TestLazyCores.testCachingLimit-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6415df4c
[junit4] 2> 168522 INFO (TEST-TestLazyCores.testCachingLimit-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 168525 INFO (coreLoadExecutor-1185-thread-1) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 168525 INFO (coreLoadExecutor-1185-thread-3) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 168526 INFO (coreLoadExecutor-1185-thread-2) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 168532 INFO (coreLoadExecutor-1185-thread-3) [ ] o.a.s.s.IndexSchema [collection5] Schema name=tiny
[junit4] 2> 168532 INFO (coreLoadExecutor-1185-thread-1) [ ] o.a.s.s.IndexSchema [collection1] Schema name=tiny
[junit4] 2> 168533 INFO (coreLoadExecutor-1185-thread-2) [ ] o.a.s.s.IndexSchema [collection2] Schema name=tiny
[junit4] 2> 168534 INFO (coreLoadExecutor-1185-thread-2) [ ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
[junit4] 2> 168534 INFO (coreLoadExecutor-1185-thread-3) [ ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
[junit4] 2> 168534 INFO (coreLoadExecutor-1185-thread-2) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection2' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-002/./collection2, trusted=true
[junit4] 2> 168534 INFO (coreLoadExecutor-1185-thread-3) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection5' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-002/./collection5, trusted=true
[junit4] 2> 168534 INFO (coreLoadExecutor-1185-thread-1) [ ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
[junit4] 2> 168534 INFO (coreLoadExecutor-1185-thread-1) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-002/./collection1, trusted=true
[junit4] 2> 168534 INFO (coreLoadExecutor-1185-thread-3) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection5' (registry 'solr.core.collection5') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6415df4c
[junit4] 2> 168534 INFO (coreLoadExecutor-1185-thread-2) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection2' (registry 'solr.core.collection2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6415df4c
[junit4] 2> 168534 INFO (coreLoadExecutor-1185-thread-1) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6415df4c
[junit4] 2> 168534 INFO (coreLoadExecutor-1185-thread-3) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 168534 INFO (coreLoadExecutor-1185-thread-2) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 168534 INFO (coreLoadExecutor-1185-thread-1) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 168534 INFO (coreLoadExecutor-1185-thread-3) [ ] o.a.s.c.SolrCore [[collection5] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-002/collection5], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-002/./collection5/data/]
[junit4] 2> 168534 INFO (coreLoadExecutor-1185-thread-2) [ ] o.a.s.c.SolrCore [[collection2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-002/collection2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-002/./collection2/data/]
[junit4] 2> 168534 INFO (coreLoadExecutor-1185-thread-1) [ ] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-002/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-002/./collection1/data/]
[junit4] 2> 168536 INFO (coreLoadExecutor-1185-thread-2) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=23, maxMergedSegmentMB=30.982421875, floorSegmentMB=0.2529296875, forceMergeDeletesPctAllowed=23.522589456668396, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 168536 INFO (coreLoadExecutor-1185-thread-3) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=23, maxMergedSegmentMB=30.982421875, floorSegmentMB=0.2529296875, forceMergeDeletesPctAllowed=23.522589456668396, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 168536 INFO (coreLoadExecutor-1185-thread-1) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=23, maxMergedSegmentMB=30.982421875, floorSegmentMB=0.2529296875, forceMergeDeletesPctAllowed=23.522589456668396, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 168574 INFO (coreLoadExecutor-1185-thread-1) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 168574 INFO (coreLoadExecutor-1185-thread-1) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 168574 INFO (coreLoadExecutor-1185-thread-1) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=64.451171875, floorSegmentMB=0.90625, forceMergeDeletesPctAllowed=16.34341308210975, segmentsPerTier=31.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4367250308299442
[junit4] 2> 168575 INFO (coreLoadExecutor-1185-thread-1) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@3120c15[collection1] main]
[junit4] 2> 168575 INFO (coreLoadExecutor-1185-thread-1) [ ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-002/collection1/conf
[junit4] 2> 168575 INFO (coreLoadExecutor-1185-thread-1) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 168576 INFO (searcherExecutor-1188-thread-1) [ ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@3120c15[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 168576 INFO (coreLoadExecutor-1185-thread-2) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 168576 INFO (coreLoadExecutor-1185-thread-2) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 168577 INFO (coreLoadExecutor-1185-thread-2) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=64.451171875, floorSegmentMB=0.90625, forceMergeDeletesPctAllowed=16.34341308210975, segmentsPerTier=31.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4367250308299442
[junit4] 2> 168577 INFO (coreLoadExecutor-1185-thread-2) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@278d696c[collection2] main]
[junit4] 2> 168577 INFO (coreLoadExecutor-1185-thread-2) [ ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-002/collection2/conf
[junit4] 2> 168578 INFO (coreLoadExecutor-1185-thread-3) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 168578 INFO (coreLoadExecutor-1185-thread-3) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 168578 INFO (coreLoadExecutor-1185-thread-2) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 168578 INFO (coreLoadExecutor-1185-thread-3) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=64.451171875, floorSegmentMB=0.90625, forceMergeDeletesPctAllowed=16.34341308210975, segmentsPerTier=31.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4367250308299442
[junit4] 2> 168578 INFO (searcherExecutor-1186-thread-1) [ ] o.a.s.c.SolrCore [collection2] Registered new searcher Searcher@278d696c[collection2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 168578 INFO (coreLoadExecutor-1185-thread-3) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@6513dd7f[collection5] main]
[junit4] 2> 168579 INFO (coreLoadExecutor-1185-thread-3) [ ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-002/collection5/conf
[junit4] 2> 168579 INFO (coreLoadExecutor-1185-thread-3) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 168579 INFO (searcherExecutor-1187-thread-1) [ ] o.a.s.c.SolrCore [collection5] Registered new searcher Searcher@6513dd7f[collection5] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 168583 INFO (TEST-TestLazyCores.testCachingLimit-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 168587 INFO (TEST-TestLazyCores.testCachingLimit-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.IndexSchema [collection3] Schema name=tiny
[junit4] 2> 168593 INFO (TEST-TestLazyCores.testCachingLimit-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.IndexSchema Loaded schema tiny/1.1 with uniqueid field id
[junit4] 2> 168593 INFO (TEST-TestLazyCores.testCachingLimit-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.CoreContainer Creating SolrCore 'collection3' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-002/./collection3, trusted=true
[junit4] 2> 168594 INFO (TEST-TestLazyCores.testCachingLimit-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection3' (registry 'solr.core.collection3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6415df4c
[junit4] 2> 168594 INFO (TEST-TestLazyCores.testCachingLimit-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 168594 INFO (TEST-TestLazyCores.testCachingLimit-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrCore [[collection3] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-002/collection3], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-002/./collection3/data/]
[junit4] 2> 168595 INFO (TEST-TestLazyCores.testCachingLimit-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=72.62890625, floorSegmentMB=1.658203125, forceMergeDeletesPctAllowed=11.342904211747612, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.14729262125251383
[junit4] 2> 168635 INFO (TEST-TestLazyCores.testCachingLimit-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 168635 INFO (TEST-TestLazyCores.testCachingLimit-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 168635 INFO (TEST-TestLazyCores.testCachingLimit-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=12, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=71.1884765625, floorSegmentMB=0.4677734375, forceMergeDeletesPctAllowed=22.268958357394666, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 168636 INFO (TEST-TestLazyCores.testCachingLimit-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@4420c03b[collection3] main]
[junit4] 2> 168636 INFO (TEST-TestLazyCores.testCachingLimit-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001/tempDir-002/collection3/conf
[junit4] 2> 168636 INFO (TEST-TestLazyCores.testCachingLimit-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 168637 INFO (searcherExecutor-1198-thread-1) [ ] o.a.s.c.SolrCore [collection3] Registered new searcher Searcher@4420c03b[collection3] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 168640 INFO (TEST-TestLazyCores.testCachingLimit-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[
[...truncated too long message...]
d = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@3004b8d6
[junit4] 2> 172086 INFO (coreCloseExecutor-1436-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection4, tag=1726106677
[junit4] 2> 172086 INFO (coreCloseExecutor-1436-thread-3) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@58d36ade: rootName = null, domain = solr.core.collection4, service url = null, agent id = null] for registry solr.core.collection4 / com.codahale.metrics.MetricRegistry@139c011c
[junit4] 2> 172089 INFO (coreCloseExecutor-1436-thread-4) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection2, tag=66416852
[junit4] 2> 172089 INFO (coreCloseExecutor-1436-thread-4) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@33a27ac9: rootName = null, domain = solr.core.collection2, service url = null, agent id = null] for registry solr.core.collection2 / com.codahale.metrics.MetricRegistry@73422ecf
[junit4] 2> 172093 INFO (coreCloseExecutor-1436-thread-5) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection6, tag=2012869115
[junit4] 2> 172093 INFO (coreCloseExecutor-1436-thread-5) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@32fb5c09: rootName = null, domain = solr.core.collection6, service url = null, agent id = null] for registry solr.core.collection6 / com.codahale.metrics.MetricRegistry@6cb15a57
[junit4] 2> 172097 INFO (TEST-TestLazyCores.testCreateSame-seed#[8C1406F5EF6C0FA1]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testCreateSame
[junit4] 2> 172097 INFO (SUITE-TestLazyCores-seed#[8C1406F5EF6C0FA1]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> 172097 INFO (SUITE-TestLazyCores-seed#[8C1406F5EF6C0FA1]-worker) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1760909260
[junit4] 2> 172097 INFO (SUITE-TestLazyCores-seed#[8C1406F5EF6C0FA1]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 172097 INFO (SUITE-TestLazyCores-seed#[8C1406F5EF6C0FA1]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 172097 INFO (SUITE-TestLazyCores-seed#[8C1406F5EF6C0FA1]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_8C1406F5EF6C0FA1-001
[junit4] 2> Nov 23, 2017 2:57:05 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> Nov 23, 2017 2:57:25 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores:
[junit4] 2> 1) Thread[id=2664, name=searcherExecutor-1379-thread-1, state=WAITING, group=TGRP-TestLazyCores]
[junit4] 2> at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)
[junit4] 2> at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
[junit4] 2> at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)
[junit4] 2> at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
[junit4] 2> at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
[junit4] 2> at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
[junit4] 2> at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
[junit4] 2> at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
[junit4] 2> Nov 23, 2017 2:57:25 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=2664, name=searcherExecutor-1379-thread-1, state=WAITING, group=TGRP-TestLazyCores]
[junit4] 2> Nov 23, 2017 2:57:28 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=2664, name=searcherExecutor-1379-thread-1, state=WAITING, group=TGRP-TestLazyCores]
[junit4] 2> at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)
[junit4] 2> at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
[junit4] 2> at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)
[junit4] 2> at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
[junit4] 2> at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
[junit4] 2> at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
[junit4] 2> at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
[junit4] 2> at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {v_t=PostingsFormat(name=Direct), id=PostingsFormat(name=Direct), v_s=BlockTreeOrds(blocksize=128), v_f=Lucene50(blocksize=128)}, docValues:{}, maxPointsInLeafNode=1660, maxMBSortInHeap=5.5574923834115, sim=RandomSimilarity(queryNorm=false): {}, locale=cs-CZ, timezone=Australia/Perth
[junit4] 2> NOTE: Linux 4.10.0-37-generic amd64/Oracle Corporation 10-ea (64-bit)/cpus=8,threads=2,free=348893784,total=532676608
[junit4] 2> NOTE: All tests run in this JVM: [CreateCollectionCleanupTest, TestInitQParser, TestInitParams, ClusterStateUpdateTest, TestCloudRecovery, DistributedFacetPivotWhiteBoxTest, TestAnalyzedSuggestions, TestCollectionAPI, TestNumericTokenStream, TestOmitPositions, TestConfigSetsAPIExclusivity, TestFieldTypeCollectionResource, TestFastWriter, HdfsDirectoryFactoryTest, OverseerRolesTest, TestGeoJSONResponseWriter, StatsReloadRaceTest, TestWriterPerf, AnalyticsQueryTest, MoreLikeThisHandlerTest, PrimUtilsTest, RegexBoostProcessorTest, SpatialRPTFieldTypeTest, TestExclusionRuleCollectionAccess, TestSimpleTrackingShardHandler, AddSchemaFieldsUpdateProcessorFactoryTest, OverriddenZkACLAndCredentialsProvidersTest, DOMUtilTest, TestReqParamsAPI, DeleteLastCustomShardedReplicaTest, TestLazyCores]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestLazyCores -Dtests.seed=8C1406F5EF6C0FA1 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=cs-CZ -Dtests.timezone=Australia/Perth -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J1 | TestLazyCores (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores:
[junit4] > 1) Thread[id=2664, name=searcherExecutor-1379-thread-1, state=WAITING, group=TGRP-TestLazyCores]
[junit4] > at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)
[junit4] > at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
[junit4] > at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)
[junit4] > at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
[junit4] > at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
[junit4] > at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
[junit4] > at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
[junit4] > at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
[junit4] > at __randomizedtesting.SeedInfo.seed([8C1406F5EF6C0FA1]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=2664, name=searcherExecutor-1379-thread-1, state=WAITING, group=TGRP-TestLazyCores]
[junit4] > at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)
[junit4] > at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
[junit4] > at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)
[junit4] > at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
[junit4] > at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
[junit4] > at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
[junit4] > at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
[junit4] > at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
[junit4] > at __randomizedtesting.SeedInfo.seed([8C1406F5EF6C0FA1]:0)
[junit4] Completed [91/749 (1!)] on J1 in 27.93s, 9 tests, 3 errors <<< FAILURES!
[...truncated 42259 lines...]
[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_144) - Build # 885
- Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/885/
Java: 32bit/jdk1.8.0_144 -client -XX:+UseParallelGC
3 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ShardSplitTest
Error Message:
32 threads leaked from SUITE scope at org.apache.solr.cloud.ShardSplitTest: 1) Thread[id=27552, name=qtp15275617-27552, state=TIMED_WAITING, group=TGRP-ShardSplitTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748) 2) Thread[id=27580, name=qtp21867791-27580, state=RUNNABLE, group=TGRP-ShardSplitTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 3) Thread[id=27586, name=qtp21867791-27586, state=RUNNABLE, group=TGRP-ShardSplitTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 4) Thread[id=27585, name=qtp21867791-27585, state=TIMED_WAITING, group=TGRP-ShardSplitTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748) 5) Thread[id=27577, name=searcherExecutor-8271-thread-1, state=WAITING, group=TGRP-ShardSplitTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 6) Thread[id=27598, name=TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[2C314C44B9E847D5]-EventThread, state=WAITING, group=TGRP-ShardSplitTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501) 7) Thread[id=27554, name=qtp15275617-27554, state=RUNNABLE, group=TGRP-ShardSplitTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100) at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 8) Thread[id=27568, name=TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[2C314C44B9E847D5]-SendThread(127.0.0.1:38861), state=TIMED_WAITING, group=TGRP-ShardSplitTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060) 9) Thread[id=27556, name=qtp15275617-27556, state=TIMED_WAITING, group=TGRP-ShardSplitTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748) 10) Thread[id=27557, name=qtp15275617-27557, state=RUNNABLE, group=TGRP-ShardSplitTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 11) Thread[id=27555, name=qtp15275617-27555-acceptor-0@829d44-ServerConnector@a6ddcb{HTTP/1.1,[http/1.1]}{127.0.0.1:41743}, state=RUNNABLE, group=TGRP-ShardSplitTest] at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250) at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:371) at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:601) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 12) Thread[id=27559, name=org.eclipse.jetty.server.session.HashSessionManager@1925cbeTimer, state=TIMED_WAITING, group=TGRP-ShardSplitTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 13) Thread[id=27569, name=TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[2C314C44B9E847D5]-EventThread, state=WAITING, group=TGRP-ShardSplitTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501) 14) Thread[id=27593, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardSplitTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748) 15) Thread[id=27584, name=qtp21867791-27584-acceptor-0@123c54f-ServerConnector@192fed9{HTTP/1.1,[http/1.1]}{127.0.0.1:44949}, state=RUNNABLE, group=TGRP-ShardSplitTest] at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250) at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:371) at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:601) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 16) Thread[id=27597, name=TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[2C314C44B9E847D5]-SendThread(127.0.0.1:38861), state=TIMED_WAITING, group=TGRP-ShardSplitTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060) 17) Thread[id=27582, name=qtp21867791-27582, state=RUNNABLE, group=TGRP-ShardSplitTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100) at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 18) Thread[id=27588, name=org.eclipse.jetty.server.session.HashSessionManager@14ad7f3Timer, state=TIMED_WAITING, group=TGRP-ShardSplitTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 19) Thread[id=27553, name=qtp15275617-27553, state=RUNNABLE, group=TGRP-ShardSplitTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100) at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 20) Thread[id=27587, name=qtp21867791-27587, state=TIMED_WAITING, group=TGRP-ShardSplitTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748) 21) Thread[id=27592, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardSplitTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748) 22) Thread[id=27600, name=Thread-7216, state=WAITING, group=TGRP-ShardSplitTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.solr.core.CloserThread.run(CoreContainer.java:1717) 23) Thread[id=27583, name=qtp21867791-27583, state=RUNNABLE, group=TGRP-ShardSplitTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100) at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 24) Thread[id=27603, name=Scheduler-17628962, state=WAITING, group=TGRP-ShardSplitTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 25) Thread[id=27574, name=Scheduler-10153509, state=WAITING, group=TGRP-ShardSplitTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 26) Thread[id=27563, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardSplitTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748) 27) Thread[id=27579, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardSplitTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748) 28) Thread[id=27558, name=qtp15275617-27558, state=RUNNABLE, group=TGRP-ShardSplitTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 29) Thread[id=27564, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardSplitTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748) 30) Thread[id=27571, name=Thread-7207, state=WAITING, group=TGRP-ShardSplitTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.solr.core.CloserThread.run(CoreContainer.java:1717) 31) Thread[id=27581, name=qtp21867791-27581, state=TIMED_WAITING, group=TGRP-ShardSplitTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748) 32) Thread[id=27551, name=qtp15275617-27551, state=TIMED_WAITING, group=TGRP-ShardSplitTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 32 threads leaked from SUITE scope at org.apache.solr.cloud.ShardSplitTest:
1) Thread[id=27552, name=qtp15275617-27552, state=TIMED_WAITING, group=TGRP-ShardSplitTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
2) Thread[id=27580, name=qtp21867791-27580, state=RUNNABLE, group=TGRP-ShardSplitTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
3) Thread[id=27586, name=qtp21867791-27586, state=RUNNABLE, group=TGRP-ShardSplitTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
4) Thread[id=27585, name=qtp21867791-27585, state=TIMED_WAITING, group=TGRP-ShardSplitTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
5) Thread[id=27577, name=searcherExecutor-8271-thread-1, state=WAITING, group=TGRP-ShardSplitTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
6) Thread[id=27598, name=TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[2C314C44B9E847D5]-EventThread, state=WAITING, group=TGRP-ShardSplitTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
7) Thread[id=27554, name=qtp15275617-27554, state=RUNNABLE, group=TGRP-ShardSplitTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
8) Thread[id=27568, name=TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[2C314C44B9E847D5]-SendThread(127.0.0.1:38861), state=TIMED_WAITING, group=TGRP-ShardSplitTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
9) Thread[id=27556, name=qtp15275617-27556, state=TIMED_WAITING, group=TGRP-ShardSplitTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
10) Thread[id=27557, name=qtp15275617-27557, state=RUNNABLE, group=TGRP-ShardSplitTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
11) Thread[id=27555, name=qtp15275617-27555-acceptor-0@829d44-ServerConnector@a6ddcb{HTTP/1.1,[http/1.1]}{127.0.0.1:41743}, state=RUNNABLE, group=TGRP-ShardSplitTest]
at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)
at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:371)
at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:601)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
12) Thread[id=27559, name=org.eclipse.jetty.server.session.HashSessionManager@1925cbeTimer, state=TIMED_WAITING, group=TGRP-ShardSplitTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
13) Thread[id=27569, name=TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[2C314C44B9E847D5]-EventThread, state=WAITING, group=TGRP-ShardSplitTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
14) Thread[id=27593, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardSplitTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
15) Thread[id=27584, name=qtp21867791-27584-acceptor-0@123c54f-ServerConnector@192fed9{HTTP/1.1,[http/1.1]}{127.0.0.1:44949}, state=RUNNABLE, group=TGRP-ShardSplitTest]
at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)
at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:371)
at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:601)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
16) Thread[id=27597, name=TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[2C314C44B9E847D5]-SendThread(127.0.0.1:38861), state=TIMED_WAITING, group=TGRP-ShardSplitTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
17) Thread[id=27582, name=qtp21867791-27582, state=RUNNABLE, group=TGRP-ShardSplitTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
18) Thread[id=27588, name=org.eclipse.jetty.server.session.HashSessionManager@14ad7f3Timer, state=TIMED_WAITING, group=TGRP-ShardSplitTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
19) Thread[id=27553, name=qtp15275617-27553, state=RUNNABLE, group=TGRP-ShardSplitTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
20) Thread[id=27587, name=qtp21867791-27587, state=TIMED_WAITING, group=TGRP-ShardSplitTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
21) Thread[id=27592, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardSplitTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
22) Thread[id=27600, name=Thread-7216, state=WAITING, group=TGRP-ShardSplitTest]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.solr.core.CloserThread.run(CoreContainer.java:1717)
23) Thread[id=27583, name=qtp21867791-27583, state=RUNNABLE, group=TGRP-ShardSplitTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
24) Thread[id=27603, name=Scheduler-17628962, state=WAITING, group=TGRP-ShardSplitTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
25) Thread[id=27574, name=Scheduler-10153509, state=WAITING, group=TGRP-ShardSplitTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
26) Thread[id=27563, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardSplitTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
27) Thread[id=27579, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardSplitTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
28) Thread[id=27558, name=qtp15275617-27558, state=RUNNABLE, group=TGRP-ShardSplitTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
29) Thread[id=27564, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ShardSplitTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
30) Thread[id=27571, name=Thread-7207, state=WAITING, group=TGRP-ShardSplitTest]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.solr.core.CloserThread.run(CoreContainer.java:1717)
31) Thread[id=27581, name=qtp21867791-27581, state=TIMED_WAITING, group=TGRP-ShardSplitTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
32) Thread[id=27551, name=qtp15275617-27551, state=TIMED_WAITING, group=TGRP-ShardSplitTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([2C314C44B9E847D5]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ShardSplitTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=27597, name=TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[2C314C44B9E847D5]-SendThread(127.0.0.1:38861), state=TIMED_WAITING, group=TGRP-ShardSplitTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051) 2) Thread[id=27582, name=qtp21867791-27582, state=RUNNABLE, group=TGRP-ShardSplitTest] at java.lang.Thread.isInterrupted(Native Method) at java.lang.Thread.isInterrupted(Thread.java:964) at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:218) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100) at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 3) Thread[id=27580, name=qtp21867791-27580, state=RUNNABLE, group=TGRP-ShardSplitTest] at sun.nio.ch.EPollArrayWrapper.interrupt(Native Method) at sun.nio.ch.EPollArrayWrapper.interrupt(EPollArrayWrapper.java:317) at sun.nio.ch.EPollSelectorImpl.wakeup(EPollSelectorImpl.java:207) at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:213) at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:219) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 4) Thread[id=27586, name=qtp21867791-27586, state=RUNNABLE, group=TGRP-ShardSplitTest] at sun.nio.ch.EPollArrayWrapper.interrupt(Native Method) at sun.nio.ch.EPollArrayWrapper.interrupt(EPollArrayWrapper.java:317) at sun.nio.ch.EPollSelectorImpl.wakeup(EPollSelectorImpl.java:207) at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:213) at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:219) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 5) Thread[id=27588, name=org.eclipse.jetty.server.session.HashSessionManager@14ad7f3Timer, state=TIMED_WAITING, group=TGRP-ShardSplitTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 6) Thread[id=27553, name=qtp15275617-27553, state=RUNNABLE, group=TGRP-ShardSplitTest] at java.lang.Thread.isInterrupted(Native Method) at java.lang.Thread.isInterrupted(Thread.java:964) at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:218) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100) at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 7) Thread[id=27577, name=searcherExecutor-8271-thread-1, state=WAITING, group=TGRP-ShardSplitTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 8) Thread[id=27600, name=Thread-7216, state=WAITING, group=TGRP-ShardSplitTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.solr.core.CloserThread.run(CoreContainer.java:1717) 9) Thread[id=27583, name=qtp21867791-27583, state=RUNNABLE, group=TGRP-ShardSplitTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100) at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 10) Thread[id=27603, name=Scheduler-17628962, state=WAITING, group=TGRP-ShardSplitTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 11) Thread[id=27554, name=qtp15275617-27554, state=RUNNABLE, group=TGRP-ShardSplitTest] at java.lang.Thread.isInterrupted(Native Method) at java.lang.Thread.isInterrupted(Thread.java:964) at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:218) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100) at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 12) Thread[id=27574, name=Scheduler-10153509, state=WAITING, group=TGRP-ShardSplitTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 13) Thread[id=27568, name=TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[2C314C44B9E847D5]-SendThread(127.0.0.1:38861), state=TIMED_WAITING, group=TGRP-ShardSplitTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060) 14) Thread[id=27558, name=qtp15275617-27558, state=RUNNABLE, group=TGRP-ShardSplitTest] at java.lang.Thread.isInterrupted(Native Method) at java.lang.Thread.isInterrupted(Thread.java:964) at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:218) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 15) Thread[id=27571, name=Thread-7207, state=WAITING, group=TGRP-ShardSplitTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.solr.core.CloserThread.run(CoreContainer.java:1717) 16) Thread[id=27557, name=qtp15275617-27557, state=RUNNABLE, group=TGRP-ShardSplitTest] at sun.nio.ch.EPollArrayWrapper.interrupt(Native Method) at sun.nio.ch.EPollArrayWrapper.interrupt(EPollArrayWrapper.java:317) at sun.nio.ch.EPollSelectorImpl.wakeup(EPollSelectorImpl.java:207) at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:213) at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:219) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 17) Thread[id=27559, name=org.eclipse.jetty.server.session.HashSessionManager@1925cbeTimer, state=TIMED_WAITING, group=TGRP-ShardSplitTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=27597, name=TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[2C314C44B9E847D5]-SendThread(127.0.0.1:38861), state=TIMED_WAITING, group=TGRP-ShardSplitTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051)
2) Thread[id=27582, name=qtp21867791-27582, state=RUNNABLE, group=TGRP-ShardSplitTest]
at java.lang.Thread.isInterrupted(Native Method)
at java.lang.Thread.isInterrupted(Thread.java:964)
at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:218)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
3) Thread[id=27580, name=qtp21867791-27580, state=RUNNABLE, group=TGRP-ShardSplitTest]
at sun.nio.ch.EPollArrayWrapper.interrupt(Native Method)
at sun.nio.ch.EPollArrayWrapper.interrupt(EPollArrayWrapper.java:317)
at sun.nio.ch.EPollSelectorImpl.wakeup(EPollSelectorImpl.java:207)
at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:213)
at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:219)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
4) Thread[id=27586, name=qtp21867791-27586, state=RUNNABLE, group=TGRP-ShardSplitTest]
at sun.nio.ch.EPollArrayWrapper.interrupt(Native Method)
at sun.nio.ch.EPollArrayWrapper.interrupt(EPollArrayWrapper.java:317)
at sun.nio.ch.EPollSelectorImpl.wakeup(EPollSelectorImpl.java:207)
at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:213)
at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:219)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
5) Thread[id=27588, name=org.eclipse.jetty.server.session.HashSessionManager@14ad7f3Timer, state=TIMED_WAITING, group=TGRP-ShardSplitTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
6) Thread[id=27553, name=qtp15275617-27553, state=RUNNABLE, group=TGRP-ShardSplitTest]
at java.lang.Thread.isInterrupted(Native Method)
at java.lang.Thread.isInterrupted(Thread.java:964)
at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:218)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
7) Thread[id=27577, name=searcherExecutor-8271-thread-1, state=WAITING, group=TGRP-ShardSplitTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
8) Thread[id=27600, name=Thread-7216, state=WAITING, group=TGRP-ShardSplitTest]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.solr.core.CloserThread.run(CoreContainer.java:1717)
9) Thread[id=27583, name=qtp21867791-27583, state=RUNNABLE, group=TGRP-ShardSplitTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
10) Thread[id=27603, name=Scheduler-17628962, state=WAITING, group=TGRP-ShardSplitTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
11) Thread[id=27554, name=qtp15275617-27554, state=RUNNABLE, group=TGRP-ShardSplitTest]
at java.lang.Thread.isInterrupted(Native Method)
at java.lang.Thread.isInterrupted(Thread.java:964)
at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:218)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
12) Thread[id=27574, name=Scheduler-10153509, state=WAITING, group=TGRP-ShardSplitTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
13) Thread[id=27568, name=TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[2C314C44B9E847D5]-SendThread(127.0.0.1:38861), state=TIMED_WAITING, group=TGRP-ShardSplitTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
14) Thread[id=27558, name=qtp15275617-27558, state=RUNNABLE, group=TGRP-ShardSplitTest]
at java.lang.Thread.isInterrupted(Native Method)
at java.lang.Thread.isInterrupted(Thread.java:964)
at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:218)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
15) Thread[id=27571, name=Thread-7207, state=WAITING, group=TGRP-ShardSplitTest]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.solr.core.CloserThread.run(CoreContainer.java:1717)
16) Thread[id=27557, name=qtp15275617-27557, state=RUNNABLE, group=TGRP-ShardSplitTest]
at sun.nio.ch.EPollArrayWrapper.interrupt(Native Method)
at sun.nio.ch.EPollArrayWrapper.interrupt(EPollArrayWrapper.java:317)
at sun.nio.ch.EPollSelectorImpl.wakeup(EPollSelectorImpl.java:207)
at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:213)
at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:219)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
17) Thread[id=27559, name=org.eclipse.jetty.server.session.HashSessionManager@1925cbeTimer, state=TIMED_WAITING, group=TGRP-ShardSplitTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([2C314C44B9E847D5]:0)
FAILED: org.apache.solr.cloud.ShardSplitTest.testSplitStaticIndexReplication
Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:36569
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:36569
at __randomizedtesting.SeedInfo.seed([2C314C44B9E847D5:667BD844284068D0]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:654)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1103)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:883)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:816)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(AbstractFullDistribZkTestBase.java:408)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:333)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:991)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.r
[...truncated too long message...]
strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
[junit4] > at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 10) Thread[id=27603, name=Scheduler-17628962, state=WAITING, group=TGRP-ShardSplitTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
[junit4] > at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 11) Thread[id=27554, name=qtp15275617-27554, state=RUNNABLE, group=TGRP-ShardSplitTest]
[junit4] > at java.lang.Thread.isInterrupted(Native Method)
[junit4] > at java.lang.Thread.isInterrupted(Thread.java:964)
[junit4] > at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:218)
[junit4] > at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)
[junit4] > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
[junit4] > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
[junit4] > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
[junit4] > at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
[junit4] > at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
[junit4] > at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
[junit4] > at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] > at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
[junit4] > at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 12) Thread[id=27574, name=Scheduler-10153509, state=WAITING, group=TGRP-ShardSplitTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
[junit4] > at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 13) Thread[id=27568, name=TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[2C314C44B9E847D5]-SendThread(127.0.0.1:38861), state=TIMED_WAITING, group=TGRP-ShardSplitTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
[junit4] > 14) Thread[id=27558, name=qtp15275617-27558, state=RUNNABLE, group=TGRP-ShardSplitTest]
[junit4] > at java.lang.Thread.isInterrupted(Native Method)
[junit4] > at java.lang.Thread.isInterrupted(Thread.java:964)
[junit4] > at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:218)
[junit4] > at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)
[junit4] > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
[junit4] > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
[junit4] > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
[junit4] > at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
[junit4] > at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
[junit4] > at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
[junit4] > at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] > at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 15) Thread[id=27571, name=Thread-7207, state=WAITING, group=TGRP-ShardSplitTest]
[junit4] > at java.lang.Object.wait(Native Method)
[junit4] > at java.lang.Object.wait(Object.java:502)
[junit4] > at org.apache.solr.core.CloserThread.run(CoreContainer.java:1717)
[junit4] > 16) Thread[id=27557, name=qtp15275617-27557, state=RUNNABLE, group=TGRP-ShardSplitTest]
[junit4] > at sun.nio.ch.EPollArrayWrapper.interrupt(Native Method)
[junit4] > at sun.nio.ch.EPollArrayWrapper.interrupt(EPollArrayWrapper.java:317)
[junit4] > at sun.nio.ch.EPollSelectorImpl.wakeup(EPollSelectorImpl.java:207)
[junit4] > at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:213)
[junit4] > at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:219)
[junit4] > at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)
[junit4] > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
[junit4] > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
[junit4] > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
[junit4] > at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
[junit4] > at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
[junit4] > at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
[junit4] > at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] > at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 17) Thread[id=27559, name=org.eclipse.jetty.server.session.HashSessionManager@1925cbeTimer, state=TIMED_WAITING, group=TGRP-ShardSplitTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
[junit4] > at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
[junit4] > at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at __randomizedtesting.SeedInfo.seed([2C314C44B9E847D5]:0)
[junit4] Completed [683/749 (1!)] on J2 in 945.36s, 5 tests, 3 errors <<< FAILURES!
[...truncated 43346 lines...]
[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_144) - Build # 884
- Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/884/
Java: 32bit/jdk1.8.0_144 -server -XX:+UseG1GC
6 tests failed.
FAILED: org.apache.solr.common.cloud.TestCollectionStateWatchers.testWaitForStateWatcherIsRetainedOnPredicateFailure
Error Message:
Did not see a fully active cluster after 30 seconds
Stack Trace:
java.lang.AssertionError: Did not see a fully active cluster after 30 seconds
at __randomizedtesting.SeedInfo.seed([2DE7E2FE6A76FE91:A5D140ADB2D91683]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.common.cloud.TestCollectionStateWatchers.testWaitForStateWatcherIsRetainedOnPredicateFailure(TestCollectionStateWatchers.java:250)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.common.cloud.TestCollectionStateWatchers.testCanWaitForNonexistantCollection
Error Message:
waitForState was not triggered by collection creation
Stack Trace:
java.lang.AssertionError: waitForState was not triggered by collection creation
at __randomizedtesting.SeedInfo.seed([2DE7E2FE6A76FE91:86C7794807283ABA]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.common.cloud.TestCollectionStateWatchers.testCanWaitForNonexistantCollection(TestCollectionStateWatchers.java:206)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.common.cloud.TestCollectionStateWatchers.testWaitForStateChecksCurrentState
Error Message:
Stack Trace:
java.util.concurrent.TimeoutException
at __randomizedtesting.SeedInfo.seed([2DE7E2FE6A76FE91:FB0B8D263A2F83C4]:0)
at org.apache.solr.common.cloud.ZkStateReader.waitForState(ZkStateReader.java:1275)
at org.apache.solr.client.solrj.impl.CloudSolrClient.waitForState(CloudSolrClient.java:448)
at org.apache.solr.common.cloud.TestCollectionStateWatchers.testWaitForStateChecksCurrentState(TestCollectionStateWatchers.java:182)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.common.cloud.TestCollectionStateWatchers.testWatchesWorkForStateFormat1
Error Message:
CollectionStateWatcher not notified of stateformat=1 collection creation
Stack Trace:
java.lang.AssertionError: CollectionStateWatcher not notified of stateformat=1 collection creation
at __randomizedtesting.SeedInfo.seed([2DE7E2FE6A76FE91:4A20FE109ECEDA30]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.common.cloud.TestCollectionStateWatchers.testWatchesWorkForStateFormat1(TestCollectionStateWatchers.java:290)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.common.cloud.TestCollectionStateWatchers.testDeletionsTriggerWatches
Error Message:
Error from server at http://127.0.0.1:36089/solr: Could not fully create collection: tobedeleted
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:36089/solr: Could not fully create collection: tobedeleted
at __randomizedtesting.SeedInfo.seed([2DE7E2FE6A76FE91:8F262A71E81528FC]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1103)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:883)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:816)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.common.cloud.TestCollectionStateWatchers.testDeletionsTriggerWatches(TestCollectionStateWatchers.java:272)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.common.cloud.TestCollectionStateWatchers.testSimpleCollectionWatch
Error Message:
Stack Trace:
java.util.concurrent.TimeoutException
at __randomizedtesting.SeedInfo.seed([2DE7E2FE6A76FE91:70DC2D8E2D7B61AF]:0)
at org.apache.solr.common.cloud.ZkStateReader.waitForState(ZkStateReader.java:1275)
at org.apache.solr.client.solrj.impl.CloudSolrClient.waitForState(CloudSolrClient.java:448)
at org.apache.solr.common.cloud.TestCollectionStateWatchers.testSimpleCollectionWatch(TestCollectionStateWatchers.java:117)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 14930 lines...]
[junit4] Suite: org.apache.solr.common.cloud.TestCollectionStateWatchers
[junit4] 2> 60049 INFO (SUITE-TestCollectionStateWatchers-seed#[2DE7E2FE6A76FE91]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-solrj/test/J2/temp/solr.common.cloud.TestCollectionStateWatchers_2DE7E2FE6A76FE91-001/init-core-data-001
[junit4] 2> 60049 WARN (SUITE-TestCollectionStateWatchers-seed#[2DE7E2FE6A76FE91]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=66 numCloses=66
[junit4] 2> 60050 INFO (SUITE-TestCollectionStateWatchers-seed#[2DE7E2FE6A76FE91]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 60051 INFO (SUITE-TestCollectionStateWatchers-seed#[2DE7E2FE6A76FE91]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 60052 INFO (SUITE-TestCollectionStateWatchers-seed#[2DE7E2FE6A76FE91]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-solrj/test/J2/temp/solr.common.cloud.TestCollectionStateWatchers_2DE7E2FE6A76FE91-001/tempDir-001
[junit4] 2> 60052 INFO (SUITE-TestCollectionStateWatchers-seed#[2DE7E2FE6A76FE91]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 60052 INFO (Thread-62) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 60052 INFO (Thread-62) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 60053 ERROR (Thread-62) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 60152 INFO (SUITE-TestCollectionStateWatchers-seed#[2DE7E2FE6A76FE91]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:46025
[junit4] 2> 60158 INFO (jetty-launcher-55-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 60158 INFO (jetty-launcher-55-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 60160 INFO (jetty-launcher-55-thread-3) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 60163 INFO (jetty-launcher-55-thread-4) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 60163 INFO (jetty-launcher-55-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4c4d84{/solr,null,AVAILABLE}
[junit4] 2> 60165 INFO (jetty-launcher-55-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@13b23ef{HTTP/1.1,[http/1.1]}{127.0.0.1:36089}
[junit4] 2> 60165 INFO (jetty-launcher-55-thread-4) [ ] o.e.j.s.Server Started @62648ms
[junit4] 2> 60165 INFO (jetty-launcher-55-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36089}
[junit4] 2> 60165 ERROR (jetty-launcher-55-thread-4) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 60165 INFO (jetty-launcher-55-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.2.0
[junit4] 2> 60165 INFO (jetty-launcher-55-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 60165 INFO (jetty-launcher-55-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 60165 INFO (jetty-launcher-55-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-23T09:08:45.254Z
[junit4] 2> 60170 INFO (jetty-launcher-55-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@14088e1{/solr,null,AVAILABLE}
[junit4] 2> 60170 INFO (jetty-launcher-55-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1e8efe9{HTTP/1.1,[http/1.1]}{127.0.0.1:44537}
[junit4] 2> 60170 INFO (jetty-launcher-55-thread-3) [ ] o.e.j.s.Server Started @62653ms
[junit4] 2> 60170 INFO (jetty-launcher-55-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44537}
[junit4] 2> 60170 ERROR (jetty-launcher-55-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 60170 INFO (jetty-launcher-55-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.2.0
[junit4] 2> 60170 INFO (jetty-launcher-55-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 60170 INFO (jetty-launcher-55-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 60170 INFO (jetty-launcher-55-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-23T09:08:45.259Z
[junit4] 2> 60171 INFO (jetty-launcher-55-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 60171 INFO (jetty-launcher-55-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@899e6a{/solr,null,AVAILABLE}
[junit4] 2> 60175 INFO (jetty-launcher-55-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@49d16a{HTTP/1.1,[http/1.1]}{127.0.0.1:37633}
[junit4] 2> 60175 INFO (jetty-launcher-55-thread-2) [ ] o.e.j.s.Server Started @62658ms
[junit4] 2> 60175 INFO (jetty-launcher-55-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37633}
[junit4] 2> 60175 INFO (jetty-launcher-55-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4a09e3{/solr,null,AVAILABLE}
[junit4] 2> 60175 ERROR (jetty-launcher-55-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 60176 INFO (jetty-launcher-55-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.2.0
[junit4] 2> 60176 INFO (jetty-launcher-55-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 60176 INFO (jetty-launcher-55-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 60176 INFO (jetty-launcher-55-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-23T09:08:45.265Z
[junit4] 2> 60178 INFO (jetty-launcher-55-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 60178 INFO (jetty-launcher-55-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1131aff{HTTP/1.1,[http/1.1]}{127.0.0.1:40857}
[junit4] 2> 60178 INFO (jetty-launcher-55-thread-1) [ ] o.e.j.s.Server Started @62661ms
[junit4] 2> 60178 INFO (jetty-launcher-55-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40857}
[junit4] 2> 60178 ERROR (jetty-launcher-55-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 60178 INFO (jetty-launcher-55-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.2.0
[junit4] 2> 60178 INFO (jetty-launcher-55-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 60178 INFO (jetty-launcher-55-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 60178 INFO (jetty-launcher-55-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-23T09:08:45.267Z
[junit4] 2> 60218 INFO (jetty-launcher-55-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 60219 INFO (jetty-launcher-55-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 60226 INFO (jetty-launcher-55-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46025/solr
[junit4] 2> 60229 INFO (jetty-launcher-55-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46025/solr
[junit4] 2> 60231 INFO (jetty-launcher-55-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46025/solr
[junit4] 2> 60231 INFO (jetty-launcher-55-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46025/solr
[junit4] 2> 60241 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15fe822f1d60007, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 60253 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15fe822f1d60008, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 60279 WARN (jetty-launcher-55-thread-2) [n:127.0.0.1:37633_solr ] o.a.s.c.ZkController The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: null
[junit4] 2> 60279 WARN (jetty-launcher-55-thread-4) [n:127.0.0.1:36089_solr ] o.a.s.c.ZkController The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: null
[junit4] 2> 60284 WARN (jetty-launcher-55-thread-3) [n:127.0.0.1:44537_solr ] o.a.s.c.ZkController The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: null
[junit4] 2> 60285 INFO (jetty-launcher-55-thread-2) [n:127.0.0.1:37633_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 60285 INFO (jetty-launcher-55-thread-4) [n:127.0.0.1:36089_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 60286 INFO (jetty-launcher-55-thread-2) [n:127.0.0.1:37633_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37633_solr
[junit4] 2> 60286 INFO (jetty-launcher-55-thread-4) [n:127.0.0.1:36089_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36089_solr
[junit4] 2> 60287 INFO (jetty-launcher-55-thread-3) [n:127.0.0.1:44537_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 60287 INFO (zkCallback-74-thread-1-processing-n:127.0.0.1:44537_solr) [n:127.0.0.1:44537_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 60299 INFO (zkCallback-75-thread-1-processing-n:127.0.0.1:36089_solr) [n:127.0.0.1:36089_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 60305 INFO (jetty-launcher-55-thread-2) [n:127.0.0.1:37633_solr ] o.a.s.c.Overseer Overseer (id=99052953609306123-127.0.0.1:37633_solr-n_0000000000) starting
[junit4] 2> 60305 WARN (jetty-launcher-55-thread-1) [n:127.0.0.1:40857_solr ] o.a.s.c.ZkController The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: null
[junit4] 2> 60306 INFO (jetty-launcher-55-thread-1) [n:127.0.0.1:40857_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 60308 INFO (jetty-launcher-55-thread-1) [n:127.0.0.1:40857_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 60311 INFO (zkCallback-76-thread-1-processing-n:127.0.0.1:37633_solr) [n:127.0.0.1:37633_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 60311 INFO (jetty-launcher-55-thread-3) [n:127.0.0.1:44537_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44537_solr
[junit4] 2> 60312 INFO (zkCallback-75-thread-1-processing-n:127.0.0.1:36089_solr) [n:127.0.0.1:36089_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 60312 INFO (jetty-launcher-55-thread-1) [n:127.0.0.1:40857_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40857_solr
[junit4] 2> 60313 INFO (zkCallback-77-thread-1-processing-n:127.0.0.1:40857_solr) [n:127.0.0.1:40857_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 60315 INFO (zkCallback-74-thread-1-processing-n:127.0.0.1:44537_solr) [n:127.0.0.1:44537_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 60315 INFO (zkCallback-76-thread-1-processing-n:127.0.0.1:37633_solr) [n:127.0.0.1:37633_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 60321 INFO (zkCallback-74-thread-1-processing-n:127.0.0.1:44537_solr) [n:127.0.0.1:44537_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 60321 INFO (zkCallback-76-thread-1-processing-n:127.0.0.1:37633_solr) [n:127.0.0.1:37633_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 60321 INFO (zkCallback-75-thread-1-processing-n:127.0.0.1:36089_solr) [n:127.0.0.1:36089_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 60328 INFO (zkCallback-77-thread-1-processing-n:127.0.0.1:40857_solr) [n:127.0.0.1:40857_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 60370 INFO (jetty-launcher-55-thread-2) [n:127.0.0.1:37633_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37633_solr
[junit4] 2> 60370 INFO (zkCallback-77-thread-1-processing-n:127.0.0.1:40857_solr) [n:127.0.0.1:40857_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 60370 INFO (zkCallback-75-thread-1-processing-n:127.0.0.1:36089_solr) [n:127.0.0.1:36089_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 60371 INFO (zkCallback-74-thread-1-processing-n:127.0.0.1:44537_solr) [n:127.0.0.1:44537_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 60377 INFO (zkCallback-76-thread-1-processing-n:127.0.0.1:37633_solr) [n:127.0.0.1:37633_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 60556 INFO (jetty-launcher-55-thread-1) [n:127.0.0.1:40857_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40857.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@137c0cf
[junit4] 2> 60560 INFO (jetty-launcher-55-thread-3) [n:127.0.0.1:44537_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44537.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@137c0cf
[junit4] 2> 60570 INFO (jetty-launcher-55-thread-2) [n:127.0.0.1:37633_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37633.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@137c0cf
[junit4] 2> 60583 INFO (jetty-launcher-55-thread-3) [n:127.0.0.1:44537_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44537.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@137c0cf
[junit4] 2> 60583 INFO (jetty-launcher-55-thread-3) [n:127.0.0.1:44537_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44537.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@137c0cf
[junit4] 2> 60587 INFO (jetty-launcher-55-thread-3) [n:127.0.0.1:44537_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-solrj/test/J2/temp/solr.common.cloud.TestCollectionStateWatchers_2DE7E2FE6A76FE91-001/tempDir-001/node3/.
[junit4] 2> 60588 INFO (jetty-launcher-55-thread-4) [n:127.0.0.1:36089_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36089.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@137c0cf
[junit4] 2> 60694 INFO (jetty-launcher-55-thread-1) [n:127.0.0.1:40857_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40857.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@137c0cf
[junit4] 2> 60694 INFO (jetty-launcher-55-thread-1) [n:127.0.0.1:40857_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40857.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@137c0cf
[junit4] 2> 60696 INFO (jetty-launcher-55-thread-1) [n:127.0.0.1:40857_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-solrj/test/J2/temp/solr.common.cloud.TestCollectionStateWatchers_2DE7E2FE6A76FE91-001/tempDir-001/node1/.
[junit4] 2> 60696 INFO (jetty-launcher-55-thread-2) [n:127.0.0.1:37633_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37633.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@137c0cf
[junit4] 2> 60696 INFO (jetty-launcher-55-thread-2) [n:127.0.0.1:37633_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37633.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@137c0cf
[junit4] 2> 60697 INFO (jetty-launcher-55-thread-2) [n:127.0.0.1:37633_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-solrj/test/J2/temp/solr.common.cloud.TestCollectionStateWatchers_2DE7E2FE6A76FE91-001/tempDir-001/node2/.
[junit4] 2> 60705 INFO (jetty-launcher-55-thread-4) [n:127.0.0.1:36089_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36089.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@137c0cf
[junit4] 2> 60705 INFO (jetty-launcher-55-thread-4) [n:127.0.0.1:36089_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36089.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@137c0cf
[junit4] 2> 60707 INFO (jetty-launcher-55-thread-4) [n:127.0.0.1:36089_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-solrj/test/J2/temp/solr.common.cloud.TestCollectionStateWatchers_2DE7E2FE6A76FE91-001/tempDir-001/node4/.
[junit4] 2> 61010 INFO (SUITE-TestCollectionStateWatchers-seed#[2DE7E2FE6A76FE91]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 61011 INFO (SUITE-TestCollectionStateWatchers-seed#[2DE7E2FE6A76FE91]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46025/solr ready
[junit4] 2> 61050 INFO (TEST-TestCollectionStateWatchers.testWaitForStateWatcherIsRetainedOnPredicateFailure-seed#[2DE7E2FE6A76FE91]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testWaitForStateWatcherIsRetainedOnPredicateFailure
[junit4] 2> 61112 INFO (qtp28618242-491) [n:127.0.0.1:36089_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=8720cfd9-9855-433a-bfff-5126c24bc124&replicationFactor=1&collection.configName=config&name=falsepredicate&nrtReplicas=1&action=CREATE&numShards=4&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 61132 INFO (qtp28618242-491) [n:127.0.0.1:36089_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=8720cfd9-9855-433a-bfff-5126c24bc124&replicationFactor=1&collection.configName=config&name=falsepredicate&nrtReplicas=1&action=CREATE&numShards=4&wt=javabin&version=2} status=0 QTime=20
[junit4] 2> 61137 INFO (qtp28618242-492) [n:127.0.0.1:36089_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=8720cfd9-9855-433a-bfff-5126c24bc124&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 61137 INFO (qtp28618242-492) [n:127.0.0.1:36089_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=8720cfd9-9855-433a-bfff-5126c24bc124&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 61138 INFO (OverseerThreadFactory-199-thread-1-processing-n:127.0.0.1:37633_solr) [n:127.0.0.1:37633_solr ] o.a.s.c.CreateCollectionCmd Create collection falsepredicate
[junit4] 2> 61252 INFO (OverseerStateUpdate-99052953609306123-127.0.0.1:37633_solr-n_0000000000) [n:127.0.0.1:37633_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"falsepredicate",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"falsepredicate_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:44537/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 61254 INFO (OverseerStateUpdate-99052953609306123-127.0.0.1:37633_solr-n_0000000000) [n:127.0.0.1:37633_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"falsepredicate",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"falsepredicate_shard2_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:36089/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 61256 INFO (OverseerStateUpdate-99052953609306123-127.0.0.1:37633_solr-n_0000000000) [n:127.0.0.1:37633_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"falsepredicate",
[junit4] 2> "shard":"shard3",
[junit4] 2> "core":"falsepredicate_shard3_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:37633/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 61258 INFO (OverseerStateUpdate-99052953609306123-127.0.0.1:37633_solr-n_0000000000) [n:127.0.0.1:37633_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"falsepredicate",
[junit4] 2> "shard":"shard4",
[junit4] 2> "core":"falsepredicate_shard4_replica_n6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:40857/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 61476 INFO (qtp2966117-502) [n:127.0.0.1:44537_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=config&newCollection=true&collection=falsepredicate&version=2&replicaType=NRT&async=8720cfd9-9855-433a-bfff-5126c24bc1242153474511440547&coreNodeName=core_node3&name=falsepredicate_shard1_replica_n1&action=CREATE&numShards=4&shard=shard1&wt=javabin} status=0 QTime=10
[junit4] 2> 61476 INFO (parallelCoreAdminExecutor-202-thread-1-processing-n:127.0.0.1:44537_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474511440547 CREATE) [n:127.0.0.1:44537_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=config&newCollection=true&collection=falsepredicate&version=2&replicaType=NRT&async=8720cfd9-9855-433a-bfff-5126c24bc1242153474511440547&coreNodeName=core_node3&name=falsepredicate_shard1_replica_n1&action=CREATE&numShards=4&shard=shard1&wt=javabin
[junit4] 2> 61482 INFO (qtp28618242-487) [n:127.0.0.1:36089_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=config&newCollection=true&collection=falsepredicate&version=2&replicaType=NRT&async=8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009&coreNodeName=core_node5&name=falsepredicate_shard2_replica_n2&action=CREATE&numShards=4&shard=shard2&wt=javabin} status=0 QTime=15
[junit4] 2> 61484 INFO (parallelCoreAdminExecutor-203-thread-1-processing-n:127.0.0.1:36089_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE) [n:127.0.0.1:36089_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=config&newCollection=true&collection=falsepredicate&version=2&replicaType=NRT&async=8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009&coreNodeName=core_node5&name=falsepredicate_shard2_replica_n2&action=CREATE&numShards=4&shard=shard2&wt=javabin
[junit4] 2> 61485 INFO (parallelCoreAdminExecutor-203-thread-1-processing-n:127.0.0.1:36089_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE) [n:127.0.0.1:36089_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 61500 INFO (parallelCoreAdminExecutor-202-thread-1-processing-n:127.0.0.1:44537_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474511440547 CREATE) [n:127.0.0.1:44537_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 61529 INFO (qtp14794941-506) [n:127.0.0.1:37633_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=config&newCollection=true&collection=falsepredicate&version=2&replicaType=NRT&async=8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171&coreNodeName=core_node7&name=falsepredicate_shard3_replica_n4&action=CREATE&numShards=4&shard=shard3&wt=javabin} status=0 QTime=28
[junit4] 2> 61530 INFO (qtp15432601-496) [n:127.0.0.1:40857_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=config&newCollection=true&collection=falsepredicate&version=2&replicaType=NRT&async=8720cfd9-9855-433a-bfff-5126c24bc1242153474517296581&coreNodeName=core_node8&name=falsepredicate_shard4_replica_n6&action=CREATE&numShards=4&shard=shard4&wt=javabin} status=0 QTime=0
[junit4] 2> 61549 INFO (qtp28618242-485) [n:127.0.0.1:36089_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009
[junit4] 2> 61550 INFO (parallelCoreAdminExecutor-200-thread-1-processing-n:127.0.0.1:40857_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474517296581 CREATE) [n:127.0.0.1:40857_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=config&newCollection=true&collection=falsepredicate&version=2&replicaType=NRT&async=8720cfd9-9855-433a-bfff-5126c24bc1242153474517296581&coreNodeName=core_node8&name=falsepredicate_shard4_replica_n6&action=CREATE&numShards=4&shard=shard4&wt=javabin
[junit4] 2> 61550 INFO (parallelCoreAdminExecutor-201-thread-1-processing-n:127.0.0.1:37633_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE) [n:127.0.0.1:37633_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=config&newCollection=true&collection=falsepredicate&version=2&replicaType=NRT&async=8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171&coreNodeName=core_node7&name=falsepredicate_shard3_replica_n4&action=CREATE&numShards=4&shard=shard3&wt=javabin
[junit4] 2> 61551 INFO (parallelCoreAdminExecutor-200-thread-1-processing-n:127.0.0.1:40857_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474517296581 CREATE) [n:127.0.0.1:40857_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 61551 INFO (qtp28618242-485) [n:127.0.0.1:36089_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 61551 INFO (parallelCoreAdminExecutor-201-thread-1-processing-n:127.0.0.1:37633_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE) [n:127.0.0.1:37633_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 61666 INFO (zkCallback-77-thread-1-processing-n:127.0.0.1:40857_solr) [n:127.0.0.1:40857_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/falsepredicate/state.json] for collection [falsepredicate] has occurred - updating... (live nodes size: [4])
[junit4] 2> 61666 INFO (zkCallback-74-thread-1-processing-n:127.0.0.1:44537_solr) [n:127.0.0.1:44537_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/falsepredicate/state.json] for collection [falsepredicate] has occurred - updating... (live nodes size: [4])
[junit4] 2> 61666 INFO (zkCallback-75-thread-1-processing-n:127.0.0.1:36089_solr) [n:127.0.0.1:36089_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/falsepredicate/state.json] for collection [falsepredicate] has occurred - updating... (live nodes size: [4])
[junit4] 2> 61666 INFO (zkCallback-76-thread-1-processing-n:127.0.0.1:37633_solr) [n:127.0.0.1:37633_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/falsepredicate/state.json] for collection [falsepredicate] has occurred - updating... (live nodes size: [4])
[junit4] 2> 61673 INFO (zkCallback-74-thread-2-processing-n:127.0.0.1:44537_solr) [n:127.0.0.1:44537_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/falsepredicate/state.json] for collection [falsepredicate] has occurred - updating... (live nodes size: [4])
[junit4] 2> 61673 INFO (zkCallback-76-thread-2-processing-n:127.0.0.1:37633_solr) [n:127.0.0.1:37633_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/falsepredicate/state.json] for collection [falsepredicate] has occurred - updating... (live nodes size: [4])
[junit4] 2> 61674 INFO (zkCallback-75-thread-2-processing-n:127.0.0.1:36089_solr) [n:127.0.0.1:36089_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/falsepredicate/state.json] for collection [falsepredicate] has occurred - updating... (live nodes size: [4])
[junit4] 2> 61677 INFO (zkCallback-77-thread-2-processing-n:127.0.0.1:40857_solr) [n:127.0.0.1:40857_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/falsepredicate/state.json] for collection [falsepredicate] has occurred - updating... (live nodes size: [4])
[junit4] 2> 62138 INFO (qtp28618242-493) [n:127.0.0.1:36089_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=8720cfd9-9855-433a-bfff-5126c24bc124&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 62139 INFO (qtp28618242-493) [n:127.0.0.1:36089_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=8720cfd9-9855-433a-bfff-5126c24bc124&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 62536 INFO (parallelCoreAdminExecutor-203-thread-1-processing-n:127.0.0.1:36089_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 62552 INFO (qtp28618242-491) [n:127.0.0.1:36089_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009
[junit4] 2> 62552 INFO (qtp28618242-491) [n:127.0.0.1:36089_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 62560 INFO (parallelCoreAdminExecutor-203-thread-1-processing-n:127.0.0.1:36089_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.s.IndexSchema [falsepredicate_shard2_replica_n2] Schema name=test
[junit4] 2> 62561 INFO (parallelCoreAdminExecutor-202-thread-1-processing-n:127.0.0.1:44537_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474511440547 CREATE) [n:127.0.0.1:44537_solr c:falsepredicate s:shard1 r:core_node3 x:falsepredicate_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 62574 INFO (parallelCoreAdminExecutor-201-thread-1-processing-n:127.0.0.1:37633_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE) [n:127.0.0.1:37633_solr c:falsepredicate s:shard3 r:core_node7 x:falsepredicate_shard3_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 62579 INFO (parallelCoreAdminExecutor-200-thread-1-processing-n:127.0.0.1:40857_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474517296581 CREATE) [n:127.0.0.1:40857_solr c:falsepredicate s:shard4 r:core_node8 x:falsepredicate_shard4_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 62610 INFO (parallelCoreAdminExecutor-202-thread-1-processing-n:127.0.0.1:44537_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474511440547 CREATE) [n:127.0.0.1:44537_solr c:falsepredicate s:shard1 r:core_node3 x:falsepredicate_shard1_replica_n1] o.a.s.s.IndexSchema [falsepredicate_shard1_replica_n1] Schema name=test
[junit4] 2> 62614 INFO (parallelCoreAdminExecutor-201-thread-1-processing-n:127.0.0.1:37633_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE) [n:127.0.0.1:37633_solr c:falsepredicate s:shard3 r:core_node7 x:falsepredicate_shard3_replica_n4] o.a.s.s.IndexSchema [falsepredicate_shard3_replica_n4] Schema name=test
[junit4] 2> 62653 INFO (parallelCoreAdminExecutor-200-thread-1-processing-n:127.0.0.1:40857_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474517296581 CREATE) [n:127.0.0.1:40857_solr c:falsepredicate s:shard4 r:core_node8 x:falsepredicate_shard4_replica_n6] o.a.s.s.IndexSchema [falsepredicate_shard4_replica_n6] Schema name=test
[junit4] 2> 62749 WARN (parallelCoreAdminExecutor-203-thread-1-processing-n:127.0.0.1:36089_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 62749 WARN (parallelCoreAdminExecutor-203-thread-1-processing-n:127.0.0.1:36089_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 62749 INFO (parallelCoreAdminExecutor-203-thread-1-processing-n:127.0.0.1:36089_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 62749 INFO (parallelCoreAdminExecutor-203-thread-1-processing-n:127.0.0.1:36089_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'falsepredicate_shard2_replica_n2' using configuration from collection falsepredicate, trusted=true
[junit4] 2> 62750 INFO (parallelCoreAdminExecutor-203-thread-1-processing-n:127.0.0.1:36089_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36089.solr.core.falsepredicate.shard2.replica_n2' (registry 'solr.core.falsepredicate.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@137c0cf
[junit4] 2> 62750 INFO (parallelCoreAdminExecutor-203-thread-1-processing-n:127.0.0.1:36089_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 62750 INFO (parallelCoreAdminExecutor-203-thread-1-processing-n:127.0.0.1:36089_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.c.SolrCore [[falsepredicate_shard2_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-solrj/test/J2/temp/solr.common.cloud.TestCollectionStateWatchers_2DE7E2FE6A76FE91-001/tempDir-001/node4/falsepredicate_shard2_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-solrj/test/J2/temp/solr.common.cloud.TestCollectionStateWatchers_2DE7E2FE6A76FE91-001/tempDir-001/node4/./falsepredicate_shard2_replica_n2/data/]
[junit4] 2> 62763 WARN (parallelCoreAdminExecutor-202-thread-1-processing-n:127.0.0.1:44537_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474511440547 CREATE) [n:127.0.0.1:44537_solr c:falsepredicate s:shard1 r:core_node3 x:falsepredicate_shard1_replica_n1] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 62763 WARN (parallelCoreAdminExecutor-202-thread-1-processing-n:127.0.0.1:44537_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474511440547 CREATE) [n:127.0.0.1:44537_solr c:falsepredicate s:shard1 r:core_node3 x:falsepredicate_shard1_replica_n1] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 62763 INFO (parallelCoreAdminExecutor-202-thread-1-processing-n:127.0.0.1:44537_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474511440547 CREATE) [n:127.0.0.1:44537_solr c:falsepredicate s:shard1 r:core_node3 x:falsepredicate_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 62763 INFO (parallelCoreAdminExecutor-202-thread-1-processing-n:127.0.0.1:44537_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474511440547 CREATE) [n:127.0.0.1:44537_solr c:falsepredicate s:shard1 r:core_node3 x:falsepredicate_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'falsepredicate_shard1_replica_n1' using configuration from collection falsepredicate, trusted=true
[junit4] 2> 62764 INFO (parallelCoreAdminExecutor-202-thread-1-processing-n:127.0.0.1:44537_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474511440547 CREATE) [n:127.0.0.1:44537_solr c:falsepredicate s:shard1 r:core_node3 x:falsepredicate_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44537.solr.core.falsepredicate.shard1.replica_n1' (registry 'solr.core.falsepredicate.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@137c0cf
[junit4] 2> 62769 WARN (parallelCoreAdminExecutor-201-thread-1-processing-n:127.0.0.1:37633_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE) [n:127.0.0.1:37633_solr c:falsepredicate s:shard3 r:core_node7 x:falsepredicate_shard3_replica_n4] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 62769 WARN (parallelCoreAdminExecutor-201-thread-1-processing-n:127.0.0.1:37633_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE) [n:127.0.0.1:37633_solr c:falsepredicate s:shard3 r:core_node7 x:falsepredicate_shard3_replica_n4] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 62769 INFO (parallelCoreAdminExecutor-201-thread-1-processing-n:127.0.0.1:37633_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE) [n:127.0.0.1:37633_solr c:falsepredicate s:shard3 r:core_node7 x:falsepredicate_shard3_replica_n4] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 62769 INFO (parallelCoreAdminExecutor-201-thread-1-processing-n:127.0.0.1:37633_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE) [n:127.0.0.1:37633_solr c:falsepredicate s:shard3 r:core_node7 x:falsepredicate_shard3_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'falsepredicate_shard3_replica_n4' using configuration from collection falsepredicate, trusted=true
[junit4] 2> 62770 INFO (parallelCoreAdminExecutor-201-thread-1-processing-n:127.0.0.1:37633_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE) [n:127.0.0.1:37633_solr c:falsepredicate s:shard3 r:core_node7 x:falsepredicate_shard3_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37633.solr.core.falsepredicate.shard3.replica_n4' (registry 'solr.core.falsepredicate.shard3.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@137c0cf
[junit4] 2> 62770 INFO (parallelCoreAdminExecutor-201-thread-1-processing-n:127.0.0.1:37633_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE) [n:127.0.0.1:37633_solr c:falsepredicate s:shard3 r:core_node7 x:falsepredicate_shard3_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 62770 INFO (parallelCoreAdminExecutor-201-thread-1-processing-n:127.0.0.1:37633_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE) [n:127.0.0.1:37633_solr c:falsepredicate s:shard3 r:core_node7 x:falsepredicate_shard3_replica_n4] o.a.s.c.SolrCore [[falsepredicate_shard3_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-solrj/test/J2/temp/solr.common.cloud.TestCollectionStateWatchers_2DE7E2FE6A76FE91-001/tempDir-001/node2/falsepredicate_shard3_replica_n4], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-solrj/test/J2/temp/solr.common.cloud.TestCollectionStateWatchers_2DE7E2FE6A76FE91-001/tempDir-001/node2/./falsepredicate_shard3_replica_n4/data/]
[junit4] 2> 62773 INFO (parallelCoreAdminExecutor-202-thread-1-processing-n:127.0.0.1:44537_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474511440547 CREATE) [n:127.0.0.1:44537_solr c:falsepredicate s:shard1 r:core_node3 x:falsepredicate_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 62773 INFO (parallelCoreAdminExecutor-202-thread-1-processing-n:127.0.0.1:44537_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474511440547 CREATE) [n:127.0.0.1:44537_solr c:falsepredicate s:shard1 r:core_node3 x:falsepredicate_shard1_replica_n1] o.a.s.c.SolrCore [[falsepredicate_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-solrj/test/J2/temp/solr.common.cloud.TestCollectionStateWatchers_2DE7E2FE6A76FE91-001/tempDir-001/node3/falsepredicate_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-solrj/test/J2/temp/solr.common.cloud.TestCollectionStateWatchers_2DE7E2FE6A76FE91-001/tempDir-001/node3/./falsepredicate_shard1_replica_n1/data/]
[junit4] 2> 62809 WARN (parallelCoreAdminExecutor-200-thread-1-processing-n:127.0.0.1:40857_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474517296581 CREATE) [n:127.0.0.1:40857_solr c:falsepredicate s:shard4 r:core_node8 x:falsepredicate_shard4_replica_n6] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 62809 WARN (parallelCoreAdminExecutor-200-thread-1-processing-n:127.0.0.1:40857_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474517296581 CREATE) [n:127.0.0.1:40857_solr c:falsepredicate s:shard4 r:core_node8 x:falsepredicate_shard4_replica_n6] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 62809 INFO (parallelCoreAdminExecutor-200-thread-1-processing-n:127.0.0.1:40857_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474517296581 CREATE) [n:127.0.0.1:40857_solr c:falsepredicate s:shard4 r:core_node8 x:falsepredicate_shard4_replica_n6] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 62809 INFO (parallelCoreAdminExecutor-200-thread-1-processing-n:127.0.0.1:40857_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474517296581 CREATE) [n:127.0.0.1:40857_solr c:falsepredicate s:shard4 r:core_node8 x:falsepredicate_shard4_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'falsepredicate_shard4_replica_n6' using configuration from collection falsepredicate, trusted=true
[junit4] 2> 62810 INFO (parallelCoreAdminExecutor-200-thread-1-processing-n:127.0.0.1:40857_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474517296581 CREATE) [n:127.0.0.1:40857_solr c:falsepredicate s:shard4 r:core_node8 x:falsepredicate_shard4_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40857.solr.core.falsepredicate.shard4.replica_n6' (registry 'solr.core.falsepredicate.shard4.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@137c0cf
[junit4] 2> 62810 INFO (parallelCoreAdminExecutor-200-thread-1-processing-n:127.0.0.1:40857_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474517296581 CREATE) [n:127.0.0.1:40857_solr c:falsepredicate s:shard4 r:core_node8 x:falsepredicate_shard4_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 62810 INFO (parallelCoreAdminExecutor-200-thread-1-processing-n:127.0.0.1:40857_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474517296581 CREATE) [n:127.0.0.1:40857_solr c:falsepredicate s:shard4 r:core_node8 x:falsepredicate_shard4_replica_n6] o.a.s.c.SolrCore [[falsepredicate_shard4_replica_n6] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-solrj/test/J2/temp/solr.common.cloud.TestCollectionStateWatchers_2DE7E2FE6A76FE91-001/tempDir-001/node1/falsepredicate_shard4_replica_n6], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-solrj/test/J2/temp/solr.common.cloud.TestCollectionStateWatchers_2DE7E2FE6A76FE91-001/tempDir-001/node1/./falsepredicate_shard4_replica_n6/data/]
[junit4] 2> 62849 INFO (parallelCoreAdminExecutor-203-thread-1-processing-n:127.0.0.1:36089_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 62849 INFO (parallelCoreAdminExecutor-203-thread-1-processing-n:127.0.0.1:36089_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 62850 INFO (parallelCoreAdminExecutor-203-thread-1-processing-n:127.0.0.1:36089_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 62850 INFO (parallelCoreAdminExecutor-203-thread-1-processing-n:127.0.0.1:36089_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 62851 INFO (parallelCoreAdminExecutor-203-thread-1-processing-n:127.0.0.1:36089_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@e49542[falsepredicate_shard2_replica_n2] main]
[junit4] 2> 62853 INFO (parallelCoreAdminExecutor-203-thread-1-processing-n:127.0.0.1:36089_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
[junit4] 2> 62853 INFO (parallelCoreAdminExecutor-203-thread-1-processing-n:127.0.0.1:36089_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
[junit4] 2> 62854 INFO (parallelCoreAdminExecutor-203-thread-1-processing-n:127.0.0.1:36089_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 62854 INFO (parallelCoreAdminExecutor-203-thread-1-processing-n:127.0.0.1:36089_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1584847260685959168
[junit4] 2> 62865 INFO (searcherExecutor-208-thread-1-processing-x:falsepredicate_shard2_replica_n2 r:core_node5 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE n:127.0.0.1:36089_solr s:shard2 c:falsepredicate) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.c.SolrCore [falsepredicate_shard2_replica_n2] Registered new searcher Searcher@e49542[falsepredicate_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 62877 INFO (parallelCoreAdminExecutor-201-thread-1-processing-n:127.0.0.1:37633_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE) [n:127.0.0.1:37633_solr c:falsepredicate s:shard3 r:core_node7 x:falsepredicate_shard3_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 62877 INFO (parallelCoreAdminExecutor-201-thread-1-processing-n:127.0.0.1:37633_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE) [n:127.0.0.1:37633_solr c:falsepredicate s:shard3 r:core_node7 x:falsepredicate_shard3_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 62878 INFO (parallelCoreAdminExecutor-201-thread-1-processing-n:127.0.0.1:37633_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE) [n:127.0.0.1:37633_solr c:falsepredicate s:shard3 r:core_node7 x:falsepredicate_shard3_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 62878 INFO (parallelCoreAdminExecutor-201-thread-1-processing-n:127.0.0.1:37633_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE) [n:127.0.0.1:37633_solr c:falsepredicate s:shard3 r:core_node7 x:falsepredicate_shard3_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 62878 INFO (parallelCoreAdminExecutor-203-thread-1-processing-n:127.0.0.1:36089_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 62878 INFO (parallelCoreAdminExecutor-203-thread-1-processing-n:127.0.0.1:36089_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 62878 INFO (parallelCoreAdminExecutor-203-thread-1-processing-n:127.0.0.1:36089_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:36089/solr/falsepredicate_shard2_replica_n2/
[junit4] 2> 62879 INFO (parallelCoreAdminExecutor-203-thread-1-processing-n:127.0.0.1:36089_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 62879 INFO (parallelCoreAdminExecutor-203-thread-1-processing-n:127.0.0.1:36089_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.c.SyncStrategy http://127.0.0.1:36089/solr/falsepredicate_shard2_replica_n2/ has no replicas
[junit4] 2> 62879 INFO (parallelCoreAdminExecutor-203-thread-1-processing-n:127.0.0.1:36089_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 62879 INFO (parallelCoreAdminExecutor-201-thread-1-processing-n:127.0.0.1:37633_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE) [n:127.0.0.1:37633_solr c:falsepredicate s:shard3 r:core_node7 x:falsepredicate_shard3_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@97f0c6[falsepredicate_shard3_replica_n4] main]
[junit4] 2> 62881 INFO (parallelCoreAdminExecutor-203-thread-1-processing-n:127.0.0.1:36089_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474513423009 CREATE) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:36089/solr/falsepredicate_shard2_replica_n2/ shard2
[junit4] 2> 62883 INFO (parallelCoreAdminExecutor-201-thread-1-processing-n:127.0.0.1:37633_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE) [n:127.0.0.1:37633_solr c:falsepredicate s:shard3 r:core_node7 x:falsepredicate_shard3_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
[junit4] 2> 62884 INFO (parallelCoreAdminExecutor-201-thread-1-processing-n:127.0.0.1:37633_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE) [n:127.0.0.1:37633_solr c:falsepredicate s:shard3 r:core_node7 x:falsepredicate_shard3_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
[junit4] 2> 62884 INFO (parallelCoreAdminExecutor-201-thread-1-processing-n:127.0.0.1:37633_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE) [n:127.0.0.1:37633_solr c:falsepredicate s:shard3 r:core_node7 x:falsepredicate_shard3_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 62884 INFO (parallelCoreAdminExecutor-201-thread-1-processing-n:127.0.0.1:37633_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE) [n:127.0.0.1:37633_solr c:falsepredicate s:shard3 r:core_node7 x:falsepredicate_shard3_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1584847260717416448
[junit4] 2> 62891 INFO (searcherExecutor-210-thread-1-processing-x:falsepredicate_shard3_replica_n4 r:core_node7 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE n:127.0.0.1:37633_solr s:shard3 c:falsepredicate) [n:127.0.0.1:37633_solr c:falsepredicate s:shard3 r:core_node7 x:falsepredicate_shard3_replica_n4] o.a.s.c.SolrCore [falsepredicate_shard3_replica_n4] Registered new searcher Searcher@97f0c6[falsepredicate_shard3_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 62891 INFO (parallelCoreAdminExecutor-201-thread-1-processing-n:127.0.0.1:37633_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE) [n:127.0.0.1:37633_solr c:falsepredicate s:shard3 r:core_node7 x:falsepredicate_shard3_replica_n4] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 62891 INFO (parallelCoreAdminExecutor-201-thread-1-processing-n:127.0.0.1:37633_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE) [n:127.0.0.1:37633_solr c:falsepredicate s:shard3 r:core_node7 x:falsepredicate_shard3_replica_n4] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 62891 INFO (parallelCoreAdminExecutor-201-thread-1-processing-n:127.0.0.1:37633_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE) [n:127.0.0.1:37633_solr c:falsepredicate s:shard3 r:core_node7 x:falsepredicate_shard3_replica_n4] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:37633/solr/falsepredicate_shard3_replica_n4/
[junit4] 2> 62891 INFO (parallelCoreAdminExecutor-201-thread-1-processing-n:127.0.0.1:37633_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE) [n:127.0.0.1:37633_solr c:falsepredicate s:shard3 r:core_node7 x:falsepredicate_shard3_replica_n4] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 62891 INFO (parallelCoreAdminExecutor-201-thread-1-processing-n:127.0.0.1:37633_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE) [n:127.0.0.1:37633_solr c:falsepredicate s:shard3 r:core_node7 x:falsepredicate_shard3_replica_n4] o.a.s.c.SyncStrategy http://127.0.0.1:37633/solr/falsepredicate_shard3_replica_n4/ has no replicas
[junit4] 2> 62891 INFO (parallelCoreAdminExecutor-201-thread-1-processing-n:127.0.0.1:37633_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE) [n:127.0.0.1:37633_solr c:falsepredicate s:shard3 r:core_node7 x:falsepredicate_shard3_replica_n4] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 62894 INFO (parallelCoreAdminExecutor-200-thread-1-processing-n:127.0.0.1:40857_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474517296581 CREATE) [n:127.0.0.1:40857_solr c:falsepredicate s:shard4 r:core_node8 x:falsepredicate_shard4_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 62894 INFO (parallelCoreAdminExecutor-200-thread-1-processing-n:127.0.0.1:40857_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474517296581 CREATE) [n:127.0.0.1:40857_solr c:falsepredicate s:shard4 r:core_node8 x:falsepredicate_shard4_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 62895 INFO (parallelCoreAdminExecutor-200-thread-1-processing-n:127.0.0.1:40857_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474517296581 CREATE) [n:127.0.0.1:40857_solr c:falsepredicate s:shard4 r:core_node8 x:falsepredicate_shard4_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 62895 INFO (parallelCoreAdminExecutor-200-thread-1-processing-n:127.0.0.1:40857_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474517296581 CREATE) [n:127.0.0.1:40857_solr c:falsepredicate s:shard4 r:core_node8 x:falsepredicate_shard4_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 62895 INFO (parallelCoreAdminExecutor-201-thread-1-processing-n:127.0.0.1:37633_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474515334171 CREATE) [n:127.0.0.1:37633_solr c:falsepredicate s:shard3 r:core_node7 x:falsepredicate_shard3_replica_n4] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:37633/solr/falsepredicate_shard3_replica_n4/ shard3
[junit4] 2> 62896 INFO (parallelCoreAdminExecutor-200-thread-1-processing-n:127.0.0.1:40857_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474517296581 CREATE) [n:127.0.0.1:40857_solr c:falsepredicate s:shard4 r:core_node8 x:falsepredicate_shard4_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@c58020[falsepredicate_shard4_replica_n6] main]
[junit4] 2> 62897 INFO (parallelCoreAdminExecutor-200-thread-1-processing-n:127.0.0.1:40857_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474517296581 CREATE) [n:127.0.0.1:40857_solr c:falsepredicate s:shard4 r:core_node8 x:falsepredicate_shard4_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
[junit4] 2> 62897 INFO (parallelCoreAdminExecutor-200-thread-1-processing-n:127.0.0.1:40857_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474517296581 CREATE) [n:127.0.0.1:40857_solr c:falsepredicate s:shard4 r:core_node8 x:falsepredicate_shard4_replica_n6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
[junit4] 2> 62898 INFO (parallelCoreAdminExecutor-200-thread-1-processing-n:127.0.0.1:40857_solr 8720cfd9-9855-433a-bfff-5126c24bc1242153474517296581 CREATE) [n:127.0.0.1:40857_solr c:falsepredicate
[...truncated too long message...]
registry=solr.jetty, tag=null
[junit4] 2> 610253 INFO (jetty-closer-56-thread-4) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@12ffe24: rootName = solr_37147, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6d31c2
[junit4] 2> 610254 INFO (zkCallback-75-thread-5-processing-n:127.0.0.1:36089_solr) [n:127.0.0.1:36089_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 610254 INFO (jetty-closer-56-thread-2) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:36089_solr
[junit4] 2> 610254 INFO (zkCallback-93-thread-5-processing-n:127.0.0.1:36461_solr) [n:127.0.0.1:36461_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 610255 INFO (jetty-closer-56-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 610256 INFO (jetty-closer-56-thread-3) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:36461_solr
[junit4] 2> 610256 INFO (zkCallback-76-thread-4-processing-n:127.0.0.1:37633_solr) [n:127.0.0.1:37633_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 610256 INFO (zkCallback-99-thread-5-processing-n:127.0.0.1:37147_solr) [n:127.0.0.1:37147_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 610256 INFO (zkCallback-93-thread-6-processing-n:127.0.0.1:36461_solr) [n:127.0.0.1:36461_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 610256 INFO (jetty-closer-56-thread-4) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:37147_solr
[junit4] 2> 610257 INFO (jetty-closer-56-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 610257 INFO (zkCallback-76-thread-4-processing-n:127.0.0.1:37633_solr) [n:127.0.0.1:37633_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 610257 INFO (jetty-closer-56-thread-4) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 610257 INFO (zkCallback-75-thread-5-processing-n:127.0.0.1:36089_solr) [n:127.0.0.1:36089_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (0)
[junit4] 2> 610257 INFO (zkCallback-76-thread-5-processing-n:127.0.0.1:37633_solr) [n:127.0.0.1:37633_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 610258 INFO (coreCloseExecutor-250-thread-1) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.c.SolrCore [falsepredicate_shard2_replica_n2] CLOSING SolrCore org.apache.solr.core.SolrCore@15e59b9
[junit4] 2> 610258 INFO (coreCloseExecutor-252-thread-1) [n:127.0.0.1:36461_solr c:falsepredicate s:shard4 r:core_node8 x:falsepredicate_shard4_replica_n6] o.a.s.c.SolrCore [falsepredicate_shard4_replica_n6] CLOSING SolrCore org.apache.solr.core.SolrCore@13f28ff
[junit4] 2> 610258 INFO (coreCloseExecutor-252-thread-1) [n:127.0.0.1:36461_solr c:falsepredicate s:shard4 r:core_node8 x:falsepredicate_shard4_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.falsepredicate.shard4.replica_n6, tag=20916479
[junit4] 2> 610258 INFO (coreCloseExecutor-252-thread-1) [n:127.0.0.1:36461_solr c:falsepredicate s:shard4 r:core_node8 x:falsepredicate_shard4_replica_n6] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6cd839: rootName = solr_36461, domain = solr.core.falsepredicate.shard4.replica_n6, service url = null, agent id = null] for registry solr.core.falsepredicate.shard4.replica_n6 / com.codahale.metrics.MetricRegistry@4a0460
[junit4] 2> 610258 INFO (coreCloseExecutor-250-thread-1) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.falsepredicate.shard2.replica_n2, tag=22960569
[junit4] 2> 610259 INFO (coreCloseExecutor-250-thread-1) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1172cf7: rootName = solr_36089, domain = solr.core.falsepredicate.shard2.replica_n2, service url = null, agent id = null] for registry solr.core.falsepredicate.shard2.replica_n2 / com.codahale.metrics.MetricRegistry@1b47d47
[junit4] 2> 610259 INFO (zkCallback-93-thread-7-processing-n:127.0.0.1:36461_solr) [n:127.0.0.1:36461_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
[junit4] 2> 610262 INFO (coreCloseExecutor-249-thread-1) [n:127.0.0.1:37633_solr c:falsepredicate s:shard3 r:core_node7 x:falsepredicate_shard3_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.falsepredicate.shard3.leader, tag=29881443
[junit4] 2> 610264 INFO (jetty-closer-56-thread-1) [ ] o.a.s.c.Overseer Overseer (id=99052953609306123-127.0.0.1:37633_solr-n_0000000000) closing
[junit4] 2> 610264 INFO (OverseerStateUpdate-99052953609306123-127.0.0.1:37633_solr-n_0000000000) [n:127.0.0.1:37633_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:37633_solr
[junit4] 2> 610264 WARN (OverseerAutoScalingTriggerThread-99052953609306123-127.0.0.1:37633_solr-n_0000000000) [n:127.0.0.1:37633_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 610270 INFO (zkCallback-75-thread-5-processing-n:127.0.0.1:36089_solr) [n:127.0.0.1:36089_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36089_solr
[junit4] 2> 610270 INFO (jetty-closer-56-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@899e6a{/solr,null,UNAVAILABLE}
[junit4] 2> 610274 INFO (coreCloseExecutor-250-thread-1) [n:127.0.0.1:36089_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.falsepredicate.shard2.leader, tag=22960569
[junit4] 2> 610276 INFO (coreCloseExecutor-252-thread-1) [n:127.0.0.1:36461_solr c:falsepredicate s:shard4 r:core_node8 x:falsepredicate_shard4_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.falsepredicate.shard4.leader, tag=20916479
[junit4] 2> 610279 INFO (jetty-closer-56-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4c4d84{/solr,null,UNAVAILABLE}
[junit4] 2> 611759 WARN (zkCallback-99-thread-4-processing-n:127.0.0.1:37147_solr) [n:127.0.0.1:37147_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 611759 INFO (jetty-closer-56-thread-4) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@19731d6{/solr,null,UNAVAILABLE}
[junit4] 2> 611779 INFO (jetty-closer-56-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@127c512{/solr,null,UNAVAILABLE}
[junit4] 2> 611780 ERROR (SUITE-TestCollectionStateWatchers-seed#[2DE7E2FE6A76FE91]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 611780 INFO (SUITE-TestCollectionStateWatchers-seed#[2DE7E2FE6A76FE91]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46025 46025
[junit4] 2> 617643 INFO (Thread-62) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46025 46025
[junit4] 2> 617645 WARN (Thread-62) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/clusterprops.json
[junit4] 2> 7 /solr/aliases.json
[junit4] 2> 6 /solr/security.json
[junit4] 2> 5 /solr/configs/config
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 41 /solr/collections/falsepredicate/state.json
[junit4] 2> 7 /solr/clusterstate.json
[junit4] 2> 2 /solr/overseer_elect/election/99052953609306122-127.0.0.1:36089_solr-n_0000000001
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/live_nodes
[junit4] 2> 7 /solr/collections
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-solrj/test/J2/temp/solr.common.cloud.TestCollectionStateWatchers_2DE7E2FE6A76FE91-001
[junit4] 2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=5, maxDocsPerChunk=601, blockSize=4), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=5, blockSize=4)), sim=RandomSimilarity(queryNorm=false): {}, locale=uk-UA, timezone=Etc/GMT-13
[junit4] 2> NOTE: Linux 4.10.0-37-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=167162568,total=296747008
[junit4] 2> NOTE: All tests run in this JVM: [SolrExampleXMLTest, HttpSolrClientBuilderTest, JettyWebappTest, ModifiableSolrParamsTest, TestValidatingJsonMap, CloudSolrClientTest, MultiplyEvaluatorTest, TestCollectionStateWatchers]
[junit4] Completed [129/146 (1!)] on J2 in 557.61s, 9 tests, 3 failures, 3 errors <<< FAILURES!
[...truncated 42290 lines...]
[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_144) - Build # 883
- Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/883/
Java: 32bit/jdk1.8.0_144 -server -XX:+UseConcMarkSweepGC
7 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.core.TestLazyCores
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores: 1) Thread[id=10765, name=searcherExecutor-4265-thread-1, state=WAITING, group=TGRP-TestLazyCores] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores:
1) Thread[id=10765, name=searcherExecutor-4265-thread-1, state=WAITING, group=TGRP-TestLazyCores]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([55198E11118B6EDA]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.core.TestLazyCores
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=10765, name=searcherExecutor-4265-thread-1, state=WAITING, group=TGRP-TestLazyCores] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=10765, name=searcherExecutor-4265-thread-1, state=WAITING, group=TGRP-TestLazyCores]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([55198E11118B6EDA]:0)
FAILED: org.apache.solr.cloud.CleanupOldIndexTest.test
Error Message:
Stack Trace:
java.util.concurrent.TimeoutException
at __randomizedtesting.SeedInfo.seed([55198E11118B6EDA:DD4DB1CBBF770322]:0)
at org.apache.solr.common.cloud.ZkStateReader.waitForState(ZkStateReader.java:1275)
at org.apache.solr.client.solrj.impl.CloudSolrClient.waitForState(CloudSolrClient.java:448)
at org.apache.solr.cloud.CleanupOldIndexTest.test(CleanupOldIndexTest.java:114)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.CollectionsAPISolrJTest.testCreateAndDeleteCollection
Error Message:
Error from server at https://127.0.0.1:33051/solr: Could not fully remove collection: solrj_test
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:33051/solr: Could not fully remove collection: solrj_test
at __randomizedtesting.SeedInfo.seed([55198E11118B6EDA:52CC8F5A361F0BD7]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1103)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:883)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:816)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.cloud.CollectionsAPISolrJTest.testCreateAndDeleteCollection(CollectionsAPISolrJTest.java:107)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.CollectionsAPISolrJTest.testCreateCollectionWithPropertyParam
Error Message:
Error from server at https://127.0.0.1:33051/solr: Could not fully create collection: solrj_test_core_props
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:33051/solr: Could not fully create collection: solrj_test_core_props
at __randomizedtesting.SeedInfo.seed([55198E11118B6EDA:5382FCE09555AE83]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1103)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:883)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:816)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.cloud.CollectionsAPISolrJTest.testCreateCollectionWithPropertyParam(CollectionsAPISolrJTest.java:264)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.LeaderInitiatedRecoveryOnCommitTest.test
Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:37935/t_v
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:37935/t_v
at __randomizedtesting.SeedInfo.seed([55198E11118B6EDA:DD4DB1CBBF770322]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:654)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1103)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:883)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:816)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:314)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:991)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
... 43 more
FAILED: org.apache.solr.core.TestLazyCores.testNoCommit
Error Message:
Exception during query
Stack Trace:
java.lang.RuntimeException: Exception during query
at __randomizedtesting.SeedInfo.seed([55198E11118B6EDA:8A792FC0DAAC0D7F]:0)
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:901)
at org.apache.solr.core.TestLazyCores.check10(TestLazyCores.java:847)
at org.apache.solr.core.TestLazyCores.testNoCommit(TestLazyCores.java:829)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound='10']
xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int><lst name="params"><str name="q">*:*</str></lst></lst><result name="response" numFound="0" start="0"></result>
</response>
request was:q=*:*
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:894)
... 41 more
Build Log:
[...truncated 11827 lines...]
[junit4] Suite: org.apache.solr.cloud.LeaderInitiatedRecoveryOnCommitTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnCommitTest_55198E11118B6EDA-001/init-core-data-001
[junit4] 2> 49735 WARN (SUITE-LeaderInitiatedRecoveryOnCommitTest-seed#[55198E11118B6EDA]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=7 numCloses=7
[junit4] 2> 49735 INFO (SUITE-LeaderInitiatedRecoveryOnCommitTest-seed#[55198E11118B6EDA]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 49736 INFO (SUITE-LeaderInitiatedRecoveryOnCommitTest-seed#[55198E11118B6EDA]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 49736 INFO (SUITE-LeaderInitiatedRecoveryOnCommitTest-seed#[55198E11118B6EDA]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 49737 INFO (SUITE-LeaderInitiatedRecoveryOnCommitTest-seed#[55198E11118B6EDA]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /t_v/
[junit4] 2> 49740 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 49740 INFO (Thread-35) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 49740 INFO (Thread-35) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 49743 ERROR (Thread-35) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 49840 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.ZkTestServer start zk server on port:34951
[junit4] 2> 49850 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 49851 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 49852 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 49853 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 49853 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 49854 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 49854 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 49855 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 49855 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 49856 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 49856 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 49857 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
[junit4] 2> 49929 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 49930 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@af4f13{/t_v,null,AVAILABLE}
[junit4] 2> 49931 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1c58556{HTTP/1.1,[http/1.1]}{127.0.0.1:40187}
[junit4] 2> 49931 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.e.j.s.Server Started @51643ms
[junit4] 2> 49931 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnCommitTest_55198E11118B6EDA-001/tempDir-001/control/data, hostContext=/t_v, hostPort=37935, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnCommitTest_55198E11118B6EDA-001/control-001/cores}
[junit4] 2> 49931 ERROR (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 49932 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.2.0
[junit4] 2> 49932 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 49932 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 49932 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-23T04:30:28.496Z
[junit4] 2> 49935 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 49935 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnCommitTest_55198E11118B6EDA-001/control-001/solr.xml
[junit4] 2> 49937 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 49937 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 49938 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1f52303, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 49944 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34951/solr
[junit4] 2> 49992 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [n:127.0.0.1:37935_t_v ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 49993 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [n:127.0.0.1:37935_t_v ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37935_t_v
[junit4] 2> 49993 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [n:127.0.0.1:37935_t_v ] o.a.s.c.Overseer Overseer (id=99051859365396484-127.0.0.1:37935_t_v-n_0000000000) starting
[junit4] 2> 49997 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [n:127.0.0.1:37935_t_v ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37935_t_v
[junit4] 2> 49998 INFO (zkCallback-40-thread-1-processing-n:127.0.0.1:37935_t_v) [n:127.0.0.1:37935_t_v ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 50060 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [n:127.0.0.1:37935_t_v ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f52303
[junit4] 2> 50073 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [n:127.0.0.1:37935_t_v ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f52303
[junit4] 2> 50073 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [n:127.0.0.1:37935_t_v ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f52303
[junit4] 2> 50075 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [n:127.0.0.1:37935_t_v ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnCommitTest_55198E11118B6EDA-001/control-001/cores
[junit4] 2> 50097 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 50098 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34951/solr ready
[junit4] 2> 50099 INFO (SocketProxy-Acceptor-37935) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=54404,localport=37935], receiveBufferSize:531000
[junit4] 2> 50106 INFO (SocketProxy-Acceptor-37935) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=40187,localport=49104], receiveBufferSize=530904
[junit4] 2> 50107 INFO (qtp32384763-318) [n:127.0.0.1:37935_t_v ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:37935_t_v&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 50113 INFO (OverseerThreadFactory-306-thread-1-processing-n:127.0.0.1:37935_t_v) [n:127.0.0.1:37935_t_v ] o.a.s.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 50224 INFO (SocketProxy-Acceptor-37935) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=54414,localport=37935], receiveBufferSize:531000
[junit4] 2> 50234 INFO (SocketProxy-Acceptor-37935) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=40187,localport=49114], receiveBufferSize=530904
[junit4] 2> 50235 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 50236 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 50344 INFO (zkCallback-40-thread-1-processing-n:127.0.0.1:37935_t_v) [n:127.0.0.1:37935_t_v ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 51256 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 51273 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 51277 WARN (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrResourceLoader Solr loaded a deprecated plugin/analysis class [solr.TrieIntField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 51279 WARN (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrResourceLoader Solr loaded a deprecated plugin/analysis class [solr.TrieFloatField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 51281 WARN (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrResourceLoader Solr loaded a deprecated plugin/analysis class [solr.TrieLongField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 51283 WARN (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrResourceLoader Solr loaded a deprecated plugin/analysis class [solr.TrieDoubleField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 51299 WARN (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrResourceLoader Solr loaded a deprecated plugin/analysis class [solr.TrieDateField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 51376 WARN (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrResourceLoader Solr loaded a deprecated plugin/analysis class [solr.EnumField]. Please consult documentation how to replace it accordingly.
[junit4] 2> 51386 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 51405 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 51405 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f52303
[junit4] 2> 51405 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 51405 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnCommitTest_55198E11118B6EDA-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnCommitTest_55198E11118B6EDA-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 51408 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=18, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.573023664818114]
[junit4] 2> 51415 WARN (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 51456 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 51456 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 51457 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 51457 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 51458 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=61.099609375, floorSegmentMB=0.6669921875, forceMergeDeletesPctAllowed=1.5289498304499338, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 51458 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1e8ec16[control_collection_shard1_replica_n1] main]
[junit4] 2> 51472 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 51472 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 51474 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 51475 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1584829751664574464
[junit4] 2> 51476 INFO (searcherExecutor-309-thread-1-processing-n:127.0.0.1:37935_t_v x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@1e8ec16[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 51486 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 51486 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 51486 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:37935/t_v/control_collection_shard1_replica_n1/
[junit4] 2> 51486 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 51486 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:37935/t_v/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 51486 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 51499 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:37935/t_v/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 110159 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15fe7242bd10005, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 110161 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.ChaosMonkey monkey: stop jetty! 37935
[junit4] 2> 110161 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=7956672
[junit4] 2> 110161 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 110161 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@18edec0: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1cd5331
[junit4] 2> 110166 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 110166 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@e2f00d: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@2e055c
[junit4] 2> 110169 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 110169 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@118aa55: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@125ddda
[junit4] 2> 110170 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:37935_t_v
[junit4] 2> 110170 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 110171 INFO (zkCallback-40-thread-2-processing-n:127.0.0.1:37935_t_v) [n:127.0.0.1:37935_t_v ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 110171 INFO (coreCloseExecutor-314-thread-1) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@8d4074
[junit4] 2> 110171 INFO (coreCloseExecutor-314-thread-1) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.control_collection.shard1.replica_n1, tag=9257076
[junit4] 2> 110171 INFO (coreCloseExecutor-314-thread-1) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2bbda9: rootName = null, domain = solr.core.control_collection.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.control_collection.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@1101d4f
[junit4] 2> 110179 INFO (coreCloseExecutor-314-thread-1) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.control_collection.shard1.leader, tag=9257076
[junit4] 2> 121018 INFO (ScheduledTrigger-304-thread-1) [n:127.0.0.1:37935_t_v ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
[junit4] 2> 121029 INFO (AutoscalingActionExecutor-305-thread-1-processing-n:127.0.0.1:37935_t_v) [n:127.0.0.1:37935_t_v ] o.a.s.c.a.ExecutePlanAction No operations to execute for event: {
[junit4] 2> "id":"14f99cbdf1ae5c40T49up9nz7k4gkkfkrcxihammdh",
[junit4] 2> "source":".auto_add_replicas",
[junit4] 2> "eventTime":1511411489577000000,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1511411489577000000],
[junit4] 2> "_enqueue_time_":1511411499580000000,
[junit4] 2> "nodeNames":["127.0.0.1:37935_t_v"]}}
[junit4] 2> 150289 WARN (SocketProxy-Response-40187:54414) [ ] o.a.s.c.SocketProxy java.net.SocketTimeoutException: Read timed out when reading from Socket[addr=/127.0.0.1,port=40187,localport=49114]
[junit4] 2> 150292 ERROR (OverseerThreadFactory-306-thread-1-processing-n:127.0.0.1:37935_t_v) [n:127.0.0.1:37935_t_v ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: http://127.0.0.1:37935/t_v
[junit4] 2> org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:37935/t_v
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:657)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
[junit4] 2> at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
[junit4] 2> at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:37935 failed to respond
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
[junit4] 2> at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
[junit4] 2> at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
[junit4] 2> at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
[junit4] 2> at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
[junit4] 2> at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
[junit4] 2> at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
[junit4] 2> at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
[junit4] 2> at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
[junit4] 2> at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
[junit4] 2> at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
[junit4] 2> at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
[junit4] 2> ... 12 more
[junit4] 2> 150293 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.Overseer Overseer (id=99051859365396484-127.0.0.1:37935_t_v-n_0000000000) closing
[junit4] 2> 150294 ERROR (OverseerThreadFactory-306-thread-1-processing-n:127.0.0.1:37935_t_v) [n:127.0.0.1:37935_t_v ] o.a.s.c.OverseerCollectionMessageHandler Cleaning up collection [control_collection].
[junit4] 2> 150294 INFO (OverseerStateUpdate-99051859365396484-127.0.0.1:37935_t_v-n_0000000000) [n:127.0.0.1:37935_t_v ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:37935_t_v
[junit4] 2> 150299 INFO (OverseerThreadFactory-306-thread-1-processing-n:127.0.0.1:37935_t_v) [n:127.0.0.1:37935_t_v ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
[junit4] 2> 180335 INFO (zkCallback-40-thread-2-processing-n:127.0.0.1:37935_t_v) [n:127.0.0.1:37935_t_v ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDeleted path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [0])
[junit4] 2> 180336 ERROR (OverseerThreadFactory-306-thread-1-processing-n:127.0.0.1:37935_t_v) [n:127.0.0.1:37935_t_v ] o.a.s.c.OverseerCollectionMessageHandler Collection: control_collection operation: create failed:org.apache.solr.common.SolrException: Could not fully remove collection: control_collection
[junit4] 2> at org.apache.solr.cloud.DeleteCollectionCmd.call(DeleteCollectionCmd.java:109)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionMessageHandler.cleanupCollection(OverseerCollectionMessageHandler.java:678)
[junit4] 2> at org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:302)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:232)
[junit4] 2> at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:464)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 180342 WARN (OverseerAutoScalingTriggerThread-99051859365396484-127.0.0.1:37935_t_v-n_0000000000) [n:127.0.0.1:37935_t_v ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 180344 INFO (qtp32384763-318) [n:127.0.0.1:37935_t_v ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:37935_t_v&wt=javabin&version=2} status=500 QTime=130236
[junit4] 2> 180344 ERROR (qtp32384763-318) [n:127.0.0.1:37935_t_v ] o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: Could not fully remove collection: control_collection
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:307)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:244)
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:222)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 180347 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@1c58556{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 180347 ERROR (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController Error getting leader from zk
[junit4] 2> org.apache.solr.common.SolrException: No registered leader was found after waiting for 1220000ms , collection: control_collection slice: shard1 saw state=null with live_nodes=[]
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:771)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:736)
[junit4] 2> at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1178)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:1079)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:1014)
[junit4] 2> at org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:181)
[junit4] 2> at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:208)
[junit4] 2> at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:886)
[junit4] 2> at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1047)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:948)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
[junit4] 2> at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 180347 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@af4f13{/t_v,null,UNAVAILABLE}
[junit4] 2> 180348 ERROR (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkContainer :org.apache.solr.common.SolrException: Error getting leader from zk for shard shard1
[junit4] 2> at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1207)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:1079)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:1014)
[junit4] 2> at org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:181)
[junit4] 2> at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:208)
[junit4] 2> at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:886)
[junit4] 2> at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1047)
[junit4] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:948)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
[junit4] 2> at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> Caused by: org.apache.solr.common.SolrException: No registered leader was found after waiting for 1220000ms , collection: control_collection slice: shard1 saw state=null with live_nodes=[]
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:771)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:736)
[junit4] 2> at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1178)
[junit4] 2> ... 42 more
[junit4] 2>
[junit4] 2> 181077 INFO (qtp32384763-314) [n:127.0.0.1:37935_t_v c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=130842
[junit4] 2> 181081 ERROR (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 181082 INFO (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34951 34951
[junit4] 2> 182660 INFO (Thread-35) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34951 34951
[junit4] 2> 182660 WARN (Thread-35) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 2 /solr/aliases.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 2 /solr/clusterstate.json
[junit4] 2> 2 /solr/clusterprops.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 2 /solr/live_nodes
[junit4] 2> 2 /solr/collections
[junit4] 2>
[junit4] 2> 182660 WARN (TEST-LeaderInitiatedRecoveryOnCommitTest.test-seed#[55198E11118B6EDA]) [ ] o.a.s.c.SocketProxy Closing 2 connections to: http://127.0.0.1:37935/t_v, target: http://127.0.0.1:40187/t_v
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=LeaderInitiatedRecoveryOnCommitTest -Dtests.method=test -Dtests.seed=55198E11118B6EDA -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es-MX -Dtests.timezone=America/Santiago -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 133s J2 | LeaderInitiatedRecoveryOnCommitTest.test <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:37935/t_v
[junit4] > at __randomizedtesting.SeedInfo.seed([55198E11118B6EDA:DD4DB1CBBF770322]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:654)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1103)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:883)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:816)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:314)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:991)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > Caused by: java.net.SocketTimeoutException: Read timed out
[junit4] > at java.net.SocketInputStream.socketRead0(Native Method)
[junit4] > at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
[junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:171)
[junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:141)
[junit4] > at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
[junit4] > at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
[junit4] > at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
[junit4] > at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
[junit4] > at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
[junit4] > at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
[junit4] > at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
[junit4] > at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
[junit4] > at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
[junit4] > at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
[junit4] > at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
[junit4] > ... 43 more
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderInitiatedRecoveryOnCommitTest_55198E11118B6EDA-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1514, maxMBSortInHeap=7.026640947035723, sim=RandomSimilarity(queryNorm=true): {}, locale=es-MX, timezone=America/Santiago
[junit4] 2> NOTE: Linux 4.10.0-37-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=25500648,total=77664256
[junit4] 2> NOTE: All tests run in this JVM: [TestClassicSimilarityFactory, JSONWriterTest, HLLSerializationTest, SearchHandlerTest, DocValuesNotIndexedTest, TestSolrCoreParser, TestReload, SuggesterTest, LeaderInitiatedRecoveryOnCommitTest]
[junit4] Completed [83/749 (1!)] on J2 in 132.94s, 1 test, 1 error <<< FAILURES!
[...truncated 715 lines...]
[junit4] Suite: org.apache.solr.core.TestLazyCores
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_55198E11118B6EDA-001/init-core-data-001
[junit4] 2> 1156858 WARN (SUITE-TestLazyCores-seed#[55198E11118B6EDA]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=9 numCloses=9
[junit4] 2> 1156859 INFO (SUITE-TestLazyCores-seed#[55198E11118B6EDA]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 1156859 INFO (SUITE-TestLazyCores-seed#[55198E11118B6EDA]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 1156860 INFO (SUITE-TestLazyCores-seed#[55198E11118B6EDA]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1156861 INFO (TEST-TestLazyCores.testLazyLoad-seed#[55198E11118B6EDA]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testLazyLoad
[junit4] 2> 1156868 INFO (TEST-TestLazyCores.testLazyLoad-seed#[55198E11118B6EDA]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestLazyCores_55198E11118B6EDA-001/tempDir-001/solr.xml
[junit4] 2> 1156874 INFO (TEST-TestLazyCores.testLazyLoad-seed#[55198E11118B6EDA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1156874 INFO (TEST-TestLazyCores.testLazyLoad-seed#[55198E11118B6EDA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1156874 INFO (TEST-TestLazyCores.testLazyLoad-seed#[55198E11118B6EDA]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@adcdb4, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1156897 INFO (TEST-TestLazyCores.testLazyLoad-seed#[55198E11118B6EDA]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@adcdb4
[junit4] 2> 1156903 INFO (TEST-TestLazyCores.testLazyLoad-seed#[55198E11118B6EDA]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@adcdb4
[junit4] 2> 1156903 INFO (TEST-TestLazyCores.testLazyLoad-seed#[55198E11118B6EDA]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@adcdb4
[junit4] 2> 1156905 INFO (TEST-TestLazyCores.testLazyLoad-seed#[55198E11118B6EDA]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1156912 INFO (coreLoadExecutor-4180-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 1156912 INFO (coreLoadExecutor-4180-thread-3) [ x:collection5] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 1156913 INFO (coreLoadExecutor-4180-thread-2) [ x:collection2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 1156916 INFO (coreLoadExecutor-4180-thread-3) [ x:collection5] o.a.s.s.IndexSchema [collection5] Schema name=tiny
[junit4] 2> 1156916 INFO (coreLoadExecutor-4180-thread-1) [
[...truncated too long message...]
127.0.0.1:33363_solr c:solrj_implicit s:shardB r:core_node9 x:solrj_implicit_shardB_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.solrj_implicit.shardB.leader, tag=31332787
[junit4] 2> 2721358 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15fe74b54d5000c, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 2721359 INFO (jetty-closer-2699-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@13a4855{/solr,null,UNAVAILABLE}
[junit4] 2> 2721902 ERROR (qtp19402542-10272) [n:127.0.0.1:33051_solr ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Solr is shutting down
[junit4] 2> at org.apache.solr.handler.admin.PrepRecoveryOp.execute(PrepRecoveryOp.java:171)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 2721902 INFO (qtp19402542-10272) [n:127.0.0.1:33051_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:33051_solr&onlyIfLeaderActive=true&core=solrj_replicatests_shard1_replica_n2&coreNodeName=core_node6&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=400 QTime=71009
[junit4] 2> 2721905 ERROR (SUITE-CollectionsAPISolrJTest-seed#[55198E11118B6EDA]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2721905 INFO (SUITE-CollectionsAPISolrJTest-seed#[55198E11118B6EDA]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41035 41035
[junit4] 2> 2723543 INFO (Thread-1574) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41035 41035
[junit4] 2> 2723543 WARN (Thread-1574) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 8 /solr/collections/solrj_test/state.json
[junit4] 2> 8 /solr/collections/corestatus_test/state.json
[junit4] 2> 5 /solr/aliases.json
[junit4] 2> 4 /solr/configs/solrj_default_configset
[junit4] 2> 4 /solr/configs/solrj_default_configset/managed-schema
[junit4] 2> 4 /solr/security.json
[junit4] 2> 4 /solr/configs/conf
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 74 /solr/collections/solrj_implicit/state.json
[junit4] 2> 49 /solr/collections/solrj_test_splitshard/state.json
[junit4] 2> 43 /solr/collections/replicaProperties/state.json
[junit4] 2> 37 /solr/collections/balancedProperties/state.json
[junit4] 2> 24 /solr/collections/solrj_default_configset/state.json
[junit4] 2> 21 /solr/collections/solrj_replicatests/state.json
[junit4] 2> 5 /solr/collections/aliasedCollection/state.json
[junit4] 2> 5 /solr/clusterprops.json
[junit4] 2> 5 /solr/clusterstate.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/live_nodes
[junit4] 2> 5 /solr/collections
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPISolrJTest_55198E11118B6EDA-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1595, maxMBSortInHeap=5.27552354264142, sim=RandomSimilarity(queryNorm=false): {}, locale=no, timezone=Asia/Jakarta
[junit4] 2> NOTE: Linux 4.10.0-37-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=76830376,total=238428160
[junit4] 2> NOTE: All tests run in this JVM: [HdfsSyncSliceTest, HLLUtilTest, ExternalFileFieldSortTest, TestSolrConfigHandler, AnalyticsMergeStrategyTest, TestSQLHandler, ResponseHeaderTest, TestSolrIndexConfig, DistributedFacetPivotSmallTest, SmileWriterTest, DateFieldTest, ResourceLoaderTest, TestMacroExpander, VersionInfoTest, TestNoOpRegenerator, TestSolrJ, TestClusterStateMutator, TestDFRSimilarityFactory, DistributedMLTComponentTest, TestHashQParserPlugin, TestPhraseSuggestions, TestBackupRepositoryFactory, JsonLoaderTest, TestPHPSerializedResponseWriter, TestCloudInspectUtil, DistributedQueryElevationComponentTest, CloudMLTQParserTest, TestPayloadScoreQParserPlugin, SpellCheckCollatorTest, ConfigureRecoveryStrategyTest, TestSchemaVersionResource, SoftAutoCommitTest, SegmentsInfoRequestHandlerTest, HdfsChaosMonkeySafeLeaderTest, GraphQueryTest, TestClusterProperties, ImplicitSnitchTest, TestHalfAndHalfDocValues, TestFieldSortValues, ExplicitHLLTest, AtomicUpdatesTest, TestReloadDeadlock, CleanupOldIndexTest, BlockDirectoryTest, AnalysisAfterCoreReloadTest, TestCryptoKeys, TestAnalyzeInfixSuggestions, TestTlogReplica, TestUtils, TestConfigSetProperties, BigEndianAscendingWordDeserializerTest, DeleteReplicaTest, TestSha256AuthenticationProvider, CdcrBidirectionalTest, TestUpdate, TestNumericTerms32, MoveReplicaTest, BlobRepositoryCloudTest, BasicFunctionalityTest, OverseerTaskQueueTest, DocValuesTest, UpdateRequestProcessorFactoryTest, TestJoin, TestPullReplicaErrorHandling, TestSmileRequest, TestMaxScoreQueryParser, TestRestManager, TestRequestStatusCollectionAPI, TestCustomStream, DistanceUnitsTest, ZkFailoverTest, TestConfigSetsAPI, TermsComponentTest, SortSpecParsingTest, LargeFieldTest, TestPivotHelperCode, BasicAuthIntegrationTest, PeerSyncTest, TestShortCircuitedRequests, TestOrdValues, TestSort, AssignBackwardCompatibilityTest, TestDistributedSearch, TestDocBasedVersionConstraints, UpdateParamsTest, TestDistributedStatsComponentCardinality, TestSolrDeletionPolicy1, TestInPlaceUpdatesDistrib, MissingSegmentRecoveryTest, DistributedFacetPivotLargeTest, ZkControllerTest, CollectionsAPISolrJTest]
[junit4] Completed [720/749 (4!)] on J0 in 107.75s, 13 tests, 2 errors <<< FAILURES!
[...truncated 43314 lines...]
[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk1.8.0_144) - Build # 882
- Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/882/
Java: 64bit/jdk1.8.0_144 -XX:+UseCompressedOops -XX:+UseSerialGC
1 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.search.mlt.CloudMLTQParserTest
Error Message:
Stack Trace:
java.util.concurrent.TimeoutException
at __randomizedtesting.SeedInfo.seed([72BC41633C991B49]:0)
at org.apache.solr.common.cloud.ZkStateReader.waitForState(ZkStateReader.java:1275)
at org.apache.solr.client.solrj.impl.CloudSolrClient.waitForState(CloudSolrClient.java:448)
at org.apache.solr.search.mlt.CloudMLTQParserTest.setupCluster(CloudMLTQParserTest.java:50)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:874)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 13123 lines...]
[junit4] Suite: org.apache.solr.search.mlt.CloudMLTQParserTest
[junit4] 2> 1452230 INFO (SUITE-CloudMLTQParserTest-seed#[72BC41633C991B49]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.mlt.CloudMLTQParserTest_72BC41633C991B49-001/init-core-data-001
[junit4] 2> 1452230 WARN (SUITE-CloudMLTQParserTest-seed#[72BC41633C991B49]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=13 numCloses=13
[junit4] 2> 1452231 INFO (SUITE-CloudMLTQParserTest-seed#[72BC41633C991B49]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 1452232 INFO (SUITE-CloudMLTQParserTest-seed#[72BC41633C991B49]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 1452233 INFO (SUITE-CloudMLTQParserTest-seed#[72BC41633C991B49]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.mlt.CloudMLTQParserTest_72BC41633C991B49-001/tempDir-001
[junit4] 2> 1452233 INFO (SUITE-CloudMLTQParserTest-seed#[72BC41633C991B49]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1452234 INFO (Thread-770) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1452234 INFO (Thread-770) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1452236 ERROR (Thread-770) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1452334 INFO (SUITE-CloudMLTQParserTest-seed#[72BC41633C991B49]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:46437
[junit4] 2> 1452359 INFO (jetty-launcher-893-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1452359 INFO (jetty-launcher-893-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1452372 INFO (jetty-launcher-893-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@430a9e93{/solr,null,AVAILABLE}
[junit4] 2> 1452380 INFO (jetty-launcher-893-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3f5fa3fa{/solr,null,AVAILABLE}
[junit4] 2> 1452396 INFO (jetty-launcher-893-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@24317b35{SSL,[ssl, http/1.1]}{127.0.0.1:33771}
[junit4] 2> 1452396 INFO (jetty-launcher-893-thread-2) [ ] o.e.j.s.Server Started @1454374ms
[junit4] 2> 1452396 INFO (jetty-launcher-893-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33771}
[junit4] 2> 1452396 ERROR (jetty-launcher-893-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1452396 INFO (jetty-launcher-893-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.2.0
[junit4] 2> 1452396 INFO (jetty-launcher-893-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1452397 INFO (jetty-launcher-893-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1452397 INFO (jetty-launcher-893-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-23T01:00:21.005Z
[junit4] 2> 1452405 INFO (jetty-launcher-893-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1452408 INFO (jetty-launcher-893-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3eeb08d5{SSL,[ssl, http/1.1]}{127.0.0.1:45583}
[junit4] 2> 1452408 INFO (jetty-launcher-893-thread-1) [ ] o.e.j.s.Server Started @1454386ms
[junit4] 2> 1452408 INFO (jetty-launcher-893-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45583}
[junit4] 2> 1452408 ERROR (jetty-launcher-893-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1452408 INFO (jetty-launcher-893-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.2.0
[junit4] 2> 1452408 INFO (jetty-launcher-893-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1452408 INFO (jetty-launcher-893-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1452408 INFO (jetty-launcher-893-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-23T01:00:21.016Z
[junit4] 2> 1452418 INFO (jetty-launcher-893-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46437/solr
[junit4] 2> 1452418 INFO (jetty-launcher-893-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1452462 INFO (jetty-launcher-893-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46437/solr
[junit4] 2> 1452532 INFO (jetty-launcher-893-thread-1) [n:127.0.0.1:45583_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1452533 INFO (jetty-launcher-893-thread-1) [n:127.0.0.1:45583_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45583_solr
[junit4] 2> 1452533 INFO (jetty-launcher-893-thread-1) [n:127.0.0.1:45583_solr ] o.a.s.c.Overseer Overseer (id=99051033122766853-127.0.0.1:45583_solr-n_0000000000) starting
[junit4] 2> 1452545 INFO (jetty-launcher-893-thread-2) [n:127.0.0.1:33771_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1452545 INFO (jetty-launcher-893-thread-2) [n:127.0.0.1:33771_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33771_solr
[junit4] 2> 1452558 INFO (zkCallback-905-thread-1-processing-n:127.0.0.1:45583_solr) [n:127.0.0.1:45583_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1452559 INFO (jetty-launcher-893-thread-1) [n:127.0.0.1:45583_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45583_solr
[junit4] 2> 1452563 INFO (zkCallback-905-thread-1-processing-n:127.0.0.1:45583_solr) [n:127.0.0.1:45583_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1452566 INFO (zkCallback-903-thread-1-processing-n:127.0.0.1:33771_solr) [n:127.0.0.1:33771_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1452573 INFO (zkCallback-903-thread-1-processing-n:127.0.0.1:33771_solr) [n:127.0.0.1:33771_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1452670 INFO (jetty-launcher-893-thread-1) [n:127.0.0.1:45583_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45583.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@310082af
[junit4] 2> 1452672 INFO (jetty-launcher-893-thread-2) [n:127.0.0.1:33771_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33771.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@310082af
[junit4] 2> 1452679 INFO (jetty-launcher-893-thread-2) [n:127.0.0.1:33771_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33771.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@310082af
[junit4] 2> 1452679 INFO (jetty-launcher-893-thread-2) [n:127.0.0.1:33771_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33771.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@310082af
[junit4] 2> 1452680 INFO (jetty-launcher-893-thread-2) [n:127.0.0.1:33771_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.mlt.CloudMLTQParserTest_72BC41633C991B49-001/tempDir-001/node2/.
[junit4] 2> 1452681 INFO (jetty-launcher-893-thread-1) [n:127.0.0.1:45583_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45583.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@310082af
[junit4] 2> 1452681 INFO (jetty-launcher-893-thread-1) [n:127.0.0.1:45583_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45583.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@310082af
[junit4] 2> 1452681 INFO (jetty-launcher-893-thread-1) [n:127.0.0.1:45583_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.mlt.CloudMLTQParserTest_72BC41633C991B49-001/tempDir-001/node1/.
[junit4] 2> 1452711 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15fe663cbeb0007, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1452712 INFO (SUITE-CloudMLTQParserTest-seed#[72BC41633C991B49]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1452712 INFO (SUITE-CloudMLTQParserTest-seed#[72BC41633C991B49]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46437/solr ready
[junit4] 2> 1452848 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=889721e7-86fc-45d6-96da-17c81dc18e3a&replicationFactor=1&collection.configName=conf&name=mlt-collection&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1452849 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=889721e7-86fc-45d6-96da-17c81dc18e3a&replicationFactor=1&collection.configName=conf&name=mlt-collection&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 1452854 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1452854 INFO (OverseerThreadFactory-1496-thread-1-processing-n:127.0.0.1:45583_solr) [n:127.0.0.1:45583_solr ] o.a.s.c.CreateCollectionCmd Create collection mlt-collection
[junit4] 2> 1452854 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1452976 INFO (OverseerStateUpdate-99051033122766853-127.0.0.1:45583_solr-n_0000000000) [n:127.0.0.1:45583_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"mlt-collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"mlt-collection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:33771/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1452978 INFO (OverseerStateUpdate-99051033122766853-127.0.0.1:45583_solr-n_0000000000) [n:127.0.0.1:45583_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"mlt-collection",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"mlt-collection_shard2_replica_n3",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:45583/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1453221 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf&newCollection=true&collection=mlt-collection&version=2&replicaType=NRT&async=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&coreNodeName=core_node2&name=mlt-collection_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&wt=javabin} status=0 QTime=11
[junit4] 2> 1453221 INFO (parallelCoreAdminExecutor-1498-thread-1-processing-n:127.0.0.1:33771_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213 CREATE) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf&newCollection=true&collection=mlt-collection&version=2&replicaType=NRT&async=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&coreNodeName=core_node2&name=mlt-collection_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&wt=javabin
[junit4] 2> 1453225 INFO (parallelCoreAdminExecutor-1498-thread-1-processing-n:127.0.0.1:33771_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213 CREATE) [n:127.0.0.1:33771_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1453229 INFO (qtp1880827456-8251) [n:127.0.0.1:45583_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf&newCollection=true&collection=mlt-collection&version=2&replicaType=NRT&async=889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334&coreNodeName=core_node4&name=mlt-collection_shard2_replica_n3&action=CREATE&numShards=2&shard=shard2&wt=javabin} status=0 QTime=0
[junit4] 2> 1453229 INFO (parallelCoreAdminExecutor-1497-thread-1-processing-n:127.0.0.1:45583_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334 CREATE) [n:127.0.0.1:45583_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf&newCollection=true&collection=mlt-collection&version=2&replicaType=NRT&async=889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334&coreNodeName=core_node4&name=mlt-collection_shard2_replica_n3&action=CREATE&numShards=2&shard=shard2&wt=javabin
[junit4] 2> 1453230 INFO (parallelCoreAdminExecutor-1497-thread-1-processing-n:127.0.0.1:45583_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334 CREATE) [n:127.0.0.1:45583_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1453234 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1453234 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1453339 INFO (zkCallback-903-thread-1-processing-n:127.0.0.1:33771_solr) [n:127.0.0.1:33771_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/mlt-collection/state.json] for collection [mlt-collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1453339 INFO (zkCallback-905-thread-1-processing-n:127.0.0.1:45583_solr) [n:127.0.0.1:45583_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/mlt-collection/state.json] for collection [mlt-collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1453339 INFO (zkCallback-903-thread-2-processing-n:127.0.0.1:33771_solr) [n:127.0.0.1:33771_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/mlt-collection/state.json] for collection [mlt-collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1453339 INFO (zkCallback-905-thread-2-processing-n:127.0.0.1:45583_solr) [n:127.0.0.1:45583_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/mlt-collection/state.json] for collection [mlt-collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1453856 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1453859 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 1454235 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1454235 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1454242 INFO (parallelCoreAdminExecutor-1498-thread-1-processing-n:127.0.0.1:33771_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213 CREATE) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 1454243 INFO (parallelCoreAdminExecutor-1497-thread-1-processing-n:127.0.0.1:45583_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334 CREATE) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 1454262 INFO (parallelCoreAdminExecutor-1497-thread-1-processing-n:127.0.0.1:45583_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334 CREATE) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.s.IndexSchema [mlt-collection_shard2_replica_n3] Schema name=cloud-dynamic
[junit4] 2> 1454263 INFO (parallelCoreAdminExecutor-1498-thread-1-processing-n:127.0.0.1:33771_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213 CREATE) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.s.IndexSchema [mlt-collection_shard1_replica_n1] Schema name=cloud-dynamic
[junit4] 2> 1454281 INFO (parallelCoreAdminExecutor-1497-thread-1-processing-n:127.0.0.1:45583_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334 CREATE) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 1454281 INFO (parallelCoreAdminExecutor-1497-thread-1-processing-n:127.0.0.1:45583_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334 CREATE) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.c.CoreContainer Creating SolrCore 'mlt-collection_shard2_replica_n3' using configuration from collection mlt-collection, trusted=true
[junit4] 2> 1454281 INFO (parallelCoreAdminExecutor-1498-thread-1-processing-n:127.0.0.1:33771_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213 CREATE) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 1454282 INFO (parallelCoreAdminExecutor-1498-thread-1-processing-n:127.0.0.1:33771_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213 CREATE) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'mlt-collection_shard1_replica_n1' using configuration from collection mlt-collection, trusted=true
[junit4] 2> 1454282 INFO (parallelCoreAdminExecutor-1497-thread-1-processing-n:127.0.0.1:45583_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334 CREATE) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45583.solr.core.mlt-collection.shard2.replica_n3' (registry 'solr.core.mlt-collection.shard2.replica_n3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@310082af
[junit4] 2> 1454282 INFO (parallelCoreAdminExecutor-1498-thread-1-processing-n:127.0.0.1:33771_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213 CREATE) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33771.solr.core.mlt-collection.shard1.replica_n1' (registry 'solr.core.mlt-collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@310082af
[junit4] 2> 1454282 INFO (parallelCoreAdminExecutor-1497-thread-1-processing-n:127.0.0.1:45583_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334 CREATE) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1454282 INFO (parallelCoreAdminExecutor-1498-thread-1-processing-n:127.0.0.1:33771_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213 CREATE) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1454282 INFO (parallelCoreAdminExecutor-1497-thread-1-processing-n:127.0.0.1:45583_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334 CREATE) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.c.SolrCore [[mlt-collection_shard2_replica_n3] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.mlt.CloudMLTQParserTest_72BC41633C991B49-001/tempDir-001/node1/mlt-collection_shard2_replica_n3], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.mlt.CloudMLTQParserTest_72BC41633C991B49-001/tempDir-001/node1/./mlt-collection_shard2_replica_n3/data/]
[junit4] 2> 1454282 INFO (parallelCoreAdminExecutor-1498-thread-1-processing-n:127.0.0.1:33771_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213 CREATE) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.c.SolrCore [[mlt-collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.mlt.CloudMLTQParserTest_72BC41633C991B49-001/tempDir-001/node2/mlt-collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.mlt.CloudMLTQParserTest_72BC41633C991B49-001/tempDir-001/node2/./mlt-collection_shard1_replica_n1/data/]
[junit4] 2> 1454321 INFO (parallelCoreAdminExecutor-1498-thread-1-processing-n:127.0.0.1:33771_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213 CREATE) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1454321 INFO (parallelCoreAdminExecutor-1498-thread-1-processing-n:127.0.0.1:33771_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213 CREATE) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1454346 INFO (parallelCoreAdminExecutor-1497-thread-1-processing-n:127.0.0.1:45583_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334 CREATE) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1454346 INFO (parallelCoreAdminExecutor-1497-thread-1-processing-n:127.0.0.1:45583_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334 CREATE) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1454347 INFO (parallelCoreAdminExecutor-1498-thread-1-processing-n:127.0.0.1:33771_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213 CREATE) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1454347 INFO (parallelCoreAdminExecutor-1498-thread-1-processing-n:127.0.0.1:33771_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213 CREATE) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1454347 INFO (parallelCoreAdminExecutor-1497-thread-1-processing-n:127.0.0.1:45583_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334 CREATE) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1454347 INFO (parallelCoreAdminExecutor-1497-thread-1-processing-n:127.0.0.1:45583_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334 CREATE) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1454348 INFO (parallelCoreAdminExecutor-1498-thread-1-processing-n:127.0.0.1:33771_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213 CREATE) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@592113a6[mlt-collection_shard1_replica_n1] main]
[junit4] 2> 1454348 INFO (parallelCoreAdminExecutor-1497-thread-1-processing-n:127.0.0.1:45583_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334 CREATE) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.s.SolrIndexSearcher Opening [Searcher@d6b9746[mlt-collection_shard2_replica_n3] main]
[junit4] 2> 1454349 INFO (parallelCoreAdminExecutor-1498-thread-1-processing-n:127.0.0.1:33771_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213 CREATE) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1454349 INFO (parallelCoreAdminExecutor-1497-thread-1-processing-n:127.0.0.1:45583_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334 CREATE) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1454349 INFO (parallelCoreAdminExecutor-1498-thread-1-processing-n:127.0.0.1:33771_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213 CREATE) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1454349 INFO (parallelCoreAdminExecutor-1497-thread-1-processing-n:127.0.0.1:45583_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334 CREATE) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1454350 INFO (parallelCoreAdminExecutor-1498-thread-1-processing-n:127.0.0.1:33771_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213 CREATE) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1454350 INFO (parallelCoreAdminExecutor-1497-thread-1-processing-n:127.0.0.1:45583_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334 CREATE) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1454350 INFO (parallelCoreAdminExecutor-1498-thread-1-processing-n:127.0.0.1:33771_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213 CREATE) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1584816532182007808
[junit4] 2> 1454350 INFO (parallelCoreAdminExecutor-1497-thread-1-processing-n:127.0.0.1:45583_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334 CREATE) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1584816532182007808
[junit4] 2> 1454350 INFO (searcherExecutor-1501-thread-1-processing-x:mlt-collection_shard2_replica_n3 r:core_node4 889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334 CREATE n:127.0.0.1:45583_solr s:shard2 c:mlt-collection) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.c.SolrCore [mlt-collection_shard2_replica_n3] Registered new searcher Searcher@d6b9746[mlt-collection_shard2_replica_n3] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1454353 INFO (parallelCoreAdminExecutor-1498-thread-1-processing-n:127.0.0.1:33771_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213 CREATE) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1454353 INFO (parallelCoreAdminExecutor-1498-thread-1-processing-n:127.0.0.1:33771_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213 CREATE) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1454354 INFO (parallelCoreAdminExecutor-1498-thread-1-processing-n:127.0.0.1:33771_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213 CREATE) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:33771/solr/mlt-collection_shard1_replica_n1/
[junit4] 2> 1454354 INFO (parallelCoreAdminExecutor-1498-thread-1-processing-n:127.0.0.1:33771_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213 CREATE) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1454354 INFO (parallelCoreAdminExecutor-1498-thread-1-processing-n:127.0.0.1:33771_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213 CREATE) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:33771/solr/mlt-collection_shard1_replica_n1/ has no replicas
[junit4] 2> 1454354 INFO (parallelCoreAdminExecutor-1497-thread-1-processing-n:127.0.0.1:45583_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334 CREATE) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1454354 INFO (parallelCoreAdminExecutor-1498-thread-1-processing-n:127.0.0.1:33771_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213 CREATE) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1454354 INFO (parallelCoreAdminExecutor-1497-thread-1-processing-n:127.0.0.1:45583_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334 CREATE) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1454354 INFO (parallelCoreAdminExecutor-1497-thread-1-processing-n:127.0.0.1:45583_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334 CREATE) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:45583/solr/mlt-collection_shard2_replica_n3/
[junit4] 2> 1454354 INFO (parallelCoreAdminExecutor-1497-thread-1-processing-n:127.0.0.1:45583_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334 CREATE) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1454354 INFO (parallelCoreAdminExecutor-1497-thread-1-processing-n:127.0.0.1:45583_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334 CREATE) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.c.SyncStrategy https://127.0.0.1:45583/solr/mlt-collection_shard2_replica_n3/ has no replicas
[junit4] 2> 1454354 INFO (parallelCoreAdminExecutor-1497-thread-1-processing-n:127.0.0.1:45583_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334 CREATE) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1454355 INFO (parallelCoreAdminExecutor-1498-thread-1-processing-n:127.0.0.1:33771_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213 CREATE) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:33771/solr/mlt-collection_shard1_replica_n1/ shard1
[junit4] 2> 1454356 INFO (parallelCoreAdminExecutor-1497-thread-1-processing-n:127.0.0.1:45583_solr 889721e7-86fc-45d6-96da-17c81dc18e3a2124169756873334 CREATE) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:45583/solr/mlt-collection_shard2_replica_n3/ shard2
[junit4] 2> 1454357 INFO (searcherExecutor-1502-thread-1-processing-x:mlt-collection_shard1_replica_n1 r:core_node2 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213 CREATE n:127.0.0.1:33771_solr s:shard1 c:mlt-collection) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.c.SolrCore [mlt-collection_shard1_replica_n1] Registered new searcher Searcher@592113a6[mlt-collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1454860 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1454861 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1455236 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1455237 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1455862 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1455862 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1456238 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1456238 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1456863 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1456864 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1457239 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1457239 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1457865 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1457865 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1458240 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1458240 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1458866 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1458867 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1459241 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1459241 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1459868 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1459868 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1460242 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1460242 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1460869 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1460869 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1461243 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1461243 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1461870 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1461871 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1462244 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1462244 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1462872 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1462872 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1463245 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1463245 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1463873 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1463874 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1464246 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1464246 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1464875 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1464875 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1465247 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1465247 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1465876 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1465877 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1466249 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1466249 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1466878 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1466878 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1467250 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1467250 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1467879 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1467879 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1468251 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1468251 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1468880 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1468881 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1469253 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1469253 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1469882 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1469883 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 1470254 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1470254 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1470885 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1470885 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1471255 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1471255 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1471886 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1471887 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1472256 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1472256 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1472888 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1472888 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1473257 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1473257 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1473889 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1473890 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1474258 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1474258 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1474891 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1474891 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1475259 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1475259 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1475892 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1475893 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1476260 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1476260 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1476893 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1476894 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1477261 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1477261 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1477895 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1477895 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1478263 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1478263 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1478896 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1478897 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1479264 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1479264 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1479897 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1479898 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1480265 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1480265 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1480899 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1480900 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1481266 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1481266 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1481901 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1481903 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 1482267 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1482267 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1482904 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1482905 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 1483268 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1483268 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1483906 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1483907 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 1484269 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1484269 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1484908 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1484909 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1485270 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1485271 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1485910 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1485910 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1486272 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1486272 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1486911 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1486913 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 1487273 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1487273 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1487914 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1487915 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 1488275 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1488275 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1488916 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1488917 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1489276 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1489276 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1489918 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1489919 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1490277 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1490277 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1490920 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1490921 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 1491279 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1491279 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1491922 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1491923 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 1492280 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1492280 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1492925 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1492925 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1493282 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1493282 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1493926 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1493927 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 1494282 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1494282 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1494929 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1494930 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1495284 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1495284 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1495931 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1495932 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1496285 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1496285 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1496933 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1496934 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 1497286 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1497286 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1497935 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1497936 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1498287 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1498287 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1498937 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1498938 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1499289 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1499289 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1499939 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1499940 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 1500290 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1500290 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1500941 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1500942 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 1501291 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1501291 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1501943 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1501944 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1502293 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1502293 INFO (qtp1347349568-8242) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1502945 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1502946 INFO (qtp1347349568-8240) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 1503294 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4] 2> 1503294 INFO (qtp1347349568-8255) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1503948 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1503949 INFO (qtp1347349568-8254) [n:127.0.0.1:33771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=889721e7-86fc-45d6-96da-17c81dc18e3a&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1504295 INFO (qtp1347349568-8253) [n:127.0.0.1:33771_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 889721e7-86fc-45d6-96da-17c81dc18e3a2124169754344213
[junit4]
[...truncated too long message...]
lr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
[junit4] 2> at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> Caused by: org.apache.solr.common.SolrException: No registered leader was found after waiting for 1220000ms , collection: mlt-collection slice: shard2 saw state=DocCollection(mlt-collection//collections/mlt-collection/state.json/2)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "shards":{
[junit4] 2> "shard1":{
[junit4] 2> "range":"80000000-ffffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node2":{
[junit4] 2> "core":"mlt-collection_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:33771/solr",
[junit4] 2> "node_name":"127.0.0.1:33771_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"}}},
[junit4] 2> "shard2":{
[junit4] 2> "range":"0-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node4":{
[junit4] 2> "core":"mlt-collection_shard2_replica_n3",
[junit4] 2> "base_url":"https://127.0.0.1:45583/solr",
[junit4] 2> "node_name":"127.0.0.1:45583_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"}}}},
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"1",
[junit4] 2> "tlogReplicas":"0"} with live_nodes=[]
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:771)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:736)
[junit4] 2> at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1178)
[junit4] 2> ... 16 more
[junit4] 2>
[junit4] 2> 2674380 INFO (coreCloseExecutor-1511-thread-1) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.c.SolrCore [mlt-collection_shard2_replica_n3] CLOSING SolrCore org.apache.solr.core.SolrCore@5a1cba78
[junit4] 2> 2674380 INFO (coreCloseExecutor-1511-thread-1) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.mlt-collection.shard2.replica_n3, tag=1511832184
[junit4] 2> 2674380 INFO (coreCloseExecutor-1511-thread-1) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@c364d4a: rootName = solr_45583, domain = solr.core.mlt-collection.shard2.replica_n3, service url = null, agent id = null] for registry solr.core.mlt-collection.shard2.replica_n3 / com.codahale.metrics.MetricRegistry@6f2c036a
[junit4] 2> 2674384 INFO (coreCloseExecutor-1512-thread-1) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.c.SolrCore [mlt-collection_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@1ad8d5a9
[junit4] 2> 2674384 INFO (coreCloseExecutor-1512-thread-1) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.mlt-collection.shard1.replica_n1, tag=450418089
[junit4] 2> 2674384 INFO (coreCloseExecutor-1512-thread-1) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@29882666: rootName = solr_33771, domain = solr.core.mlt-collection.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.mlt-collection.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@41b7380b
[junit4] 2> 2674385 INFO (coreCloseExecutor-1511-thread-1) [n:127.0.0.1:45583_solr c:mlt-collection s:shard2 r:core_node4 x:mlt-collection_shard2_replica_n3] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.mlt-collection.shard2.leader, tag=1511832184
[junit4] 2> 2674386 INFO (jetty-closer-894-thread-1) [ ] o.a.s.c.Overseer Overseer (id=99051033122766853-127.0.0.1:45583_solr-n_0000000000) closing
[junit4] 2> 2674386 INFO (OverseerStateUpdate-99051033122766853-127.0.0.1:45583_solr-n_0000000000) [n:127.0.0.1:45583_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:45583_solr
[junit4] 2> 2674387 WARN (OverseerAutoScalingTriggerThread-99051033122766853-127.0.0.1:45583_solr-n_0000000000) [n:127.0.0.1:45583_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 2674388 INFO (jetty-closer-894-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@430a9e93{/solr,null,UNAVAILABLE}
[junit4] 2> 2674388 INFO (zkCallback-903-thread-4-processing-n:127.0.0.1:33771_solr) [n:127.0.0.1:33771_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33771_solr
[junit4] 2> 2674391 INFO (coreCloseExecutor-1512-thread-1) [n:127.0.0.1:33771_solr c:mlt-collection s:shard1 r:core_node2 x:mlt-collection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.mlt-collection.shard1.leader, tag=450418089
[junit4] 2> 2674393 INFO (jetty-closer-894-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3f5fa3fa{/solr,null,UNAVAILABLE}
[junit4] 2> 2674393 ERROR (SUITE-CloudMLTQParserTest-seed#[72BC41633C991B49]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2674393 INFO (SUITE-CloudMLTQParserTest-seed#[72BC41633C991B49]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46437 46437
[junit4] 2> 2680175 INFO (Thread-770) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46437 46437
[junit4] 2> 2680176 WARN (Thread-770) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/aliases.json
[junit4] 2> 2 /solr/security.json
[junit4] 2> 2 /solr/configs/conf
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/collections/mlt-collection/state.json
[junit4] 2> 3 /solr/clusterstate.json
[junit4] 2> 3 /solr/clusterprops.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/live_nodes
[junit4] 2> 3 /solr/collections
[junit4] 2>
[junit4] 2> 2680177 INFO (SUITE-CloudMLTQParserTest-seed#[72BC41633C991B49]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1615, maxMBSortInHeap=5.336242541586419, sim=RandomSimilarity(queryNorm=false): {}, locale=de-CH, timezone=Africa/Nairobi
[junit4] 2> NOTE: Linux 4.10.0-37-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=8,threads=1,free=138827776,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [AutoScalingHandlerTest, TestHighlightDedupGrouping, SliceStateTest, JvmMetricsTest, TestFieldCacheVsDocValues, TestPHPSerializedResponseWriter, VersionInfoTest, TestBinaryField, HdfsSyncSliceTest, TestFastOutputStream, TestSolrFieldCacheBean, TestSolrCoreSnapshots, SpatialFilterTest, MinimalSchemaTest, BasicDistributedZkTest, HdfsUnloadDistributedZkTest, PeerSyncTest, TestFreeTextSuggestions, TestJsonFacetRefinement, HdfsBasicDistributedZk2Test, V2StandaloneTest, RestartWhileUpdatingTest, SpatialHeatmapFacetsTest, TermsComponentTest, CloudMLTQParserTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CloudMLTQParserTest -Dtests.seed=72BC41633C991B49 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=de-CH -Dtests.timezone=Africa/Nairobi -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J0 | CloudMLTQParserTest (suite) <<<
[junit4] > Throwable #1: java.util.concurrent.TimeoutException
[junit4] > at __randomizedtesting.SeedInfo.seed([72BC41633C991B49]:0)
[junit4] > at org.apache.solr.common.cloud.ZkStateReader.waitForState(ZkStateReader.java:1275)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.waitForState(CloudSolrClient.java:448)
[junit4] > at org.apache.solr.search.mlt.CloudMLTQParserTest.setupCluster(CloudMLTQParserTest.java:50)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] Completed [460/749 (1!)] on J0 in 1227.97s, 0 tests, 1 error <<< FAILURES!
[...truncated 48286 lines...]
[JENKINS-EA] Lucene-Solr-7.x-Linux (64bit/jdk-10-ea+32) - Build #
881 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/881/
Java: 64bit/jdk-10-ea+32 -XX:+UseCompressedOops -XX:+UseParallelGC
2 tests failed.
FAILED: org.apache.solr.cloud.TestAuthenticationFramework.testBasics
Error Message:
Error from server at http://127.0.0.1:40279/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 404 </title> </head> <body> <h2>HTTP ERROR: 404</h2> <p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason: <pre> Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p> <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/> </body> </html>
Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at http://127.0.0.1:40279/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason:
<pre> Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>
at __randomizedtesting.SeedInfo.seed([72BC94B56E2A50AD:4F643A9956C40EDD]:0)
at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:549)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1012)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:883)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:945)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:945)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:945)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:945)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:945)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:816)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
at org.apache.solr.cloud.TestAuthenticationFramework.collectionCreateSearchDeleteTwice(TestAuthenticationFramework.java:126)
at org.apache.solr.cloud.TestAuthenticationFramework.testBasics(TestAuthenticationFramework.java:74)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:40279/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason:
<pre> Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:607)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:526)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
... 1 more
FAILED: org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple
Error Message:
Waiting for collection testSimple2 null Live Nodes: [127.0.0.1:39639_solr, 127.0.0.1:45775_solr] Last available state: DocCollection(testSimple2//collections/testSimple2/state.json/14)={ "pullReplicas":"0", "replicationFactor":"2", "shards":{ "shard1":{ "range":"80000000-ffffffff", "state":"active", "replicas":{ "core_node3":{ "core":"testSimple2_shard1_replica_n1", "base_url":"https://127.0.0.1:45775/solr", "node_name":"127.0.0.1:45775_solr", "state":"active", "type":"NRT", "leader":"true"}, "core_node5":{ "core":"testSimple2_shard1_replica_n2", "base_url":"https://127.0.0.1:33729/solr", "node_name":"127.0.0.1:33729_solr", "state":"down", "type":"NRT"}}}, "shard2":{ "range":"0-7fffffff", "state":"active", "replicas":{ "core_node7":{ "core":"testSimple2_shard2_replica_n4", "base_url":"https://127.0.0.1:45775/solr", "node_name":"127.0.0.1:45775_solr", "state":"active", "type":"NRT", "leader":"true"}, "core_node8":{ "core":"testSimple2_shard2_replica_n6", "base_url":"https://127.0.0.1:33729/solr", "node_name":"127.0.0.1:33729_solr", "state":"down", "type":"NRT"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"2", "autoAddReplicas":"true", "nrtReplicas":"2", "tlogReplicas":"0"}
Stack Trace:
java.lang.AssertionError: Waiting for collection testSimple2
null
Live Nodes: [127.0.0.1:39639_solr, 127.0.0.1:45775_solr]
Last available state: DocCollection(testSimple2//collections/testSimple2/state.json/14)={
"pullReplicas":"0",
"replicationFactor":"2",
"shards":{
"shard1":{
"range":"80000000-ffffffff",
"state":"active",
"replicas":{
"core_node3":{
"core":"testSimple2_shard1_replica_n1",
"base_url":"https://127.0.0.1:45775/solr",
"node_name":"127.0.0.1:45775_solr",
"state":"active",
"type":"NRT",
"leader":"true"},
"core_node5":{
"core":"testSimple2_shard1_replica_n2",
"base_url":"https://127.0.0.1:33729/solr",
"node_name":"127.0.0.1:33729_solr",
"state":"down",
"type":"NRT"}}},
"shard2":{
"range":"0-7fffffff",
"state":"active",
"replicas":{
"core_node7":{
"core":"testSimple2_shard2_replica_n4",
"base_url":"https://127.0.0.1:45775/solr",
"node_name":"127.0.0.1:45775_solr",
"state":"active",
"type":"NRT",
"leader":"true"},
"core_node8":{
"core":"testSimple2_shard2_replica_n6",
"base_url":"https://127.0.0.1:33729/solr",
"node_name":"127.0.0.1:33729_solr",
"state":"down",
"type":"NRT"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"2",
"autoAddReplicas":"true",
"nrtReplicas":"2",
"tlogReplicas":"0"}
at __randomizedtesting.SeedInfo.seed([72BC94B56E2A50AD:4A0FB04B49D9847C]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:269)
at org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple(AutoAddReplicasIntegrationTest.java:125)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 12476 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_72BC94B56E2A50AD-001/init-core-data-001
[junit4] 2> 698184 WARN (SUITE-AutoAddReplicasIntegrationTest-seed#[72BC94B56E2A50AD]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=18 numCloses=18
[junit4] 2> 698184 INFO (SUITE-AutoAddReplicasIntegrationTest-seed#[72BC94B56E2A50AD]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 698185 INFO (SUITE-AutoAddReplicasIntegrationTest-seed#[72BC94B56E2A50AD]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 698185 INFO (SUITE-AutoAddReplicasIntegrationTest-seed#[72BC94B56E2A50AD]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 698186 INFO (SUITE-AutoAddReplicasIntegrationTest-seed#[72BC94B56E2A50AD]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_72BC94B56E2A50AD-001/tempDir-001
[junit4] 2> 698186 INFO (SUITE-AutoAddReplicasIntegrationTest-seed#[72BC94B56E2A50AD]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 698186 INFO (Thread-2248) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 698186 INFO (Thread-2248) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 698187 ERROR (Thread-2248) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 698286 INFO (SUITE-AutoAddReplicasIntegrationTest-seed#[72BC94B56E2A50AD]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:38345
[junit4] 2> 698294 INFO (jetty-launcher-1194-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 698294 INFO (jetty-launcher-1194-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 698294 INFO (jetty-launcher-1194-thread-3) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 698297 INFO (jetty-launcher-1194-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@47e58d53{/solr,null,AVAILABLE}
[junit4] 2> 698297 INFO (jetty-launcher-1194-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@67cc0a95{/solr,null,AVAILABLE}
[junit4] 2> 698297 INFO (jetty-launcher-1194-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@b079634{/solr,null,AVAILABLE}
[junit4] 2> 698300 INFO (jetty-launcher-1194-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@61f5f0a0{SSL,[ssl, http/1.1]}{127.0.0.1:33729}
[junit4] 2> 698300 INFO (jetty-launcher-1194-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@14a59c90{SSL,[ssl, http/1.1]}{127.0.0.1:45775}
[junit4] 2> 698300 INFO (jetty-launcher-1194-thread-1) [ ] o.e.j.s.Server Started @699797ms
[junit4] 2> 698300 INFO (jetty-launcher-1194-thread-2) [ ] o.e.j.s.Server Started @699798ms
[junit4] 2> 698300 INFO (jetty-launcher-1194-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33729}
[junit4] 2> 698300 INFO (jetty-launcher-1194-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45775}
[junit4] 2> 698300 INFO (jetty-launcher-1194-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1f9555ff{SSL,[ssl, http/1.1]}{127.0.0.1:39639}
[junit4] 2> 698300 INFO (jetty-launcher-1194-thread-3) [ ] o.e.j.s.Server Started @699798ms
[junit4] 2> 698301 ERROR (jetty-launcher-1194-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 698301 INFO (jetty-launcher-1194-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39639}
[junit4] 2> 698301 INFO (jetty-launcher-1194-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.2.0
[junit4] 2> 698301 ERROR (jetty-launcher-1194-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 698301 INFO (jetty-launcher-1194-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 698301 INFO (jetty-launcher-1194-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 698301 ERROR (jetty-launcher-1194-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 698301 INFO (jetty-launcher-1194-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-22T21:06:16.071309Z
[junit4] 2> 698301 INFO (jetty-launcher-1194-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.2.0
[junit4] 2> 698301 INFO (jetty-launcher-1194-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.2.0
[junit4] 2> 698301 INFO (jetty-launcher-1194-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 698301 INFO (jetty-launcher-1194-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 698301 INFO (jetty-launcher-1194-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 698301 INFO (jetty-launcher-1194-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 698301 INFO (jetty-launcher-1194-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-22T21:06:16.071663Z
[junit4] 2> 698301 INFO (jetty-launcher-1194-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-11-22T21:06:16.071706Z
[junit4] 2> 698304 INFO (jetty-launcher-1194-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 698308 INFO (jetty-launcher-1194-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 698308 INFO (jetty-launcher-1194-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 698310 INFO (jetty-launcher-1194-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38345/solr
[junit4] 2> 698319 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15fe58d7d150001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 698322 INFO (jetty-launcher-1194-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38345/solr
[junit4] 2> 698323 INFO (jetty-launcher-1194-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38345/solr
[junit4] 2> 698337 INFO (jetty-launcher-1194-thread-3) [ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 698337 INFO (jetty-launcher-1194-thread-3) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:39639_solr
[junit4] 2> 698338 INFO (jetty-launcher-1194-thread-3) [ ] o.a.s.c.Overseer Overseer (id=99050112677117961-127.0.0.1:39639_solr-n_0000000000) starting
[junit4] 2> 698341 INFO (jetty-launcher-1194-thread-3) [ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39639_solr
[junit4] 2> 698341 DEBUG (OverseerAutoScalingTriggerThread-99050112677117961-127.0.0.1:39639_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 698341 INFO (zkCallback-1211-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 698341 DEBUG (OverseerAutoScalingTriggerThread-99050112677117961-127.0.0.1:39639_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 698342 DEBUG (OverseerAutoScalingTriggerThread-99050112677117961-127.0.0.1:39639_solr-n_0000000000) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:39639_solr]
[junit4] 2> 698342 DEBUG (OverseerAutoScalingTriggerThread-99050112677117961-127.0.0.1:39639_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 698342 DEBUG (OverseerAutoScalingTriggerThread-99050112677117961-127.0.0.1:39639_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 698342 DEBUG (OverseerAutoScalingTriggerThread-99050112677117961-127.0.0.1:39639_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 698342 DEBUG (OverseerAutoScalingTriggerThread-99050112677117961-127.0.0.1:39639_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 698343 DEBUG (ScheduledTrigger-2763-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:39639_solr]
[junit4] 2> 698358 INFO (jetty-launcher-1194-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 698358 INFO (jetty-launcher-1194-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 698359 INFO (jetty-launcher-1194-thread-2) [ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 698359 INFO (jetty-launcher-1194-thread-1) [ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 698359 INFO (jetty-launcher-1194-thread-1) [ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33729_solr
[junit4] 2> 698359 INFO (jetty-launcher-1194-thread-2) [ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45775_solr
[junit4] 2> 698360 INFO (zkCallback-1211-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
[junit4] 2> 698360 INFO (zkCallback-1204-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
[junit4] 2> 698360 INFO (zkCallback-1210-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
[junit4] 2> 698374 INFO (jetty-launcher-1194-thread-3) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39639.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c974329
[junit4] 2> 698381 INFO (jetty-launcher-1194-thread-3) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39639.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c974329
[junit4] 2> 698381 INFO (jetty-launcher-1194-thread-3) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39639.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c974329
[junit4] 2> 698382 INFO (jetty-launcher-1194-thread-3) [ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_72BC94B56E2A50AD-001/tempDir-001/node3/.
[junit4] 2> 698388 INFO (jetty-launcher-1194-thread-1) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33729.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c974329
[junit4] 2> 698392 INFO (jetty-launcher-1194-thread-2) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45775.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c974329
[junit4] 2> 698392 INFO (jetty-launcher-1194-thread-1) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33729.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c974329
[junit4] 2> 698392 INFO (jetty-launcher-1194-thread-1) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33729.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c974329
[junit4] 2> 698393 INFO (jetty-launcher-1194-thread-1) [ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_72BC94B56E2A50AD-001/tempDir-001/node1/.
[junit4] 2> 698397 INFO (jetty-launcher-1194-thread-2) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45775.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c974329
[junit4] 2> 698397 INFO (jetty-launcher-1194-thread-2) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45775.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c974329
[junit4] 2> 698397 INFO (jetty-launcher-1194-thread-2) [ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_72BC94B56E2A50AD-001/tempDir-001/node2/.
[junit4] 2> 698425 INFO (SUITE-AutoAddReplicasIntegrationTest-seed#[72BC94B56E2A50AD]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 698425 INFO (SUITE-AutoAddReplicasIntegrationTest-seed#[72BC94B56E2A50AD]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38345/solr ready
[junit4] 2> 698432 INFO (TEST-AutoAddReplicasIntegrationTest.testSimple-seed#[72BC94B56E2A50AD]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testSimple
[junit4] 2> 698440 INFO (qtp1950934723-7215) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&maxShardsPerNode=2&autoAddReplicas=true&name=testSimple1&nrtReplicas=2&action=CREATE&numShards=2&createNodeSet=127.0.0.1:39639_solr,127.0.0.1:33729_solr&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 698443 INFO (OverseerThreadFactory-2765-thread-1) [ ] o.a.s.c.CreateCollectionCmd Create collection testSimple1
[junit4] 2> 698549 INFO (OverseerStateUpdate-99050112677117961-127.0.0.1:39639_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testSimple1_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:39639/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 698550 INFO (OverseerStateUpdate-99050112677117961-127.0.0.1:39639_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testSimple1_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:33729/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 698550 INFO (OverseerStateUpdate-99050112677117961-127.0.0.1:39639_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple1",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"testSimple1_shard2_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:39639/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 698551 INFO (OverseerStateUpdate-99050112677117961-127.0.0.1:39639_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple1",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"testSimple1_shard2_replica_n6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:33729/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 698762 INFO (qtp1950934723-7234) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n6&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 698763 INFO (qtp1950934723-7234) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 698763 INFO (qtp1950934723-7231) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n2&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 698782 INFO (qtp881279113-7235) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n1&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 698782 INFO (qtp881279113-7235) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 698785 INFO (qtp881279113-7232) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n4&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 698891 INFO (zkCallback-1211-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 698891 INFO (zkCallback-1210-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 699343 DEBUG (ScheduledTrigger-2763-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:33729_solr, 127.0.0.1:45775_solr, 127.0.0.1:39639_solr]
[junit4] 2> 699776 INFO (qtp1950934723-7234) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 699782 INFO (qtp1950934723-7234) [ ] o.a.s.s.IndexSchema [testSimple1_shard2_replica_n6] Schema name=minimal
[junit4] 2> 699784 INFO (qtp1950934723-7234) [ ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 699784 INFO (qtp1950934723-7234) [ ] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard2_replica_n6' using configuration from collection testSimple1, trusted=true
[junit4] 2> 699785 INFO (qtp1950934723-7234) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33729.solr.core.testSimple1.shard2.replica_n6' (registry 'solr.core.testSimple1.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c974329
[junit4] 2> 699785 INFO (qtp1950934723-7234) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 699785 INFO (qtp1950934723-7234) [ ] o.a.s.c.SolrCore [[testSimple1_shard2_replica_n6] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_72BC94B56E2A50AD-001/tempDir-001/node1/testSimple1_shard2_replica_n6], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_72BC94B56E2A50AD-001/tempDir-001/node1/./testSimple1_shard2_replica_n6/data/]
[junit4] 2> 699787 INFO (qtp1950934723-7231) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 699794 INFO (qtp881279113-7232) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 699794 INFO (qtp1950934723-7231) [ ] o.a.s.s.IndexSchema [testSimple1_shard1_replica_n2] Schema name=minimal
[junit4] 2> 699796 INFO (qtp881279113-7235) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 699796 INFO (qtp1950934723-7231) [ ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 699796 INFO (qtp1950934723-7231) [ ] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard1_replica_n2' using configuration from collection testSimple1, trusted=true
[junit4] 2> 699797 INFO (qtp1950934723-7231) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33729.solr.core.testSimple1.shard1.replica_n2' (registry 'solr.core.testSimple1.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c974329
[junit4] 2> 699797 INFO (qtp1950934723-7231) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 699797 INFO (qtp1950934723-7231) [ ] o.a.s.c.SolrCore [[testSimple1_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_72BC94B56E2A50AD-001/tempDir-001/node1/testSimple1_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_72BC94B56E2A50AD-001/tempDir-001/node1/./testSimple1_shard1_replica_n2/data/]
[junit4] 2> 699799 INFO (qtp881279113-7232) [ ] o.a.s.s.IndexSchema [testSimple1_shard2_replica_n4] Schema name=minimal
[junit4] 2> 699801 INFO (qtp881279113-7232) [ ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 699801 INFO (qtp881279113-7232) [ ] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard2_replica_n4' using configuration from collection testSimple1, trusted=true
[junit4] 2> 699801 INFO (qtp881279113-7235) [ ] o.a.s.s.IndexSchema [testSimple1_shard1_replica_n1] Schema name=minimal
[junit4] 2> 699801 INFO (qtp881279113-7232) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39639.solr.core.testSimple1.shard2.replica_n4' (registry 'solr.core.testSimple1.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c974329
[junit4] 2> 699802 INFO (qtp881279113-7232) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 699802 INFO (qtp881279113-7232) [ ] o.a.s.c.SolrCore [[testSimple1_shard2_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_72BC94B56E2A50AD-001/tempDir-001/node3/testSimple1_shard2_replica_n4], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_72BC94B56E2A50AD-001/tempDir-001/node3/./testSimple1_shard2_replica_n4/data/]
[junit4] 2> 699803 INFO (qtp881279113-7235) [ ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 699803 INFO (qtp881279113-7235) [ ] o.a.s.c.CoreContainer Creating SolrCore 'testSimple1_shard1_replica_n1' using configuration from collection testSimple1, trusted=true
[junit4] 2> 699803 INFO (qtp881279113-7235) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39639.solr.core.testSimple1.shard1.replica_n1' (registry 'solr.core.testSimple1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c974329
[junit4] 2> 699803 INFO (qtp881279113-7235) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 699803 INFO (qtp881279113-7235) [ ] o.a.s.c.SolrCore [[testSimple1_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_72BC94B56E2A50AD-001/tempDir-001/node3/testSimple1_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_72BC94B56E2A50AD-001/tempDir-001/node3/./testSimple1_shard1_replica_n1/data/]
[junit4] 2> 699832 INFO (qtp1950934723-7234) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 699832 INFO (qtp1950934723-7234) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 699832 INFO (qtp1950934723-7234) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 699832 INFO (qtp1950934723-7234) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 699833 INFO (qtp1950934723-7234) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@3134e358[testSimple1_shard2_replica_n6] main]
[junit4] 2> 699834 INFO (qtp1950934723-7234) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 699834 INFO (qtp1950934723-7234) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 699834 INFO (qtp1950934723-7234) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 699834 INFO (qtp1950934723-7234) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1584801804560891904
[junit4] 2> 699835 INFO (searcherExecutor-2772-thread-1) [ ] o.a.s.c.SolrCore [testSimple1_shard2_replica_n6] Registered new searcher Searcher@3134e358[testSimple1_shard2_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 699838 INFO (qtp1950934723-7234) [ ] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=9999ms
[junit4] 2> 699838 INFO (qtp881279113-7232) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 699838 INFO (qtp881279113-7232) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 699839 INFO (qtp881279113-7235) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 699839 INFO (qtp881279113-7235) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 699839 INFO (qtp881279113-7232) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 699839 INFO (qtp881279113-7232) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 699839 INFO (qtp881279113-7235) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 699839 INFO (qtp881279113-7235) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 699840 INFO (qtp881279113-7232) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@ed35dcf[testSimple1_shard2_replica_n4] main]
[junit4] 2> 699840 INFO (qtp881279113-7235) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@6644877f[testSimple1_shard1_replica_n1] main]
[junit4] 2> 699840 INFO (qtp881279113-7232) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 699840 INFO (qtp881279113-7235) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 699841 INFO (qtp881279113-7232) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 699841 INFO (qtp881279113-7235) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 699841 INFO (qtp881279113-7232) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 699841 INFO (qtp881279113-7235) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 699841 INFO (qtp1950934723-7231) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 699841 INFO (qtp1950934723-7231) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 699841 INFO (searcherExecutor-2775-thread-1) [ ] o.a.s.c.SolrCore [testSimple1_shard1_replica_n1] Registered new searcher Searcher@6644877f[testSimple1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 699841 INFO (searcherExecutor-2774-thread-1) [ ] o.a.s.c.SolrCore [testSimple1_shard2_replica_n4] Registered new searcher Searcher@ed35dcf[testSimple1_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 699841 INFO (qtp881279113-7235) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1584801804568231936
[junit4] 2> 699841 INFO (qtp881279113-7232) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1584801804568231936
[junit4] 2> 699842 INFO (qtp1950934723-7231) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 699842 INFO (qtp1950934723-7231) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 699843 INFO (qtp1950934723-7231) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@9969cfc[testSimple1_shard1_replica_n2] main]
[junit4] 2> 699844 INFO (qtp1950934723-7231) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 699844 INFO (qtp1950934723-7231) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 699844 INFO (qtp881279113-7235) [ ] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
[junit4] 2> 699844 INFO (qtp1950934723-7231) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 699845 INFO (searcherExecutor-2773-thread-1) [ ] o.a.s.c.SolrCore [testSimple1_shard1_replica_n2] Registered new searcher Searcher@9969cfc[testSimple1_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 699845 INFO (qtp1950934723-7231) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1584801804572426240
[junit4] 2> 699945 INFO (zkCallback-1210-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 699945 INFO (zkCallback-1211-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 700338 INFO (qtp1950934723-7234) [ ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 700338 INFO (qtp1950934723-7234) [ ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 700338 INFO (qtp1950934723-7234) [ ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:33729/solr/testSimple1_shard2_replica_n6/
[junit4] 2> 700339 INFO (qtp1950934723-7234) [ ] o.a.s.u.PeerSync PeerSync: core=testSimple1_shard2_replica_n6 url=https://127.0.0.1:33729/solr START replicas=[https://127.0.0.1:39639/solr/testSimple1_shard2_replica_n4/] nUpdates=100
[junit4] 2> 700343 INFO (qtp881279113-7318) [ ] o.a.s.c.S.Request [testSimple1_shard2_replica_n4] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 700344 DEBUG (ScheduledTrigger-2763-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:33729_solr, 127.0.0.1:45775_solr, 127.0.0.1:39639_solr]
[junit4] 2> 700345 INFO (qtp881279113-7235) [ ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 700345 INFO (qtp881279113-7235) [ ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 700345 INFO (qtp881279113-7235) [ ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:39639/solr/testSimple1_shard1_replica_n1/
[junit4] 2> 700345 INFO (qtp881279113-7235) [ ] o.a.s.u.PeerSync PeerSync: core=testSimple1_shard1_replica_n1 url=https://127.0.0.1:39639/solr START replicas=[https://127.0.0.1:33729/solr/testSimple1_shard1_replica_n2/] nUpdates=100
[junit4] 2> 700349 INFO (qtp1950934723-7321) [ ] o.a.s.c.S.Request [testSimple1_shard1_replica_n2] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 700639 INFO (qtp1950934723-7234) [ ] o.a.s.u.PeerSync PeerSync: core=testSimple1_shard2_replica_n6 url=https://127.0.0.1:33729/solr DONE. We have no versions. sync failed.
[junit4] 2> 700639 INFO (qtp1950934723-7234) [ ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 700639 INFO (qtp1950934723-7234) [ ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 700639 INFO (qtp1950934723-7234) [ ] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 700644 INFO (qtp1950934723-7234) [ ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:33729/solr/testSimple1_shard2_replica_n6/ shard2
[junit4] 2> 700646 INFO (qtp881279113-7235) [ ] o.a.s.u.PeerSync PeerSync: core=testSimple1_shard1_replica_n1 url=https://127.0.0.1:39639/solr DONE. We have no versions. sync failed.
[junit4] 2> 700646 INFO (qtp881279113-7235) [ ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 700646 INFO (qtp881279113-7235) [ ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 700646 INFO (qtp881279113-7235) [ ] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 700648 INFO (qtp881279113-7235) [ ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:39639/solr/testSimple1_shard1_replica_n1/ shard1
[junit4] 2> 700750 INFO (zkCallback-1211-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 700750 INFO (zkCallback-1210-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 700795 INFO (qtp1950934723-7234) [ ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 700799 INFO (qtp881279113-7235) [ ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 700808 INFO (qtp1950934723-7234) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n6&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2046
[junit4] 2> 700808 INFO (qtp881279113-7235) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n1&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2026
[junit4] 2> 700846 INFO (qtp881279113-7232) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=testSimple1_shard2_replica_n4&action=CREATE&numShards=2&collection=testSimple1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2061
[junit4] 2> 700849 INFO (qtp1950934723-7231) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testSimple1_shard1_replica_n2&action=CREATE&numShards=2&collection=testSimple1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2086
[junit4] 2> 700852 INFO (qtp1950934723-7215) [ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 700951 INFO (zkCallback-1210-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 700951 INFO (zkCallback-1211-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple1/state.json] for collection [testSimple1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 701345 DEBUG (ScheduledTrigger-2763-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:33729_solr, 127.0.0.1:45775_solr, 127.0.0.1:39639_solr]
[junit4] 2> 701852 INFO (qtp1950934723-7215) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&maxShardsPerNode=2&autoAddReplicas=true&name=testSimple1&nrtReplicas=2&action=CREATE&numShards=2&createNodeSet=127.0.0.1:39639_solr,127.0.0.1:33729_solr&wt=javabin&version=2} status=0 QTime=3411
[junit4] 2> 701853 INFO (qtp1950934723-7230) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&maxShardsPerNode=2&autoAddReplicas=false&name=testSimple2&nrtReplicas=2&action=CREATE&numShards=2&createNodeSet=127.0.0.1:33729_solr,127.0.0.1:45775_solr&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 701854 INFO (OverseerThreadFactory-2765-thread-2) [ ] o.a.s.c.CreateCollectionCmd Create collection testSimple2
[junit4] 2> 701854 INFO (OverseerCollectionConfigSetProcessor-99050112677117961-127.0.0.1:39639_solr-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 702057 INFO (OverseerStateUpdate-99050112677117961-127.0.0.1:39639_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testSimple2_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:45775/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 702058 INFO (OverseerStateUpdate-99050112677117961-127.0.0.1:39639_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testSimple2_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:33729/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 702058 INFO (OverseerStateUpdate-99050112677117961-127.0.0.1:39639_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple2",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"testSimple2_shard2_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:45775/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 702059 INFO (OverseerStateUpdate-99050112677117961-127.0.0.1:39639_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple2",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"testSimple2_shard2_replica_n6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:33729/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 702261 INFO (qtp1950934723-7217) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testSimple2_shard1_replica_n2&action=CREATE&numShards=2&collection=testSimple2&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 702261 INFO (qtp1950934723-7220) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=testSimple2_shard2_replica_n6&action=CREATE&numShards=2&collection=testSimple2&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 702280 INFO (qtp488349312-7218) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple2_shard1_replica_n1&action=CREATE&numShards=2&collection=testSimple2&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 702281 INFO (qtp488349312-7218) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 702283 INFO (qtp488349312-7233) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=testSimple2_shard2_replica_n4&action=CREATE&numShards=2&collection=testSimple2&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 702345 DEBUG (ScheduledTrigger-2763-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:33729_solr, 127.0.0.1:45775_solr, 127.0.0.1:39639_solr]
[junit4] 2> 702386 INFO (zkCallback-1210-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 702386 INFO (zkCallback-1204-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 702386 INFO (zkCallback-1210-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 702386 INFO (zkCallback-1204-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 703277 INFO (qtp1950934723-7220) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 703278 INFO (qtp1950934723-7217) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 703282 INFO (qtp1950934723-7220) [ ] o.a.s.s.IndexSchema [testSimple2_shard2_replica_n6] Schema name=minimal
[junit4] 2> 703298 INFO (qtp1950934723-7220) [ ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 703299 INFO (qtp1950934723-7220) [ ] o.a.s.c.CoreContainer Creating SolrCore 'testSimple2_shard2_replica_n6' using configuration from collection testSimple2, trusted=true
[junit4] 2> 703299 INFO (qtp1950934723-7217) [ ] o.a.s.s.IndexSchema [testSimple2_shard1_replica_n2] Schema name=minimal
[junit4] 2> 703300 INFO (qtp1950934723-7220) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33729.solr.core.testSimple2.shard2.replica_n6' (registry 'solr.core.testSimple2.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c974329
[junit4] 2> 703300 INFO (qtp1950934723-7220) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 703300 INFO (qtp1950934723-7220) [ ] o.a.s.c.SolrCore [[testSimple2_shard2_replica_n6] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_72BC94B56E2A50AD-001/tempDir-001/node1/testSimple2_shard2_replica_n6], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_72BC94B56E2A50AD-001/tempDir-001/node1/./testSimple2_shard2_replica_n6/data/]
[junit4] 2> 703301 INFO (qtp1950934723-7217) [ ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 703301 INFO (qtp1950934723-7217) [ ] o.a.s.c.CoreContainer Creating SolrCore 'testSimple2_shard1_replica_n2' using configuration from collection testSimple2, trusted=true
[junit4] 2> 703302 INFO (qtp1950934723-7217) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33729.solr.core.testSimple2.shard1.replica_n2' (registry 'solr.core.testSimple2.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c974329
[junit4] 2> 703302 INFO (qtp1950934723-7217) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 703302 INFO (qtp1950934723-7217) [ ] o.a.s.c.SolrCore [[testSimple2_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_72BC94B56E2A50AD-001/tempDir-001/node1/testSimple2_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_72BC94B56E2A50AD-001/tempDir-001/node1/./testSimple2_shard1_replica_n2/data/]
[junit4] 2> 703306 INFO (qtp488349312-7233) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 703310 INFO (qtp488349312-7218) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 703311 INFO (qtp488349312-7233) [ ] o.a.s.s.IndexSchema [testSimple2_shard2_replica_n4] Schema name=minimal
[junit4] 2> 703312 INFO (qtp488349312-7233) [ ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 703312 INFO (qtp488349312-7233) [ ] o.a.s.c.CoreContainer Creating SolrCore 'testSimple2_shard2_replica_n4' using configuration from collection testSimple2, trusted=true
[junit4] 2> 703313 INFO (qtp488349312-7233) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45775.solr.core.testSimple2.shard2.replica_n4' (registry 'solr.core.testSimple2.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c974329
[junit4] 2> 703313 INFO (qtp488349312-7233) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 703313 INFO (qtp488349312-7233) [ ] o.a.s.c.SolrCore [[testSimple2_shard2_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_72BC94B56E2A50AD-001/tempDir-001/node2/testSimple2_shard2_replica_n4], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_72BC94B56E2A50AD-001/tempDir-001/node2/./testSimple2_shard2_replica_n4/data/]
[junit4] 2> 703315 INFO (qtp488349312-7218) [ ] o.a.s.s.IndexSchema [testSimple2_shard1_replica_n1] Schema name=minimal
[junit4] 2> 703317 INFO (qtp488349312-7218) [ ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 703317 INFO (qtp488349312-7218) [ ] o.a.s.c.CoreContainer Creating SolrCore 'testSimple2_shard1_replica_n1' using configuration from collection testSimple2, trusted=true
[junit4] 2> 703317 INFO (qtp488349312-7218) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45775.solr.core.testSimple2.shard1.replica_n1' (registry 'solr.core.testSimple2.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c974329
[junit4] 2> 703317 INFO (qtp488349312-7218) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 703317 INFO (qtp488349312-7218) [ ] o.a.s.c.SolrCore [[testSimple2_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_72BC94B56E2A50AD-001/tempDir-001/node2/testSimple2_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_72BC94B56E2A50AD-001/tempDir-001/node2/./testSimple2_shard1_replica_n1/data/]
[junit4] 2> 703345 DEBUG (ScheduledTrigger-2763-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:33729_solr, 127.0.0.1:45775_solr, 127.0.0.1:39639_solr]
[junit4] 2> 703351 INFO (qtp488349312-7233) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 703351 INFO (qtp488349312-7233) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 703352 INFO (qtp488349312-7233) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 703352 INFO (qtp488349312-7233) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 703353 INFO (qtp488349312-7233) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@64b25632[testSimple2_shard2_replica_n4] main]
[junit4] 2> 703354 INFO (qtp488349312-7233) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 703354 INFO (qtp488349312-7233) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 703355 INFO (qtp488349312-7233) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 703355 INFO (qtp1950934723-7220) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 703355 INFO (qtp1950934723-7220) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 703355 INFO (searcherExecutor-2794-thread-1) [ ] o.a.s.c.SolrCore [testSimple2_shard2_replica_n4] Registered new searcher Searcher@64b25632[testSimple2_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 703355 INFO (qtp488349312-7233) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1584801808252928000
[junit4] 2> 703355 INFO (qtp1950934723-7217) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 703355 INFO (qtp1950934723-7217) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 703356 INFO (qtp1950934723-7220) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 703356 INFO (qtp1950934723-7220) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 703356 INFO (qtp1950934723-7217) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 703356 INFO (qtp1950934723-7217) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 703356 INFO (qtp1950934723-7220) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@270c688b[testSimple2_shard2_replica_n6] main]
[junit4] 2> 703357 INFO (qtp1950934723-7220) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 703357 INFO (qtp1950934723-7217) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@17cd5800[testSimple2_shard1_replica_n2] main]
[junit4] 2> 703357 INFO (qtp1950934723-7220) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 703357 INFO (qtp488349312-7218) [ ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 703357 INFO (qtp488349312-7218) [ ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 703357 INFO (qtp1950934723-7217) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 703357 INFO (qtp1950934723-7217) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 703357 INFO (qtp1950934723-7220) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 703358 INFO (qtp1950934723-7217) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 703358 INFO (qtp488349312-7218) [ ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 703358 INFO (qtp488349312-7218) [ ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 703358 INFO (searcherExecutor-2792-thread-1) [ ] o.a.s.c.SolrCore [testSimple2_shard2_replica_n6] Registered new searcher Searcher@270c688b[testSimple2_shard2_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 703358 INFO (qtp1950934723-7220) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1584801808256073728
[junit4] 2> 703358 INFO (qtp488349312-7233) [ ] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=9999ms
[junit4] 2> 703358 INFO (searcherExecutor-2793-thread-1) [ ] o.a.s.c.SolrCore [testSimple2_shard1_replica_n2] Registered new searcher Searcher@17cd5800[testSimple2_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 703358 INFO (qtp1950934723-7217) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1584801808256073728
[junit4] 2> 703359 INFO (qtp488349312-7218) [ ] o.a.s.s.SolrIndexSearcher Opening [Searcher@9ac2c53[testSimple2_shard1_replica_n1] main]
[junit4] 2> 703359 INFO (qtp488349312-7218) [ ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 703359 INFO (qtp488349312-7218) [ ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 703360 INFO (qtp488349312-7218) [ ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 703360 INFO (searcherExecutor-2795-thread-1) [ ] o.a.s.c.SolrCore [testSimple2_shard1_replica_n1] Registered new searcher Searcher@9ac2c53[testSimple2_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 703360 INFO (qtp488349312-7218) [ ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1584801808258170880
[junit4] 2> 703360 INFO (qtp1950934723-7217) [ ] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
[junit4] 2> 703462 INFO (zkCallback-1210-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 703462 INFO (zkCallback-1210-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 703462 INFO (zkCallback-1204-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 703462 INFO (zkCallback-1204-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 703859 INFO (qtp488349312-7233) [ ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 703859 INFO (qtp488349312-7233) [ ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 703859 INFO (qtp488349312-7233) [ ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:45775/solr/testSimple2_shard2_replica_n4/
[junit4] 2> 703859 INFO (qtp488349312-7233) [ ] o.a.s.u.PeerSync PeerSync: core=testSimple2_shard2_replica_n4 url=https://127.0.0.1:45775/solr START replicas=[https://127.0.0.1:33729/solr/testSimple2_shard2_replica_n6/] nUpdates=100
[junit4] 2> 703861 INFO (qtp1950934723-7217) [ ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 703861 INFO (qtp1950934723-7217) [ ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 703861 INFO (qtp1950934723-7217) [ ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:33729/solr/testSimple2_shard1_replica_n2/
[junit4] 2> 703861 INFO (qtp1950934723-7217) [ ] o.a.s.u.PeerSync PeerSync: core=testSimple2_shard1_replica_n2 url=https://127.0.0.1:33729/solr START replicas=[https://127.0.0.1:45775/solr/testSimple2_shard1_replica_n1/] nUpdates=100
[junit4] 2> 703863 INFO (qtp1950934723-7321) [ ] o.a.s.c.S.Request [testSimple2_shard2_replica_n6] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 703866 INFO (qtp488349312-7336) [ ] o.a.s.c.S.Request [testSimple2_shard1_replica_n1] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 704160 INFO (qtp488349312-7233) [ ] o.a.s.u.PeerSync PeerSync: core=testSimple2_shard2_replica_n4 url=https://127.0.0.1:45775/solr DONE. We have no versions. sync failed.
[junit4] 2> 704160 INFO (qtp488349312-7233) [ ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 704160 INFO (qtp488349312-7233) [ ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 704160 INFO (qtp488349312-7233) [ ] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 704162 INFO (qtp1950934723-7217) [ ] o.a.s.u.PeerSync PeerSync: core=testSimple2_shard1_replica_n2 url=https://127.0.0.1:33729/solr DONE. We have no versions. sync failed.
[junit4] 2> 704162 INFO (qtp1950934723-7217) [ ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 704162 INFO (qtp1950934723-7217) [ ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 704162 INFO (qtp1950934723-7217) [ ] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 704164 INFO (qtp488349312-7233) [ ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:45775/solr/testSimple2_shard2_replica_n4/ shard2
[junit4] 2> 704165 INFO (qtp1950934723-7217) [ ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:33729/solr/testSimple2_shard1_replica_n2/ shard1
[junit4] 2> 704266 INFO (zkCallback-1210-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 704266 INFO (zkCallback-1210-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 704266 INFO (zkCallback-1204-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 704266 INFO (zkCallback-1204-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 704315 INFO (qtp488349312-7233) [ ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 704315 INFO (qtp1950934723-7217) [ ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 704325 INFO (qtp1950934723-7217) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testSimple2_shard1_replica_n2&action=CREATE&numShards=2&collection=testSimple2&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2063
[junit4] 2> 704325 INFO (qtp488349312-7233) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=testSimple2_shard2_replica_n4&action=CREATE&numShards=2&collection=testSimple2&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2041
[junit4] 2> 704345 DEBUG (ScheduledTrigger-2763-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:33729_solr, 127.0.0.1:45775_solr, 127.0.0.1:39639_solr]
[junit4] 2> 704361 INFO (qtp1950934723-7220) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=testSimple2_shard2_replica_n6&action=CREATE&numShards=2&collection=testSimple2&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2100
[junit4] 2> 704363 INFO (qtp488349312-7218) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple2_shard1_replica_n1&action=CREATE&numShards=2&collection=testSimple2&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2082
[junit4] 2> 704367 INFO (qtp1950934723-7230) [ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 704463 INFO (zkCallback-1204-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 704463 INFO (zkCallback-1210-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 704463 INFO (zkCallback-1204-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 704463 INFO (zkCallback-1210-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple2/state.json] for collection [testSimple2] has occurred - updating... (live nodes size: [3])
[junit4] 2> 705345 DEBUG (ScheduledTrigger-2763-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:33729_solr, 127.0.0.1:45775_solr, 127.0.0.1:39639_solr]
[junit4] 2> 705367 INFO (qtp1950934723-7230) [ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&maxShardsPerNode=2&autoAddReplicas=false&name=testSimple2&nrtReplicas=2&action=CREATE&numShards=2&createNodeSet=127.0.0.1:33729_solr,127.0.0.1:45775_solr&wt=javabin&version=2} status=0 QTime=3513
[junit4] 2> 705367 INFO (qtp1950934723-7303) [ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&maxShardsPerNode=3&autoAddReplicas=false&name=testSimple3&nrtReplicas=1&action=CREATE&numShards=3&createNodeSet=127.0.0.1:39639_solr&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 705368 INFO (OverseerThreadFactory-2765-thread-3) [ ] o.a.s.c.CreateCollectionCmd Create collection testSimple3
[junit4] 2> 705368 INFO (OverseerCollectionConfigSetProcessor-99050112677117961-127.0.0.1:39639_solr-n_0000000000) [ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 705571 INFO (OverseerStateUpdate-99050112677117961-127.0.0.1:39639_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple3",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testSimple3_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:39639/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 705572 INFO (OverseerStateUpdate-99050112677117961-127.0.0.1:39639_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple3",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"testSimple3_shard2_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:39639/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 705572 INFO (OverseerStateUpdate-99050112677117961-127.0.0.1:39639_solr-n_0000000000) [ ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testSimple3",
[junit4] 2> "shard":"shard3",
[junit4] 2> "core":"testSimple3_shard3_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:39639/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 705776 INFO (qtp881279113-7318) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf&newCollection=true&name=testSimple3_shard3_replica_n4&action=CREATE&numShards=3&collection=testSimple3&shard=shard3&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 705776 INFO (qtp881279113-7237) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testSimple3_shard2_replica_n2&action=CREATE&numShards=3&collection=testSimple3&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 705776 INFO (qtp881279113-7223) [ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testSimple3_shard1_replica_n1&action=CREATE&numShards=3&collection=testSimple3&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 705878 INFO (zkCallback-1211-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple3/state.json] for collection [testSimple3] has occurred - updating... (live nodes size: [3])
[junit4] 2> 705878 INFO (zkCallback-1211-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testSimple3/state.json] for collection [testSimple3] has occurred - updating... (live nodes size: [3])
[junit4] 2> 706346 DEBUG (ScheduledTrigger-2763-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:33729_solr, 127.0.0.1:45775_solr, 127.0.0.1:39639_solr]
[junit4] 2> 706781 INFO (qtp881279113-7237) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 706781 INFO (qtp881279113-7318) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 706784 INFO (qtp881279113-7223) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
[junit4] 2> 706786 INFO (qtp881279113-7318) [ ] o.a.s.s.IndexSchema [testSimple3_shard3_replica_n4] Schema name=minimal
[junit4] 2> 706787 INFO (qtp881279113-7237) [ ] o.a.s.s.IndexSchema [testSimple3_shard2_replica_n2] Schema name=minimal
[junit4] 2> 706787 INFO (qtp881279113-7318) [ ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 706787 INFO (qtp881279113-7318) [ ] o.a.s.c.CoreContainer Creating SolrCore 'testSimple3_shard3_replica_n4' using configuration from collection testSimple3, trusted=true
[junit4] 2> 706787 INFO (qtp881279113-7318) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39639.solr.core.testSimple3.shard3.replica_n4' (registry 'solr.core.testSimple3.shard3.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c974329
[junit4] 2> 706788 INFO (qtp881279113-7318) [ ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 706788 INFO (qtp881279113-7318) [ ] o.a.s.c.SolrCore [[testSimple3_shard3_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.AutoAddReplicasIntegrationTest_72BC94B56E2A50AD-001/tempDir-001/node3/testSimple3_shard3_replica_n4], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autosc
[...truncated too long message...]
ter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2b44697d: rootName = solr_40279, domain = solr.core.testcollection.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.testcollection.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@1afe952e
[junit4] 2> 1905374 INFO (coreCloseExecutor-5816-thread-1) [ ] o.a.s.c.SolrCore [testcollection_shard2_replica_n7] CLOSING SolrCore org.apache.solr.core.SolrCore@ac9c8f7
[junit4] 2> 1905374 INFO (coreCloseExecutor-5816-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testcollection.shard2.replica_n7, tag=180996343
[junit4] 2> 1905374 INFO (coreCloseExecutor-5815-thread-2) [ ] o.a.s.c.SolrCore [testcollection_shard2_replica_n5] CLOSING SolrCore org.apache.solr.core.SolrCore@731abd77
[junit4] 2> 1905374 INFO (coreCloseExecutor-5816-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@72488567: rootName = solr_33649, domain = solr.core.testcollection.shard2.replica_n7, service url = null, agent id = null] for registry solr.core.testcollection.shard2.replica_n7 / com.codahale.metrics.MetricRegistry@30de0246
[junit4] 2> 1905379 INFO (coreCloseExecutor-5816-thread-2) [ ] o.a.s.c.SolrCore [testcollection_shard1_replica_n3] CLOSING SolrCore org.apache.solr.core.SolrCore@768c5420
[junit4] 2> 1905381 INFO (coreCloseExecutor-5815-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testcollection.shard2.replica_n5, tag=1931132279
[junit4] 2> 1905381 INFO (coreCloseExecutor-5815-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@61d62808: rootName = solr_40279, domain = solr.core.testcollection.shard2.replica_n5, service url = null, agent id = null] for registry solr.core.testcollection.shard2.replica_n5 / com.codahale.metrics.MetricRegistry@77e4df66
[junit4] 2> 1905381 INFO (coreCloseExecutor-5816-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testcollection.shard1.replica_n3, tag=1988908064
[junit4] 2> 1905381 INFO (coreCloseExecutor-5816-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4570e3a2: rootName = solr_33649, domain = solr.core.testcollection.shard1.replica_n3, service url = null, agent id = null] for registry solr.core.testcollection.shard1.replica_n3 / com.codahale.metrics.MetricRegistry@31aeb28d
[junit4] 2> 1905385 INFO (coreCloseExecutor-5816-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testcollection.shard2.leader, tag=180996343
[junit4] 2> 1905385 INFO (coreCloseExecutor-5816-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testcollection.shard1.leader, tag=1988908064
[junit4] 2> 1905387 INFO (jetty-closer-2351-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@54987e95{/solr,null,UNAVAILABLE}
[junit4] 2> 1905388 INFO (coreCloseExecutor-5815-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testcollection.shard1.leader, tag=1984273722
[junit4] 2> 1905388 INFO (coreCloseExecutor-5815-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testcollection.shard2.leader, tag=1931132279
[junit4] 2> 1905389 INFO (jetty-closer-2351-thread-1) [ ] o.a.s.c.Overseer Overseer (id=99050191264612358-127.0.0.1:40279_solr-n_0000000000) closing
[junit4] 2> 1905389 INFO (OverseerStateUpdate-99050191264612358-127.0.0.1:40279_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:40279_solr
[junit4] 2> 1905389 WARN (OverseerAutoScalingTriggerThread-99050191264612358-127.0.0.1:40279_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 1905390 INFO (jetty-closer-2351-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4f61155f{/solr,null,UNAVAILABLE}
[junit4] 2> 1905390 ERROR (SUITE-TestAuthenticationFramework-seed#[72BC94B56E2A50AD]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1905391 INFO (SUITE-TestAuthenticationFramework-seed#[72BC94B56E2A50AD]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:40847 40847
[junit4] 2> 1911262 INFO (Thread-4512) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:40847 40847
[junit4] 2> 1911262 WARN (Thread-4512) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/configs/solrCloudCollectionConfig
[junit4] 2> 3 /solr/aliases.json
[junit4] 2> 3 /solr/clusterprops.json
[junit4] 2> 2 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 24 /solr/collections/testcollection/state.json
[junit4] 2> 3 /solr/clusterstate.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/live_nodes
[junit4] 2> 3 /solr/collections
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_72BC94B56E2A50AD-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {id=PostingsFormat(name=Memory)}, docValues:{}, maxPointsInLeafNode=1487, maxMBSortInHeap=7.3675779248495274, sim=RandomSimilarity(queryNorm=false): {}, locale=id-ID, timezone=Libya
[junit4] 2> NOTE: Linux 4.10.0-37-generic amd64/Oracle Corporation 10-ea (64-bit)/cpus=8,threads=1,free=279864088,total=476577792
[junit4] 2> NOTE: All tests run in this JVM: [HdfsThreadLeakTest, TestSizeLimitedDistributedMap, TestPushWriter, TestComplexPhraseQParserPlugin, PeerSyncReplicationTest, TestUnifiedSolrHighlighter, BooleanFieldTest, TestAtomicUpdateErrorCases, TestFaceting, DistributedFacetPivotLongTailTest, TestStressLucene, TestSurroundQueryParser, DocumentAnalysisRequestHandlerTest, RequestHandlersTest, TestSortByMinMaxFunction, AnalysisErrorHandlingTest, ManagedSchemaRoundRobinCloudTest, TestMultiValuedNumericRangeQuery, SolrCmdDistributorTest, TestDocTermOrds, TestDynamicLoading, ZkStateReaderTest, TestSolrCloudWithKerberosAlt, TestHighFrequencyDictionaryFactory, TestFastLRUCache, TestJmxIntegration, SynonymTokenizerTest, TestConfigReload, RuleEngineTest, TestSystemCollAutoCreate, CdcrBootstrapTest, LegacyCloudClusterPropTest, TestCollectionAPI, TestConfigOverlay, SpatialRPTFieldTypeTest, BadIndexSchemaTest, HdfsRecoveryZkTest, ShowFileRequestHandlerTest, DOMUtilTest, TriggerIntegrationTest, TestDeleteCollectionOnDownNodes, ChaosMonkeySafeLeaderTest, AnalyticsQueryTest, TestTrackingShardHandlerFactory, TestScoreJoinQPScore, AddReplicaTest, StatsReloadRaceTest, TestBlendedInfixSuggestions, TestMissingGroups, SuggesterFSTTest, TestSchemaResource, TestLeaderElectionZkExpiry, TestSSLRandomization, ClassificationUpdateProcessorFactoryTest, TestExclusionRuleCollectionAccess, DistributedIntervalFacetingTest, DebugComponentTest, TestLuceneMatchVersion, UtilsToolTest, TestInPlaceUpdatesStandalone, ZkSolrClientTest, DistributedExpandComponentTest, TestCollationField, SampleTest, RegexBytesRefFilterTest, WrapperMergePolicyFactoryTest, TestUseDocValuesAsStored, PreAnalyzedFieldTest, TestInitParams, DistributedVersionInfoTest, DistributedSuggestComponentTest, AutoAddReplicasIntegrationTest, TemplateUpdateProcessorTest, SparseHLLTest, HttpTriggerListenerTest, SearchRateTriggerTest, CdcrRequestHandlerTest, TestDelegationWithHadoopAuth, TestPKIAuthenticationPlugin, TolerantUpdateProcessorTest, NotRequiredUniqueKeyTest, TestQueryWrapperFilter, DistribDocExpirationUpdateProcessorTest, NumericFieldsTest, PolyFieldTest, SolrMetricReporterTest, PathHierarchyTokenizerFactoryTest, PrimUtilsTest, HttpPartitionTest, TestRandomFlRTGCloud, TestEmbeddedSolrServerAdminHandler, TestReRankQParserPlugin, TestOmitPositions, TestNumericTokenStream, ReplicaListTransformerTest, TestTolerantUpdateProcessorCloud, TestFastWriter, TestLockTree, SolrRequestParserTest, TestStressRecovery, TestIntervalFaceting, TestConfigSets, HdfsDirectoryFactoryTest, TestFieldCacheSort, FullHLLTest, SolrSlf4jReporterTest, MoveReplicaHDFSFailoverTest, TestStandardQParsers, AssignTest, DeleteShardTest, TestSolr4Spatial, TestExactStatsCache, TestRetrieveFieldsOptimizer, NumberUtilsTest, TestConfigSetsAPIExclusivity, PeerSyncWithIndexFingerprintCachingTest, BlockJoinFacetRandomTest, TestAnalyzedSuggestions, TestFieldCacheWithThreads, TestSimpleTrackingShardHandler, TestXIncludeConfig, OverseerRolesTest, ShardRoutingCustomTest, TestRecovery, TestRealTimeGet, DistributedTermsComponentTest, SpellCheckComponentTest, ConvertedLegacyTest, TestSort, TestFunctionQuery, TestLazyCores, DirectUpdateHandlerTest, SoftAutoCommitTest, ActionThrottleTest, AliasIntegrationTest, AsyncCallRequestStatusResponseTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, ConcurrentDeleteAndCreateCollectionTest, CreateCollectionCleanupTest, DeleteLastCustomShardedReplicaTest, DeleteStatusTest, LeaderFailoverAfterPartitionTest, MoveReplicaHDFSTest, OverseerModifyCollectionTest, OverseerStatusTest, OverseerTaskQueueTest, RestartWhileUpdatingTest, RollingRestartTest, SharedFSAutoReplicaFailoverTest, SimpleCollectionCreateDeleteTest, SolrCLIZkUtilsTest, TestAuthenticationFramework]
[junit4] Completed [542/749 (2!)] on J1 in 13.94s, 1 test, 1 error <<< FAILURES!
[...truncated 40913 lines...]