You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/02/11 16:51:08 UTC
[JENKINS] Lucene-Solr-Tests-master - Build # 4221 - Unstable
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/4221/
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.client.solrj.response.TestDelegationTokenResponse
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.client.solrj.response.TestDelegationTokenResponse: 1) Thread[id=16, name=Log4j2-TF-1-AsyncLoggerConfig-1, state=TIMED_WAITING, group=TGRP-TestDelegationTokenResponse] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at app//com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38) at app//com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56) at app//com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159) at app//com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.client.solrj.response.TestDelegationTokenResponse:
1) Thread[id=16, name=Log4j2-TF-1-AsyncLoggerConfig-1, state=TIMED_WAITING, group=TGRP-TestDelegationTokenResponse]
at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
at app//com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
at app//com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
at app//com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
at app//com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
at __randomizedtesting.SeedInfo.seed([4C12147BB96B75F2]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.client.solrj.response.TestDelegationTokenResponse
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=16, name=Log4j2-TF-1-AsyncLoggerConfig-1, state=TIMED_WAITING, group=TGRP-TestDelegationTokenResponse] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at app//com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38) at app//com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56) at app//com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159) at app//com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=16, name=Log4j2-TF-1-AsyncLoggerConfig-1, state=TIMED_WAITING, group=TGRP-TestDelegationTokenResponse]
at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
at app//com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
at app//com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
at app//com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
at app//com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
at __randomizedtesting.SeedInfo.seed([4C12147BB96B75F2]:0)
Build Log:
[...truncated 16121 lines...]
[junit4] Suite: org.apache.solr.client.solrj.response.TestDelegationTokenResponse
[junit4] 2> Feb 11, 2020 4:22:36 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> Feb 11, 2020 4:22:56 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.client.solrj.response.TestDelegationTokenResponse:
[junit4] 2> 1) Thread[id=16, name=Log4j2-TF-1-AsyncLoggerConfig-1, state=TIMED_WAITING, group=TGRP-TestDelegationTokenResponse]
[junit4] 2> at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
[junit4] 2> at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
[junit4] 2> at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
[junit4] 2> at app//com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] 2> at app//com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] 2> at app//com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] 2> at app//com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] 2> at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
[junit4] 2> Feb 11, 2020 4:22:56 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=16, name=Log4j2-TF-1-AsyncLoggerConfig-1, state=TIMED_WAITING, group=TGRP-TestDelegationTokenResponse]
[junit4] 2> AsyncLogger error handling event seq=0, value='null': java.lang.InterruptedException: null
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056)
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2133)
[junit4] 2> at com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] 2> at com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:834)
[junit4] 2> AsyncLogger error handling event seq=1, value='null': java.lang.InterruptedException: null
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056)
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2133)
[junit4] 2> at com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] 2> at com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:834)
[junit4] 2> AsyncLogger error handling event seq=2, value='null': java.lang.InterruptedException: null
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056)
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2133)
[junit4] 2> at com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] 2> at com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:834)
[junit4] 2> AsyncLogger error handling event seq=3, value='null': java.lang.InterruptedException: null
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056)
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2133)
[junit4] 2> at com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] 2> at com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:834)
[junit4] 2> AsyncLogger error handling event seq=4, value='null': java.lang.InterruptedException: null
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056)
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2133)
[junit4] 2> at com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] 2> at com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:834)
[junit4] 2> Feb 11, 2020 4:22:59 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=16, name=Log4j2-TF-1-AsyncLoggerConfig-1, state=TIMED_WAITING, group=TGRP-TestDelegationTokenResponse]
[junit4] 2> at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
[junit4] 2> at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
[junit4] 2> at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
[junit4] 2> at app//com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] 2> at app//com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] 2> at app//com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] 2> at app//com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] 2> at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene84): {}, docValues:{}, maxPointsInLeafNode=972, maxMBSortInHeap=6.372031917775164, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@3fb02ca1), locale=zgh, timezone=America/Monterrey
[junit4] 2> NOTE: Linux 4.4.0-170-generic amd64/Oracle Corporation 11.0.4 (64-bit)/cpus=8,threads=2,free=474826136,total=528482304
[junit4] 2> NOTE: All tests run in this JVM: [TestDelegationTokenResponse]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestDelegationTokenResponse -Dtests.seed=4C12147BB96B75F2 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=zgh -Dtests.timezone=America/Monterrey -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J1 | TestDelegationTokenResponse (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.client.solrj.response.TestDelegationTokenResponse:
[junit4] > 1) Thread[id=16, name=Log4j2-TF-1-AsyncLoggerConfig-1, state=TIMED_WAITING, group=TGRP-TestDelegationTokenResponse]
[junit4] > at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
[junit4] > at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
[junit4] > at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
[junit4] > at app//com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] > at app//com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] > at app//com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] > at app//com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] > at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
[junit4] > at __randomizedtesting.SeedInfo.seed([4C12147BB96B75F2]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=16, name=Log4j2-TF-1-AsyncLoggerConfig-1, state=TIMED_WAITING, group=TGRP-TestDelegationTokenResponse]
[junit4] > at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
[junit4] > at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
[junit4] > at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
[junit4] > at app//com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] > at app//com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] > at app//com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] > at app//com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] > at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
[junit4] > at __randomizedtesting.SeedInfo.seed([4C12147BB96B75F2]:0)
[junit4] Completed [15/207 (1!)] on J1 in 27.39s, 3 tests, 2 errors <<< FAILURES!
[...truncated 51908 lines...]
[JENKINS] Lucene-Solr-Tests-master - Build # 4223 - Still Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/4223/
4 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.TestDocumentBuilder
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.TestDocumentBuilder: 1) Thread[id=16, name=Log4j2-TF-1-AsyncLoggerConfig-1, state=TIMED_WAITING, group=TGRP-TestDocumentBuilder] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at app//com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38) at app//com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56) at app//com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159) at app//com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.TestDocumentBuilder:
1) Thread[id=16, name=Log4j2-TF-1-AsyncLoggerConfig-1, state=TIMED_WAITING, group=TGRP-TestDocumentBuilder]
at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
at app//com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
at app//com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
at app//com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
at app//com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
at __randomizedtesting.SeedInfo.seed([815B26FEB815D31D]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.TestDocumentBuilder
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=16, name=Log4j2-TF-1-AsyncLoggerConfig-1, state=TIMED_WAITING, group=TGRP-TestDocumentBuilder] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at app//com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38) at app//com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56) at app//com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159) at app//com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=16, name=Log4j2-TF-1-AsyncLoggerConfig-1, state=TIMED_WAITING, group=TGRP-TestDocumentBuilder]
at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
at app//com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
at app//com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
at app//com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
at app//com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
at __randomizedtesting.SeedInfo.seed([815B26FEB815D31D]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.client.solrj.CollectionAdminRequestRequiredParamsTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.client.solrj.CollectionAdminRequestRequiredParamsTest: 1) Thread[id=16, name=Log4j2-TF-1-AsyncLoggerConfig-1, state=TIMED_WAITING, group=TGRP-CollectionAdminRequestRequiredParamsTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at app//com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38) at app//com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56) at app//com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159) at app//com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.client.solrj.CollectionAdminRequestRequiredParamsTest:
1) Thread[id=16, name=Log4j2-TF-1-AsyncLoggerConfig-1, state=TIMED_WAITING, group=TGRP-CollectionAdminRequestRequiredParamsTest]
at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
at app//com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
at app//com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
at app//com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
at app//com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
at __randomizedtesting.SeedInfo.seed([56A7288AF3F7B73F]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.client.solrj.CollectionAdminRequestRequiredParamsTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=16, name=Log4j2-TF-1-AsyncLoggerConfig-1, state=TIMED_WAITING, group=TGRP-CollectionAdminRequestRequiredParamsTest] at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123) at app//com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38) at app//com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56) at app//com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159) at app//com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125) at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=16, name=Log4j2-TF-1-AsyncLoggerConfig-1, state=TIMED_WAITING, group=TGRP-CollectionAdminRequestRequiredParamsTest]
at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
at app//com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
at app//com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
at app//com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
at app//com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
at __randomizedtesting.SeedInfo.seed([56A7288AF3F7B73F]:0)
Build Log:
[...truncated 12514 lines...]
[junit4] Suite: org.apache.solr.TestDocumentBuilder
[junit4] 1> doc1: SolrInputDocument(fields: [field1=value1, field2=value1, field3=value2, field4=15, field5=[45, 33, 20]])
[junit4] 1> clone: SolrInputDocument(fields: [field1=value1, field2=value1, field3=value2, field4=15, field5=[45, 33, 20]])
[junit4] 2> Feb 11, 2020 7:25:20 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> Feb 11, 2020 7:25:40 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.TestDocumentBuilder:
[junit4] 2> 1) Thread[id=16, name=Log4j2-TF-1-AsyncLoggerConfig-1, state=TIMED_WAITING, group=TGRP-TestDocumentBuilder]
[junit4] 2> at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
[junit4] 2> at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
[junit4] 2> at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
[junit4] 2> at app//com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] 2> at app//com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] 2> at app//com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] 2> at app//com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] 2> at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
[junit4] 2> Feb 11, 2020 7:25:40 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=16, name=Log4j2-TF-1-AsyncLoggerConfig-1, state=TIMED_WAITING, group=TGRP-TestDocumentBuilder]
[junit4] 2> AsyncLogger error handling event seq=0, value='null': java.lang.InterruptedException: null
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056)
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2133)
[junit4] 2> at com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] 2> at com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:834)
[junit4] 2> AsyncLogger error handling event seq=1, value='null': java.lang.InterruptedException: null
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056)
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2133)
[junit4] 2> at com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] 2> at com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:834)
[junit4] 2> AsyncLogger error handling event seq=2, value='null': java.lang.InterruptedException: null
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056)
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2133)
[junit4] 2> at com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] 2> at com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:834)
[junit4] 2> AsyncLogger error handling event seq=3, value='null': java.lang.InterruptedException: null
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056)
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2133)
[junit4] 2> at com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] 2> at com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:834)
[junit4] 2> AsyncLogger error handling event seq=4, value='null': java.lang.InterruptedException: null
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056)
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2133)
[junit4] 2> at com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] 2> at com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:834)
[junit4] 2> Feb 11, 2020 7:25:42 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=16, name=Log4j2-TF-1-AsyncLoggerConfig-1, state=TIMED_WAITING, group=TGRP-TestDocumentBuilder]
[junit4] 2> at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
[junit4] 2> at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
[junit4] 2> at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
[junit4] 2> at app//com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] 2> at app//com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] 2> at app//com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] 2> at app//com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] 2> at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene84): {}, docValues:{}, maxPointsInLeafNode=161, maxMBSortInHeap=5.134413740473151, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@6fddd102), locale=ast-ES, timezone=Australia/Broken_Hill
[junit4] 2> NOTE: Linux 4.4.0-170-generic amd64/Oracle Corporation 11.0.4 (64-bit)/cpus=8,threads=2,free=473783200,total=528482304
[junit4] 2> NOTE: All tests run in this JVM: [TestDocumentBuilder]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestDocumentBuilder -Dtests.seed=815B26FEB815D31D -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=ast-ES -Dtests.timezone=Australia/Broken_Hill -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J2 | TestDocumentBuilder (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.TestDocumentBuilder:
[junit4] > 1) Thread[id=16, name=Log4j2-TF-1-AsyncLoggerConfig-1, state=TIMED_WAITING, group=TGRP-TestDocumentBuilder]
[junit4] > at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
[junit4] > at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
[junit4] > at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
[junit4] > at app//com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] > at app//com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] > at app//com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] > at app//com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] > at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
[junit4] > at __randomizedtesting.SeedInfo.seed([815B26FEB815D31D]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=16, name=Log4j2-TF-1-AsyncLoggerConfig-1, state=TIMED_WAITING, group=TGRP-TestDocumentBuilder]
[junit4] > at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
[junit4] > at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
[junit4] > at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
[junit4] > at app//com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] > at app//com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] > at app//com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] > at app//com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] > at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
[junit4] > at __randomizedtesting.SeedInfo.seed([815B26FEB815D31D]:0)
[junit4] Completed [10/904 (1!)] on J2 in 23.53s, 1 test, 2 errors <<< FAILURES!
[...truncated 3498 lines...]
[junit4] Suite: org.apache.solr.client.solrj.CollectionAdminRequestRequiredParamsTest
[junit4] 2> Feb 11, 2020 7:57:15 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> Feb 11, 2020 7:57:35 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.client.solrj.CollectionAdminRequestRequiredParamsTest:
[junit4] 2> 1) Thread[id=16, name=Log4j2-TF-1-AsyncLoggerConfig-1, state=TIMED_WAITING, group=TGRP-CollectionAdminRequestRequiredParamsTest]
[junit4] 2> at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
[junit4] 2> at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
[junit4] 2> at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
[junit4] 2> at app//com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] 2> at app//com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] 2> at app//com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] 2> at app//com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] 2> at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
[junit4] 2> Feb 11, 2020 7:57:35 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=16, name=Log4j2-TF-1-AsyncLoggerConfig-1, state=TIMED_WAITING, group=TGRP-CollectionAdminRequestRequiredParamsTest]
[junit4] 2> AsyncLogger error handling event seq=0, value='null': java.lang.InterruptedException: null
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056)
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2133)
[junit4] 2> at com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] 2> at com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:834)
[junit4] 2> AsyncLogger error handling event seq=1, value='null': java.lang.InterruptedException: null
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056)
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2133)
[junit4] 2> at com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] 2> at com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:834)
[junit4] 2> AsyncLogger error handling event seq=2, value='null': java.lang.InterruptedException: null
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056)
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2133)
[junit4] 2> at com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] 2> at com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:834)
[junit4] 2> AsyncLogger error handling event seq=3, value='null': java.lang.InterruptedException: null
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056)
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2133)
[junit4] 2> at com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] 2> at com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:834)
[junit4] 2> AsyncLogger error handling event seq=4, value='null': java.lang.InterruptedException: null
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056)
[junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2133)
[junit4] 2> at com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] 2> at com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] 2> at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] 2> at java.base/java.lang.Thread.run(Thread.java:834)
[junit4] 2> Feb 11, 2020 7:57:37 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=16, name=Log4j2-TF-1-AsyncLoggerConfig-1, state=TIMED_WAITING, group=TGRP-CollectionAdminRequestRequiredParamsTest]
[junit4] 2> at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
[junit4] 2> at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
[junit4] 2> at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
[junit4] 2> at app//com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] 2> at app//com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] 2> at app//com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] 2> at app//com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] 2> at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@3b84f9be), locale=prg-001, timezone=Pacific/Truk
[junit4] 2> NOTE: Linux 4.4.0-170-generic amd64/Oracle Corporation 11.0.4 (64-bit)/cpus=8,threads=2,free=475165344,total=528482304
[junit4] 2> NOTE: All tests run in this JVM: [CollectionAdminRequestRequiredParamsTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CollectionAdminRequestRequiredParamsTest -Dtests.seed=56A7288AF3F7B73F -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=prg-001 -Dtests.timezone=Pacific/Truk -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.00s J1 | CollectionAdminRequestRequiredParamsTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.client.solrj.CollectionAdminRequestRequiredParamsTest:
[junit4] > 1) Thread[id=16, name=Log4j2-TF-1-AsyncLoggerConfig-1, state=TIMED_WAITING, group=TGRP-CollectionAdminRequestRequiredParamsTest]
[junit4] > at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
[junit4] > at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
[junit4] > at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
[junit4] > at app//com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] > at app//com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] > at app//com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] > at app//com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] > at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
[junit4] > at __randomizedtesting.SeedInfo.seed([56A7288AF3F7B73F]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=16, name=Log4j2-TF-1-AsyncLoggerConfig-1, state=TIMED_WAITING, group=TGRP-CollectionAdminRequestRequiredParamsTest]
[junit4] > at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
[junit4] > at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
[junit4] > at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
[junit4] > at app//com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] > at app//com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] > at app//com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] > at app//com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] > at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
[junit4] > at __randomizedtesting.SeedInfo.seed([56A7288AF3F7B73F]:0)
[junit4] Completed [6/207 (1!)] on J1 in 28.31s, 24 tests, 2 errors <<< FAILURES!
[...truncated 51945 lines...]
[JENKINS] Lucene-Solr-Tests-master - Build # 4222 - Still Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/4222/
1 tests failed.
FAILED: org.apache.solr.cloud.SystemCollectionCompatTest.testBackCompat
Error Message:
No live SolrServers available to handle this request:[https://127.0.0.1:37277/solr/.system]
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:37277/solr/.system]
at __randomizedtesting.SeedInfo.seed([8A06912BD667BF9D:FAF33282B6AF16EB]:0)
at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:345)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1143)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:906)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:838)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207)
at org.apache.solr.cloud.SystemCollectionCompatTest.setupSystemCollection(SystemCollectionCompatTest.java:118)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:976)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occurred while waiting response from server at: https://127.0.0.1:37277/solr/.system
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:676)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:265)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
... 43 more
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/java.net.SocketInputStream.socketRead0(Native Method)
at java.base/java.net.SocketInputStream.socketRead(SocketInputStream.java:115)
at java.base/java.net.SocketInputStream.read(SocketInputStream.java:168)
at java.base/java.net.SocketInputStream.read(SocketInputStream.java:140)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(SSLSocketInputRecord.java:448)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(SSLSocketInputRecord.java:68)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(SSLSocketImpl.java:1104)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:823)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:280)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:157)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:564)
... 47 more
Build Log:
[...truncated 14254 lines...]
[junit4] Suite: org.apache.solr.cloud.SystemCollectionCompatTest
[junit4] 2> 1807332 INFO (SUITE-SystemCollectionCompatTest-seed#[8A06912BD667BF9D]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.SystemCollectionCompatTest_8A06912BD667BF9D-001/data-dir-181-001
[junit4] 2> 1807333 WARN (SUITE-SystemCollectionCompatTest-seed#[8A06912BD667BF9D]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=30 numCloses=30
[junit4] 2> 1807333 INFO (SUITE-SystemCollectionCompatTest-seed#[8A06912BD667BF9D]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 1807333 INFO (SUITE-SystemCollectionCompatTest-seed#[8A06912BD667BF9D]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 1807334 INFO (SUITE-SystemCollectionCompatTest-seed#[8A06912BD667BF9D]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1807334 INFO (SUITE-SystemCollectionCompatTest-seed#[8A06912BD667BF9D]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.SystemCollectionCompatTest_8A06912BD667BF9D-001/tempDir-001
[junit4] 2> 1807334 INFO (SUITE-SystemCollectionCompatTest-seed#[8A06912BD667BF9D]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1807335 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1807335 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1807435 INFO (SUITE-SystemCollectionCompatTest-seed#[8A06912BD667BF9D]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:38201
[junit4] 2> 1807435 INFO (SUITE-SystemCollectionCompatTest-seed#[8A06912BD667BF9D]-worker) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:38201
[junit4] 2> 1807435 INFO (SUITE-SystemCollectionCompatTest-seed#[8A06912BD667BF9D]-worker) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:38201
[junit4] 2> 1807435 INFO (SUITE-SystemCollectionCompatTest-seed#[8A06912BD667BF9D]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 38201
[junit4] 2> 1807436 INFO (SUITE-SystemCollectionCompatTest-seed#[8A06912BD667BF9D]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1807438 INFO (zkConnectionManagerCallback-9653-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1807438 INFO (SUITE-SystemCollectionCompatTest-seed#[8A06912BD667BF9D]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1807442 INFO (SUITE-SystemCollectionCompatTest-seed#[8A06912BD667BF9D]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1807446 INFO (zkConnectionManagerCallback-9655-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1807446 INFO (SUITE-SystemCollectionCompatTest-seed#[8A06912BD667BF9D]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1807450 INFO (SUITE-SystemCollectionCompatTest-seed#[8A06912BD667BF9D]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1807454 INFO (zkConnectionManagerCallback-9657-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1807454 INFO (SUITE-SystemCollectionCompatTest-seed#[8A06912BD667BF9D]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1807558 WARN (jetty-launcher-9658-thread-1) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 1807558 INFO (jetty-launcher-9658-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 1807559 INFO (jetty-launcher-9658-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 1807559 INFO (jetty-launcher-9658-thread-1) [ ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 11.0.4+10-LTS
[junit4] 2> 1807560 WARN (jetty-launcher-9658-thread-2) [ ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
[junit4] 2> 1807560 INFO (jetty-launcher-9658-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 1807560 INFO (jetty-launcher-9658-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
[junit4] 2> 1807560 INFO (jetty-launcher-9658-thread-2) [ ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 11.0.4+10-LTS
[junit4] 2> 1807565 INFO (jetty-launcher-9658-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1807565 INFO (jetty-launcher-9658-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1807565 INFO (jetty-launcher-9658-thread-1) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 1807566 INFO (jetty-launcher-9658-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6e9113ee{/solr,null,AVAILABLE}
[junit4] 2> 1807567 INFO (jetty-launcher-9658-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@68dd0939{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:38231}
[junit4] 2> 1807567 INFO (jetty-launcher-9658-thread-1) [ ] o.e.j.s.Server Started @1807628ms
[junit4] 2> 1807567 INFO (jetty-launcher-9658-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38231}
[junit4] 2> 1807567 ERROR (jetty-launcher-9658-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1807567 INFO (jetty-launcher-9658-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1807567 INFO (jetty-launcher-9658-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 1807567 INFO (jetty-launcher-9658-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1807567 INFO (jetty-launcher-9658-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr
[junit4] 2> 1807567 INFO (jetty-launcher-9658-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-02-11T18:22:20.388720Z
[junit4] 2> 1807578 INFO (jetty-launcher-9658-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1807587 INFO (jetty-launcher-9658-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1807587 INFO (jetty-launcher-9658-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1807587 INFO (jetty-launcher-9658-thread-2) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 1807590 INFO (jetty-launcher-9658-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7cfa4b4{/solr,null,AVAILABLE}
[junit4] 2> 1807591 INFO (jetty-launcher-9658-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7b19b1d8{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:37277}
[junit4] 2> 1807591 INFO (jetty-launcher-9658-thread-2) [ ] o.e.j.s.Server Started @1807652ms
[junit4] 2> 1807591 INFO (jetty-launcher-9658-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37277}
[junit4] 2> 1807591 ERROR (jetty-launcher-9658-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1807591 INFO (jetty-launcher-9658-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1807591 INFO (jetty-launcher-9658-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 1807591 INFO (jetty-launcher-9658-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1807591 INFO (jetty-launcher-9658-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr
[junit4] 2> 1807591 INFO (jetty-launcher-9658-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-02-11T18:22:20.412634Z
[junit4] 2> 1807594 INFO (zkConnectionManagerCallback-9660-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1807594 INFO (jetty-launcher-9658-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1807595 INFO (jetty-launcher-9658-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1807598 INFO (jetty-launcher-9658-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1807598 INFO (zkConnectionManagerCallback-9662-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1807598 INFO (jetty-launcher-9658-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1807599 INFO (jetty-launcher-9658-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1808014 INFO (jetty-launcher-9658-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 1808015 WARN (jetty-launcher-9658-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@57bbfbe[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1808015 WARN (jetty-launcher-9658-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@57bbfbe[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1808042 WARN (jetty-launcher-9658-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@7226b0ab[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1808042 WARN (jetty-launcher-9658-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@7226b0ab[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1808044 INFO (jetty-launcher-9658-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38201/solr
[junit4] 2> 1808057 INFO (jetty-launcher-9658-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1808074 INFO (zkConnectionManagerCallback-9670-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1808074 INFO (jetty-launcher-9658-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1808394 INFO (jetty-launcher-9658-thread-1) [n:127.0.0.1:38231_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1808403 INFO (zkConnectionManagerCallback-9672-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1808403 INFO (jetty-launcher-9658-thread-1) [n:127.0.0.1:38231_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1808469 INFO (jetty-launcher-9658-thread-1) [n:127.0.0.1:38231_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38231_solr
[junit4] 2> 1808469 INFO (jetty-launcher-9658-thread-1) [n:127.0.0.1:38231_solr ] o.a.s.c.Overseer Overseer (id=73228521385361414-127.0.0.1:38231_solr-n_0000000000) starting
[junit4] 2> 1808494 INFO (OverseerStateUpdate-73228521385361414-127.0.0.1:38231_solr-n_0000000000) [n:127.0.0.1:38231_solr ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:38231_solr
[junit4] 2> 1808513 INFO (jetty-launcher-9658-thread-1) [n:127.0.0.1:38231_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38231_solr
[junit4] 2> 1808515 INFO (jetty-launcher-9658-thread-1) [n:127.0.0.1:38231_solr ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 1808515 WARN (jetty-launcher-9658-thread-1) [n:127.0.0.1:38231_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 1808524 INFO (zkCallback-9671-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1808744 INFO (jetty-launcher-9658-thread-1) [n:127.0.0.1:38231_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1808804 INFO (jetty-launcher-9658-thread-1) [n:127.0.0.1:38231_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38231.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@287a1c23
[junit4] 2> 1808811 INFO (jetty-launcher-9658-thread-1) [n:127.0.0.1:38231_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38231.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@287a1c23
[junit4] 2> 1808811 INFO (jetty-launcher-9658-thread-1) [n:127.0.0.1:38231_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38231.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@287a1c23
[junit4] 2> 1808812 INFO (jetty-launcher-9658-thread-1) [n:127.0.0.1:38231_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.SystemCollectionCompatTest_8A06912BD667BF9D-001/tempDir-001/node1/.
[junit4] 2> 1810474 INFO (jetty-launcher-9658-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 1810475 WARN (jetty-launcher-9658-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3876d836[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1810475 WARN (jetty-launcher-9658-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3876d836[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1810478 WARN (jetty-launcher-9658-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@6462cba6[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1810478 WARN (jetty-launcher-9658-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@6462cba6[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1810479 INFO (jetty-launcher-9658-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38201/solr
[junit4] 2> 1810480 INFO (jetty-launcher-9658-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1810480 INFO (zkConnectionManagerCallback-9682-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1810480 INFO (jetty-launcher-9658-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1810582 INFO (jetty-launcher-9658-thread-2) [n:127.0.0.1:37277_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1810583 INFO (zkConnectionManagerCallback-9684-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1810583 INFO (jetty-launcher-9658-thread-2) [n:127.0.0.1:37277_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1810586 INFO (jetty-launcher-9658-thread-2) [n:127.0.0.1:37277_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1810691 INFO (jetty-launcher-9658-thread-2) [n:127.0.0.1:37277_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:37277_solr as DOWN
[junit4] 2> 1810692 INFO (jetty-launcher-9658-thread-2) [n:127.0.0.1:37277_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1810692 INFO (jetty-launcher-9658-thread-2) [n:127.0.0.1:37277_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37277_solr
[junit4] 2> 1810693 INFO (zkCallback-9671-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1810694 INFO (zkCallback-9683-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1810695 INFO (jetty-launcher-9658-thread-2) [n:127.0.0.1:37277_solr ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 1810695 WARN (jetty-launcher-9658-thread-2) [n:127.0.0.1:37277_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 1810715 INFO (jetty-launcher-9658-thread-2) [n:127.0.0.1:37277_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1810743 INFO (jetty-launcher-9658-thread-2) [n:127.0.0.1:37277_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37277.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@287a1c23
[junit4] 2> 1810757 INFO (jetty-launcher-9658-thread-2) [n:127.0.0.1:37277_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37277.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@287a1c23
[junit4] 2> 1810758 INFO (jetty-launcher-9658-thread-2) [n:127.0.0.1:37277_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37277.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@287a1c23
[junit4] 2> 1810759 INFO (jetty-launcher-9658-thread-2) [n:127.0.0.1:37277_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.SystemCollectionCompatTest_8A06912BD667BF9D-001/tempDir-001/node2/.
[junit4] 2> 1810796 INFO (SUITE-SystemCollectionCompatTest-seed#[8A06912BD667BF9D]-worker) [ ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=2
[junit4] 2> 1810797 INFO (SUITE-SystemCollectionCompatTest-seed#[8A06912BD667BF9D]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1810802 INFO (zkConnectionManagerCallback-9693-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1810802 INFO (SUITE-SystemCollectionCompatTest-seed#[8A06912BD667BF9D]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1810803 INFO (SUITE-SystemCollectionCompatTest-seed#[8A06912BD667BF9D]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1810804 INFO (SUITE-SystemCollectionCompatTest-seed#[8A06912BD667BF9D]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38201/solr ready
[junit4] 2> 1810824 INFO (TEST-SystemCollectionCompatTest.testBackCompat-seed#[8A06912BD667BF9D]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testBackCompat
[junit4] 2> 1810836 INFO (TEST-SystemCollectionCompatTest.testBackCompat-seed#[8A06912BD667BF9D]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1810836 INFO (zkConnectionManagerCallback-9698-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1810836 INFO (TEST-SystemCollectionCompatTest.testBackCompat-seed#[8A06912BD667BF9D]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1810838 INFO (TEST-SystemCollectionCompatTest.testBackCompat-seed#[8A06912BD667BF9D]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1810839 INFO (TEST-SystemCollectionCompatTest.testBackCompat-seed#[8A06912BD667BF9D]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38201/solr ready
[junit4] 2> 1810885 INFO (qtp1646617161-28547) [n:127.0.0.1:38231_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1810892 INFO (qtp1646617161-28547) [n:127.0.0.1:38231_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=6
[junit4] 2> 1810905 INFO (qtp1646617161-28545) [n:127.0.0.1:38231_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params maxShardsPerNode=2&name=.system&nrtReplicas=2&action=CREATE&numShards=1&createNodeSet=127.0.0.1:37277_solr&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1810915 INFO (OverseerCollectionConfigSetProcessor-73228521385361414-127.0.0.1:38231_solr-n_0000000000) [n:127.0.0.1:38231_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1810915 INFO (OverseerThreadFactory-8909-thread-2-processing-n:127.0.0.1:38231_solr) [n:127.0.0.1:38231_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection .system
[junit4] 2> 1811019 WARN (OverseerThreadFactory-8909-thread-2-processing-n:127.0.0.1:38231_solr) [n:127.0.0.1:38231_solr ] o.a.s.c.a.c.CreateCollectionCmd Specified number of replicas of 2 on collection .system is higher than the number of Solr instances currently live or live and part of your createNodeSet(1). It's unusual to run two replica of the same slice on the same Solr-instance.
[junit4] 2> 1811022 INFO (OverseerStateUpdate-73228521385361414-127.0.0.1:38231_solr-n_0000000000) [n:127.0.0.1:38231_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":".system",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":".system_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:37277/solr",
[junit4] 2> "node_name":"127.0.0.1:37277_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1811025 INFO (OverseerStateUpdate-73228521385361414-127.0.0.1:38231_solr-n_0000000000) [n:127.0.0.1:38231_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":".system",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":".system_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:37277/solr",
[junit4] 2> "node_name":"127.0.0.1:37277_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1811252 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr x:.system_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n1&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1811254 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr x:.system_shard1_replica_n2 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n2&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1811260 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 1811261 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 1811276 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
[junit4] 2> 1811276 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
[junit4] 2> 1811278 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.IndexSchema [.system_shard1_replica_n1] Schema name=_system collection or core
[junit4] 2> 1811278 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.IndexSchema [.system_shard1_replica_n2] Schema name=_system collection or core
[junit4] 2> 1811281 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
[junit4] 2> 1811281 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
[junit4] 2> 1811283 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchema Created and persisted managed schema znode at /configs/.system/managed-schema
[junit4] 2> 1811283 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchema Managed schema znode at /configs/.system/managed-schema already exists - no need to create it
[junit4] 2> 1811283 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_n2' using configuration from configset .system, trusted=true
[junit4] 2> 1811284 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37277.solr.core..system.shard1.replica_n2' (registry 'solr.core..system.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@287a1c23
[junit4] 2> 1811284 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.SolrCore [[.system_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.SystemCollectionCompatTest_8A06912BD667BF9D-001/tempDir-001/node2/.system_shard1_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.SystemCollectionCompatTest_8A06912BD667BF9D-001/tempDir-001/node2/./.system_shard1_replica_n2/data/]
[junit4] 2> 1811285 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, renamed the non-managed schema /configs/.system/schema.xml to /configs/.system/schema.xml.bak
[junit4] 2> 1811285 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_n1' using configuration from configset .system, trusted=true
[junit4] 2> 1811285 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37277.solr.core..system.shard1.replica_n1' (registry 'solr.core..system.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@287a1c23
[junit4] 2> 1811285 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SolrCore [[.system_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.SystemCollectionCompatTest_8A06912BD667BF9D-001/tempDir-001/node2/.system_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.SystemCollectionCompatTest_8A06912BD667BF9D-001/tempDir-001/node2/./.system_shard1_replica_n1/data/]
[junit4] 2> 1811336 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1811336 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1811337 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommitted docs;
[junit4] 2> 1811337 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1811338 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1811338 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1811338 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@15465626[.system_shard1_replica_n1] main]
[junit4] 2> 1811339 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommitted docs;
[junit4] 2> 1811339 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1811340 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
[junit4] 2> 1811340 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@35cb584a[.system_shard1_replica_n2] main]
[junit4] 2> 1811341 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
[junit4] 2> 1811341 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
[junit4] 2> 1811341 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 0 from ZooKeeper
[junit4] 2> 1811342 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
[junit4] 2> 1811342 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
[junit4] 2> 1811342 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
[junit4] 2> 1811343 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 1811343 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1811343 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1658265633202110464
[junit4] 2> 1811343 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.IndexSchema [.system_shard1_replica_n1] Schema name=_system collection or core
[junit4] 2> 1811345 INFO (searcherExecutor-8921-thread-1-processing-n:127.0.0.1:37277_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node4) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.SolrCore [.system_shard1_replica_n2] Registered new searcher Searcher@35cb584a[.system_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1811346 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
[junit4] 2> 1811346 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 4 ms
[junit4] 2> 1811347 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1811347 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1658265633206304768
[junit4] 2> 1811349 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/.system/terms/shard1 to Terms{values={core_node4=0}, version=0}
[junit4] 2> 1811349 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/.system/leaders/shard1
[junit4] 2> 1811349 INFO (searcherExecutor-8922-thread-1-processing-n:127.0.0.1:37277_solr x:.system_shard1_replica_n1 c:.system s:shard1 r:core_node3) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SolrCore [.system_shard1_replica_n1] Registered new searcher Searcher@15465626[.system_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1811350 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/.system/terms/shard1 to Terms{values={core_node3=0, core_node4=0}, version=1}
[junit4] 2> 1811350 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/.system/leaders/shard1
[junit4] 2> 1811354 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1811354 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1811354 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:37277/solr/.system_shard1_replica_n1/
[junit4] 2> 1811354 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.PeerSync PeerSync: core=.system_shard1_replica_n1 url=https://127.0.0.1:37277/solr START replicas=[https://127.0.0.1:37277/solr/.system_shard1_replica_n2/] nUpdates=100
[junit4] 2> 1811354 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.PeerSync PeerSync: core=.system_shard1_replica_n1 url=https://127.0.0.1:37277/solr DONE. We have no versions. sync failed.
[junit4] 2> 1811367 INFO (qtp1910626984-28556) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.S.Request [.system_shard1_replica_n2] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1811368 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 1811368 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 1811368 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/.system/leaders/shard1/leader after winning as /collections/.system/leader_elect/shard1/election/73228521385361416-core_node3-n_0000000000
[junit4] 2> 1811369 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:37277/solr/.system_shard1_replica_n1/ shard1
[junit4] 2> 1811471 INFO (zkCallback-9683-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1811471 INFO (zkCallback-9683-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1811472 INFO (zkCallback-9683-thread-4) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1811472 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1811474 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n1&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=223
[junit4] 2> 1811574 INFO (zkCallback-9683-thread-4) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1811574 INFO (zkCallback-9683-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1811574 INFO (zkCallback-9683-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1811574 INFO (zkCallback-9683-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1812355 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n2&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1101
[junit4] 2> 1812357 INFO (qtp1646617161-28545) [n:127.0.0.1:38231_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 1812457 INFO (zkCallback-9683-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1812457 INFO (zkCallback-9671-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1812457 INFO (zkCallback-9683-thread-4) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1812457 INFO (zkCallback-9683-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1812457 INFO (zkCallback-9683-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1812457 INFO (qtp1646617161-28545) [n:127.0.0.1:38231_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={maxShardsPerNode=2&name=.system&nrtReplicas=2&action=CREATE&numShards=1&createNodeSet=127.0.0.1:37277_solr&wt=javabin&version=2} status=0 QTime=1552
[junit4] 2> 1812458 INFO (TEST-SystemCollectionCompatTest.testBackCompat-seed#[8A06912BD667BF9D]) [ ] o.a.s.c.MiniSolrCloudCluster waitForActiveCollection: .system
[junit4] 2> 1812470 INFO (qtp1910626984-28556) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/.system/terms/shard1 to Terms{values={core_node3=1, core_node4=1}, version=2}
[junit4] 2> 1812498 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [.system_shard1_replica_n2] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=https://127.0.0.1:37277/solr/.system_shard1_replica_n1/&wt=javabin&version=2}{add=[170357cf000Tahmcg99vtc1p0o8woowpwpmo8 (1658265634382807040)]} 0 1
[junit4] 2> 1812498 INFO (qtp1910626984-28556) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [.system_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[170357cf000Tahmcg99vtc1p0o8woowpwpmo8 (1658265634382807040)]} 0 29
[junit4] 2> 1812499 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1658265634414264320,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 1812499 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1dc6a98a commitCommandVersion:1658265634414264320
[junit4] 2> 1812500 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1658265634415312896,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 1812500 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@4fe5ff6e commitCommandVersion:1658265634415312896
[junit4] 2> 1812502 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@2ec213f5[.system_shard1_replica_n1] main]
[junit4] 2> 1812502 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@232949ac[.system_shard1_replica_n2] main]
[junit4] 2> 1812502 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 1812502 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 1812504 INFO (searcherExecutor-8922-thread-1-processing-n:127.0.0.1:37277_solr x:.system_shard1_replica_n1 c:.system s:shard1 r:core_node3) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SolrCore [.system_shard1_replica_n1] Registered new searcher Searcher@2ec213f5[.system_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(9.0.0):C1:[diagnostics={timestamp=1581445345322, java.vendor=Oracle Corporation, os=Linux, os.version=4.15.0-54-generic, java.runtime.version=11.0.4+10-LTS, os.arch=amd64, source=flush, lucene.version=9.0.0, java.vm.version=11.0.4+10-LTS, java.version=11.0.4}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}])))}
[junit4] 2> 1812504 INFO (searcherExecutor-8921-thread-1-processing-n:127.0.0.1:37277_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node4) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.SolrCore [.system_shard1_replica_n2] Registered new searcher Searcher@232949ac[.system_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(9.0.0):C1:[diagnostics={timestamp=1581445345322, java.vendor=Oracle Corporation, os=Linux, os.version=4.15.0-54-generic, java.runtime.version=11.0.4+10-LTS, os.arch=amd64, source=flush, lucene.version=9.0.0, java.vm.version=11.0.4+10-LTS, java.version=11.0.4}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}])))}
[junit4] 2> 1812504 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [.system_shard1_replica_n2] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:37277/solr/.system_shard1_replica_n1/&commit_end_point=replicas&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 4
[junit4] 2> 1812505 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [.system_shard1_replica_n1] webapp=/solr path=/update params={_stateVer_=.system:4&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 6
[junit4] 2> 1812515 INFO (qtp1910626984-28556) [n:127.0.0.1:37277_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={action=STATUS&indexInfo=true&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1812516 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={action=STATUS&indexInfo=true&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1812517 INFO (qtp1910626984-28557) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1] webapp=/solr path=/schema params={wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1812521 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.SchemaManager managed schema loaded . version : 1
[junit4] 2> 1812522 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.IndexSchema [.system_shard1_replica_n2] Schema name=_system collection or core
[junit4] 2> 1812525 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
[junit4] 2> 1812526 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.ZkController Persisted config data to node /configs/.system/schema.xml.bak
[junit4] 2> 1812527 INFO (Thread-4705) [ ] o.a.s.c.SolrCore config update listener called for core .system_shard1_replica_n2
[junit4] 2> 1812528 INFO (Thread-4705) [ ] o.a.s.c.SolrCore core reload .system_shard1_replica_n2
[junit4] 2> 1812531 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 1812539 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.IndexSchema [.system_shard1_replica_n2] Schema name=_system collection or core
[junit4] 2> 1812552 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
[junit4] 2> 1812552 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.CoreContainer Reloading SolrCore '.system_shard1_replica_n2' using configuration from configset .system
[junit4] 2> 1812595 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37277.solr.core..system.shard1.replica_n2' (registry 'solr.core..system.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@287a1c23
[junit4] 2> 1812595 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.SolrCore [[.system_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.SystemCollectionCompatTest_8A06912BD667BF9D-001/tempDir-001/node2/.system_shard1_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.SystemCollectionCompatTest_8A06912BD667BF9D-001/tempDir-001/node2/./.system_shard1_replica_n2/data/]
[junit4] 2> 1812644 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommitted docs;
[junit4] 2> 1812644 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1812647 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@1f9c0247[.system_shard1_replica_n2] main]
[junit4] 2> 1812649 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
[junit4] 2> 1812649 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
[junit4] 2> 1812649 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
[junit4] 2> 1812649 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 1812649 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1812652 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 1812654 INFO (searcherExecutor-8931-thread-1-processing-n:127.0.0.1:37277_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node4) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.SolrCore [.system_shard1_replica_n2] Registered new searcher Searcher@1f9c0247[.system_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(9.0.0):C1:[diagnostics={timestamp=1581445345322, java.vendor=Oracle Corporation, os=Linux, os.version=4.15.0-54-generic, java.runtime.version=11.0.4+10-LTS, os.arch=amd64, source=flush, lucene.version=9.0.0, java.vm.version=11.0.4+10-LTS, java.version=11.0.4}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}])))}
[junit4] 2> 1812655 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@30a2eb95[.system_shard1_replica_n2] main]
[junit4] 2> 1812655 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchema Waiting up to 599 secs for 1 replicas to apply schema update version 2 for collection .system
[junit4] 2> 1812658 INFO (searcherExecutor-8931-thread-1-processing-n:127.0.0.1:37277_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node4) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.SolrCore [.system_shard1_replica_n2] Registered new searcher Searcher@30a2eb95[.system_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(9.0.0):C1:[diagnostics={timestamp=1581445345322, os=Linux, java.vendor=Oracle Corporation, os.version=4.15.0-54-generic, java.runtime.version=11.0.4+10-LTS, os.arch=amd64, source=flush, lucene.version=9.0.0, java.vm.version=11.0.4+10-LTS, java.version=11.0.4}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}])))}
[junit4] 2> 1812660 INFO (Thread-4705) [ ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 1812667 INFO (Thread-4705) [ ] o.a.s.s.IndexSchema [.system_shard1_replica_n2] Schema name=_system collection or core
[junit4] 2> 1812669 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 1812669 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 1812669 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 1812671 INFO (Thread-4705) [ ] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
[junit4] 2> 1812671 INFO (Thread-4705) [ ] o.a.s.c.CoreContainer Reloading SolrCore '.system_shard1_replica_n2' using configuration from configset .system
[junit4] 2> 1812672 ERROR (managedSchemaExecutor-8935-thread-1-processing-n:127.0.0.1:37277_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node4) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:37277/solr/.system_shard1_replica_n1/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 1812673 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 1812673 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 1812673 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1812673 ERROR (managedSchemaExecutor-8935-thread-1-processing-n:127.0.0.1:37277_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node4) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:37277/solr/.system_shard1_replica_n1/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 1812674 INFO (qtp1910626984-28556) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 1812674 INFO (qtp1910626984-28556) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 1812674 INFO (qtp1910626984-28556) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1812675 ERROR (managedSchemaExecutor-8935-thread-1-processing-n:127.0.0.1:37277_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node4) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:37277/solr/.system_shard1_replica_n1/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 1812678 INFO (qtp1910626984-28557) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 1812679 INFO (qtp1910626984-28557) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 1812679 INFO (qtp1910626984-28557) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1812679 ERROR (managedSchemaExecutor-8935-thread-1-processing-n:127.0.0.1:37277_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node4) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:37277/solr/.system_shard1_replica_n1/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 1812680 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 1812680 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 1812680 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1812680 ERROR (managedSchemaExecutor-8935-thread-1-processing-n:127.0.0.1:37277_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node4) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:37277/solr/.system_shard1_replica_n1/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 1812681 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 1812681 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 1812681 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1812681 ERROR (managedSchemaExecutor-8935-thread-1-processing-n:127.0.0.1:37277_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node4) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:37277/solr/.system_shard1_replica_n1/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 1812682 INFO (qtp1910626984-28556) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 1812682 INFO (qtp1910626984-28556) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 1812682 INFO (qtp1910626984-28556) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1812683 ERROR (managedSchemaExecutor-8935-thread-1-processing-n:127.0.0.1:37277_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node4) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:37277/solr/.system_shard1_replica_n1/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 1812683 INFO (qtp1910626984-28557) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 1812683 INFO (qtp1910626984-28557) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 1812683 INFO (qtp1910626984-28557) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1812684 ERROR (managedSchemaExecutor-8935-thread-1-processing-n:127.0.0.1:37277_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node4) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:37277/solr/.system_shard1_replica_n1/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 1812684 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 1812684 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 1812684 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1812685 ERROR (managedSchemaExecutor-8935-thread-1-processing-n:127.0.0.1:37277_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node4) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:37277/solr/.system_shard1_replica_n1/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 1812685 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 1812686 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 1812686 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1812686 ERROR (managedSchemaExecutor-8935-thread-1-processing-n:127.0.0.1:37277_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node4) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:37277/solr/.system_shard1_replica_n1/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 1812686 INFO (qtp1910626984-28556) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 1812687 INFO (qtp1910626984-28556) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 1812687 INFO (qtp1910626984-28556) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1812687 ERROR (managedSchemaExecutor-8935-thread-1-processing-n:127.0.0.1:37277_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node4) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:37277/solr/.system_shard1_replica_n1/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 1812687 INFO (qtp1910626984-28557) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 1812688 INFO (qtp1910626984-28557) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 1812688 INFO (qtp1910626984-28557) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1812688 ERROR (managedSchemaExecutor-8935-thread-1-processing-n:127.0.0.1:37277_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node4) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:37277/solr/.system_shard1_replica_n1/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 1812688 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 1812690 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 1812690 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 1812690 ERROR (managedSchemaExecutor-8935-thread-1-processing-n:127.0.0.1:37277_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node4) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:37277/solr/.system_shard1_replica_n1/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 1812691 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 1812691 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 1812691 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1812691 ERROR (managedSchemaExecutor-8935-thread-1-processing-n:127.0.0.1:37277_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node4) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:37277/solr/.system_shard1_replica_n1/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 1812692 INFO (qtp1910626984-28556) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 1812692 INFO (qtp1910626984-28556) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 1812693 INFO (qtp1910626984-28556) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1812693 ERROR (managedSchemaExecutor-8935-thread-1-processing-n:127.0.0.1:37277_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node4) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:37277/solr/.system_shard1_replica_n1/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 1812693 INFO (qtp1910626984-28557) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 1812694 INFO (qtp1910626984-28557) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 1812694 INFO (qtp1910626984-28557) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1812694 ERROR (managedSchemaExecutor-8935-thread-1-processing-n:127.0.0.1:37277_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node4) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:37277/solr/.system_shard1_replica_n1/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 1812694 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 1812695 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 1812695 INFO (qtp1910626984-28554) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1812695 ERROR (managedSchemaExecutor-8935-thread-1-processing-n:127.0.0.1:37277_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node4) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:37277/solr/.system_shard1_replica_n1/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 1812695 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 1812696 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 1812696 INFO (qtp1910626984-28555) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1812696 ERROR (managedSchemaExecutor-8935-thread-1-processing-n:127.0.0.1:37277_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node4) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:37277/solr/.system_shard1_replica_n1/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 1812696 INFO (qtp1910626984-28556) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 1812697 INFO (qtp1910626984-28556) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 1812697 INFO (qtp1910626984-28556) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1] webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=2&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1812697 ERROR (managedSchemaExecutor-8935-thread-1-processing-n:127.0.0.1:37277_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node4) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchema Replica https://127.0.0.1:37277/solr/.system_shard1_replica_n1/ returned schema version 0 and has not applied schema version 2
[junit4] 2> 1812697 INFO (qtp1910626984-28557) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.h.SchemaHandler REFRESHING SCHEMA (refreshIfBelowVersion=2, currentVersion=0) before returning version!
[junit4] 2> 1812698 INFO (qtp1910626984-28557) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[ju
[...truncated too long message...]
from https://127.0.0.1:37277/solr/.system_shard1_replica_n1/ due to: java.util.concurrent.ExecutionException: org.apache.solr.client.solrj.SolrServerException: Server refused connection at: https://127.0.0.1:37277/solr/.system_shard1_replica_n1
[junit4] 2> 1948435 WARN (managedSchemaExecutor-8935-thread-1-processing-n:127.0.0.1:37277_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node4) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchema Failed to get /schema/zkversion from https://127.0.0.1:37277/solr/.system_shard1_replica_n1/ due to: java.util.concurrent.ExecutionException: org.apache.solr.client.solrj.SolrServerException: Server refused connection at: https://127.0.0.1:37277/solr/.system_shard1_replica_n1
[junit4] 2> 1948445 WARN (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchema Core core_node4 was interrupted waiting for schema version 2 to propagate to 1 replicas for collection .system
[junit4] 2> 1948445 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchema Took 135789.0ms for 1 replicas to apply schema update version 2 for collection .system
[junit4] 2> 1948445 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.S.Request [.system_shard1_replica_n2] webapp=/solr path=/schema params={wt=javabin&version=2} status=0 QTime=135925
[junit4] 2> 1948445 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.c.SolrCore [.system_shard1_replica_n2] CLOSING SolrCore org.apache.solr.core.SolrCore@7526e8dd
[junit4] 2> 1948445 WARN (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.m.SolrMetricManager Interrupted while trying to obtain lock to modify reporters registry: solr.core..system.shard1.replica_n2
[junit4] 2> 1948445 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection..system.shard1.leader, tag=SolrCore@7526e8dd
[junit4] 2> 1948445 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close() .
[junit4] 2> 1948445 INFO (qtp1910626984-28558) [n:127.0.0.1:37277_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n2 ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@3db7e8d4 commitCommandVersion:0
[junit4] 2> 1948447 INFO (SUITE-SystemCollectionCompatTest-seed#[8A06912BD667BF9D]-worker) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
[junit4] 2> 1948650 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/aliases.json
[junit4] 2> 5 /solr/collections/.system/terms/shard1
[junit4] 2> 4 /solr/configs/.system/managed-schema
[junit4] 2> 2 /solr/configs/.system
[junit4] 2> 2 /solr/packages.json
[junit4] 2> 2 /solr/security.json
[junit4] 2> 2 /solr/collections/.system/collectionprops.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 24 /solr/collections/.system/state.json
[junit4] 2> 7 /solr/clusterstate.json
[junit4] 2> 7 /solr/clusterprops.json
[junit4] 2> 6 /solr/aliases.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 24 /solr/overseer/queue
[junit4] 2> 18 /solr/collections
[junit4] 2> 12 /solr/overseer/collection-queue-work
[junit4] 2> 11 /solr/live_nodes
[junit4] 2>
[junit4] 2> 1948652 INFO (SUITE-SystemCollectionCompatTest-seed#[8A06912BD667BF9D]-worker) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:38201
[junit4] 2> 1948652 INFO (SUITE-SystemCollectionCompatTest-seed#[8A06912BD667BF9D]-worker) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:38201
[junit4] 2> 1948652 INFO (SUITE-SystemCollectionCompatTest-seed#[8A06912BD667BF9D]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 38201
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.SystemCollectionCompatTest_8A06912BD667BF9D-001
[junit4] 2> Feb 11, 2020 6:24:41 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene84): {id=FST50, type=PostingsFormat(name=Asserting)}, docValues:{timestamp_l=DocValuesFormat(name=Lucene80), _version_=DocValuesFormat(name=Asserting), time_l=DocValuesFormat(name=Asserting), timestamp=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=2046, maxMBSortInHeap=5.09486345490261, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@10cceb20), locale=en-SD, timezone=America/Grenada
[junit4] 2> NOTE: Linux 4.15.0-54-generic amd64/Oracle Corporation 11.0.4 (64-bit)/cpus=4,threads=1,free=193035384,total=472907776
[junit4] 2> NOTE: All tests run in this JVM: [SolrRrdBackendFactoryTest, TestDynamicFieldCollectionResource, TestJsonFacetsWithNestedObjects, HealthCheckHandlerTest, DistributedFacetExistsSmallTest, DirectUpdateHandlerTest, TestRestManager, PeerSyncTest, TestRandomFaceting, HttpPartitionWithTlogReplicasTest, SmileWriterTest, RAMDirectoryFactoryTest, SolrInfoBeanTest, UninvertDocValuesMergePolicyTest, EmbeddedSolrNoSerializeTest, TestCoreDiscovery, ReturnFieldsTest, TestSubQueryTransformerDistrib, TransactionLogTest, TestCloudRecovery2, TestCloudNestedDocsSort, LukeRequestHandlerTest, MissingSegmentRecoveryTest, TestSolrCLIRunExample, ForceLeaderTest, TestManagedSchemaThreadSafety, TestSimGenericDistributedQueue, TestAuthenticationFramework, TestJettySolrRunner, HdfsRecoveryZkTest, BasicDistributedZk2Test, TestJsonRequest, TestCloudPivotFacet, TestMinMaxOnMultiValuedField, TestMacroExpander, HdfsChaosMonkeySafeLeaderTest, SpellCheckCollatorTest, TestLMJelinekMercerSimilarityFactory, TestFieldCacheSort, TestStreamBody, ChaosMonkeyNothingIsSafeTest, TestSimTriggerIntegration, CoreSorterTest, TestDistributedMap, NodeLostTriggerIntegrationTest, OverseerStatusTest, TestScoreJoinQPScore, TestRequestForwarding, TestIndexingPerformance, HighlighterTest, DocValuesMultiTest, BlockCacheTest, SoftAutoCommitTest, DeleteReplicaTest, TestSolrQueryResponse, SolrGraphiteReporterTest, ManagedSchemaRoundRobinCloudTest, TestMinHashQParser, IndexSizeEstimatorTest, CloudExitableDirectoryReaderTest, BadCopyFieldTest, TestManagedStopFilterFactory, DistributedTermsComponentTest, TriLevelCompositeIdRoutingTest, TestWordDelimiterFilterFactory, TestSolrCloudWithDelegationTokens, TestBinaryField, TestReloadDeadlock, TestInitParams, TestSchemaVersionResource, TestRandomFlRTGCloud, TestHalfAndHalfDocValues, ShardRoutingTest, AlternateDirectoryTest, CoreAdminRequestStatusTest, TestObjectReleaseTracker, ResponseBuilderTest, TestHashPartitioner, TestHighlightDedupGrouping, OverriddenZkACLAndCredentialsProvidersTest, TestStressVersions, TestXIncludeConfig, SuggesterFSTTest, TestSortableTextField, TestHdfsBackupRestoreCore, HdfsCollectionsAPIDistributedZkTest, MinimalSchemaTest, RegexBoostProcessorTest, TestRecovery, TestInPlaceUpdatesDistrib, ExternalFileFieldSortTest, AuditLoggerIntegrationTest, TestConfigSetProperties, DistributedQueueTest, ReplaceNodeNoTargetTest, TestElisionMultitermQuery, TestDirectoryFactory, TestPullReplica, BasicFunctionalityTest, ShardsWhitelistTest, TestSchemaField, HdfsThreadLeakTest, MoveReplicaTest, RestoreTriggerStateTest, TestCSVLoader, TestLeaderElectionZkExpiry, TestSimClusterStateProvider, TemplateUpdateProcessorTest, TestFuzzyAnalyzedSuggestions, DateFieldTest, ZkNodePropsTest, V2ApiIntegrationTest, SpellingQueryConverterTest, TestLegacyTerms, HdfsBasicDistributedZk2Test, TestExportTool, TestWithCollection, FuzzySearchTest, ByteBuffersDirectoryFactoryTest, TestReplicationHandlerDiskOverFlow, TestExplainDocTransformer, VersionInfoTest, TestEmbeddedSolrServerAdminHandler, TestCollapseQParserPlugin, TestHdfsCloudBackupRestore, TestFilteredDocIdSet, SignatureUpdateProcessorFactoryTest, ScheduledTriggerTest, SolrCLIZkUtilsTest, ChaosMonkeySafeLeaderWithPullReplicasTest, MetricsHistoryIntegrationTest, AnalysisErrorHandlingTest, TestSolrFieldCacheBean, ZkCollectionPropsCachingTest, TestPerFieldSimilarity, TestSimNodeLostTrigger, AssignTest, TestFieldCacheWithThreads, TestBlendedInfixSuggestions, BaseCdcrDistributedZkTest, LeaderElectionTest, TestBM25SimilarityFactory, TestSolr4Spatial2, TestDynamicURP, DeleteInactiveReplicaTest, TestJsonFacetRefinement, ZkCLITest, TestSolrConfigHandlerConcurrent, SpatialHeatmapFacetsTest, CursorPagingTest, DisMaxRequestHandlerTest, DistributedIntervalFacetingTest, TestDistributedSearch, AliasIntegrationTest, BasicZkTest, CollectionPropsTest, ConcurrentCreateRoutedAliasTest, ConfigSetsAPITest, ConnectionManagerTest, CreateCollectionCleanupTest, DeleteStatusTest, DistribCursorPagingTest, DistribDocExpirationUpdateProcessorTest, NodeMutatorTest, OverseerRolesTest, PeerSyncReplicationTest, RemoteQueryErrorTest, RestartWhileUpdatingTest, RollingRestartTest, SSLMigrationTest, SaslZkACLProviderTest, SliceStateTest, SplitShardTest, SystemCollectionCompatTest]
[junit4] Completed [523/904 (1!)] on J1 in 141.66s, 1 test, 1 error <<< FAILURES!
[...truncated 53771 lines...]