You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2020/05/11 16:32:57 UTC
[JENKINS] Lucene-Solr-8.x-MacOSX (64bit/jdk-11.0.6) - Build # 981 -
Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-MacOSX/981/
Java: 64bit/jdk-11.0.6 -XX:-UseCompressedOops -XX:+UseParallelGC
5 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.HttpPartitionWithTlogReplicasTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.HttpPartitionWithTlogReplicasTest: 1) Thread[id=12882, name=SessionTracker, state=TIMED_WAITING, group=TGRP-HttpPartitionWithTlogReplicasTest] at java.base@11.0.6/java.lang.Thread.sleep(Native Method) at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.HttpPartitionWithTlogReplicasTest:
1) Thread[id=12882, name=SessionTracker, state=TIMED_WAITING, group=TGRP-HttpPartitionWithTlogReplicasTest]
at java.base@11.0.6/java.lang.Thread.sleep(Native Method)
at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
at __randomizedtesting.SeedInfo.seed([84019185229D1135]:0)
FAILED: org.apache.solr.cloud.ZkFailoverTest.testRestartZkWhenClusterDown
Error Message:
Timeout waiting for number of live nodes = 2
Stack Trace:
java.lang.AssertionError: Timeout waiting for number of live nodes = 2
at __randomizedtesting.SeedInfo.seed([84019185229D1135:EA9612C95B7AB7B6]:0)
at org.junit.Assert.fail(Assert.java:88)
at org.apache.solr.cloud.ZkFailoverTest.waitForLiveNodes(ZkFailoverTest.java:83)
at org.apache.solr.cloud.ZkFailoverTest.testRestartZkWhenClusterDown(ZkFailoverTest.java:69)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:834)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ZkFailoverTest
Error Message:
19 threads leaked from SUITE scope at org.apache.solr.cloud.ZkFailoverTest: 1) Thread[id=16372, name=ConnnectionExpirer, state=TIMED_WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/java.lang.Thread.sleep(Native Method) at app//org.apache.zookeeper.server.NIOServerCnxnFactory$ConnectionExpirerThread.run(NIOServerCnxnFactory.java:574) 2) Thread[id=16391, name=NIOWorkerThread-8, state=WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.6/java.lang.Thread.run(Thread.java:834) 3) Thread[id=16397, name=NIOWorkerThread-12, state=WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.6/java.lang.Thread.run(Thread.java:834) 4) Thread[id=16371, name=ZkTestServer Run Thread, state=WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/java.lang.Object.wait(Native Method) at java.base@11.0.6/java.lang.Thread.join(Thread.java:1305) at java.base@11.0.6/java.lang.Thread.join(Thread.java:1379) at app//org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:950) at app//org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:345) at app//org.apache.solr.cloud.ZkTestServer$2.run(ZkTestServer.java:568) 5) Thread[id=16373, name=NIOServerCxnFactory.SelectorThread-0, state=RUNNABLE, group=TGRP-ZkFailoverTest] at java.base@11.0.6/sun.nio.ch.KQueue.poll(Native Method) at java.base@11.0.6/sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:122) at java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124) at java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141) at app//org.apache.zookeeper.server.NIOServerCnxnFactory$SelectorThread.select(NIOServerCnxnFactory.java:426) at app//org.apache.zookeeper.server.NIOServerCnxnFactory$SelectorThread.run(NIOServerCnxnFactory.java:391) 6) Thread[id=16381, name=NIOWorkerThread-2, state=WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.6/java.lang.Thread.run(Thread.java:834) 7) Thread[id=16377, name=ProcessThread(sid:0 cport:58339):, state=WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at app//org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:134) 8) Thread[id=16374, name=NIOServerCxnFactory.AcceptThread:0.0.0.0/0.0.0.0:58339, state=RUNNABLE, group=TGRP-ZkFailoverTest] at java.base@11.0.6/sun.nio.ch.KQueue.poll(Native Method) at java.base@11.0.6/sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:122) at java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124) at java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141) at app//org.apache.zookeeper.server.NIOServerCnxnFactory$AcceptThread.select(NIOServerCnxnFactory.java:229) at app//org.apache.zookeeper.server.NIOServerCnxnFactory$AcceptThread.run(NIOServerCnxnFactory.java:205) 9) Thread[id=16386, name=NIOWorkerThread-4, state=WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.6/java.lang.Thread.run(Thread.java:834) 10) Thread[id=16390, name=NIOWorkerThread-7, state=WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.6/java.lang.Thread.run(Thread.java:834) 11) Thread[id=16387, name=NIOWorkerThread-5, state=WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.6/java.lang.Thread.run(Thread.java:834) 12) Thread[id=16375, name=SessionTracker, state=TIMED_WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/java.lang.Thread.sleep(Native Method) at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) 13) Thread[id=16395, name=NIOWorkerThread-11, state=WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.6/java.lang.Thread.run(Thread.java:834) 14) Thread[id=16376, name=SyncThread:0, state=WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at app//org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:109) 15) Thread[id=16394, name=NIOWorkerThread-10, state=WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.6/java.lang.Thread.run(Thread.java:834) 16) Thread[id=16382, name=NIOWorkerThread-3, state=WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.6/java.lang.Thread.run(Thread.java:834) 17) Thread[id=16389, name=NIOWorkerThread-6, state=WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.6/java.lang.Thread.run(Thread.java:834) 18) Thread[id=16393, name=NIOWorkerThread-9, state=WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.6/java.lang.Thread.run(Thread.java:834) 19) Thread[id=16378, name=NIOWorkerThread-1, state=WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 19 threads leaked from SUITE scope at org.apache.solr.cloud.ZkFailoverTest:
1) Thread[id=16372, name=ConnnectionExpirer, state=TIMED_WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/java.lang.Thread.sleep(Native Method)
at app//org.apache.zookeeper.server.NIOServerCnxnFactory$ConnectionExpirerThread.run(NIOServerCnxnFactory.java:574)
2) Thread[id=16391, name=NIOWorkerThread-8, state=WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
3) Thread[id=16397, name=NIOWorkerThread-12, state=WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
4) Thread[id=16371, name=ZkTestServer Run Thread, state=WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/java.lang.Object.wait(Native Method)
at java.base@11.0.6/java.lang.Thread.join(Thread.java:1305)
at java.base@11.0.6/java.lang.Thread.join(Thread.java:1379)
at app//org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:950)
at app//org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:345)
at app//org.apache.solr.cloud.ZkTestServer$2.run(ZkTestServer.java:568)
5) Thread[id=16373, name=NIOServerCxnFactory.SelectorThread-0, state=RUNNABLE, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/sun.nio.ch.KQueue.poll(Native Method)
at java.base@11.0.6/sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:122)
at java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
at java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
at app//org.apache.zookeeper.server.NIOServerCnxnFactory$SelectorThread.select(NIOServerCnxnFactory.java:426)
at app//org.apache.zookeeper.server.NIOServerCnxnFactory$SelectorThread.run(NIOServerCnxnFactory.java:391)
6) Thread[id=16381, name=NIOWorkerThread-2, state=WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
7) Thread[id=16377, name=ProcessThread(sid:0 cport:58339):, state=WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
at app//org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:134)
8) Thread[id=16374, name=NIOServerCxnFactory.AcceptThread:0.0.0.0/0.0.0.0:58339, state=RUNNABLE, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/sun.nio.ch.KQueue.poll(Native Method)
at java.base@11.0.6/sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:122)
at java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
at java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
at app//org.apache.zookeeper.server.NIOServerCnxnFactory$AcceptThread.select(NIOServerCnxnFactory.java:229)
at app//org.apache.zookeeper.server.NIOServerCnxnFactory$AcceptThread.run(NIOServerCnxnFactory.java:205)
9) Thread[id=16386, name=NIOWorkerThread-4, state=WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
10) Thread[id=16390, name=NIOWorkerThread-7, state=WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
11) Thread[id=16387, name=NIOWorkerThread-5, state=WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
12) Thread[id=16375, name=SessionTracker, state=TIMED_WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/java.lang.Thread.sleep(Native Method)
at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
13) Thread[id=16395, name=NIOWorkerThread-11, state=WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
14) Thread[id=16376, name=SyncThread:0, state=WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
at app//org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:109)
15) Thread[id=16394, name=NIOWorkerThread-10, state=WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
16) Thread[id=16382, name=NIOWorkerThread-3, state=WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
17) Thread[id=16389, name=NIOWorkerThread-6, state=WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
18) Thread[id=16393, name=NIOWorkerThread-9, state=WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
19) Thread[id=16378, name=NIOWorkerThread-1, state=WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
at __randomizedtesting.SeedInfo.seed([84019185229D1135]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ZkFailoverTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=16391, name=NIOWorkerThread-8, state=WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.6/java.lang.Thread.run(Thread.java:834) 2) Thread[id=16397, name=NIOWorkerThread-12, state=WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.6/java.lang.Thread.run(Thread.java:834) 3) Thread[id=16373, name=NIOServerCxnFactory.SelectorThread-0, state=RUNNABLE, group=TGRP-ZkFailoverTest] at java.base@11.0.6/sun.nio.ch.IOUtil.write1(Native Method) at java.base@11.0.6/sun.nio.ch.KQueueSelectorImpl.wakeup(KQueueSelectorImpl.java:286) at java.base@11.0.6/java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:213) at java.base@11.0.6/java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:219) at java.base@11.0.6/sun.nio.ch.SelectorImpl.begin(SelectorImpl.java:94) at java.base@11.0.6/sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:118) at java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124) at java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141) at app//org.apache.zookeeper.server.NIOServerCnxnFactory$SelectorThread.select(NIOServerCnxnFactory.java:426) at app//org.apache.zookeeper.server.NIOServerCnxnFactory$SelectorThread.run(NIOServerCnxnFactory.java:391) 4) Thread[id=16381, name=NIOWorkerThread-2, state=WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.6/java.lang.Thread.run(Thread.java:834) 5) Thread[id=16374, name=NIOServerCxnFactory.AcceptThread:0.0.0.0/0.0.0.0:58339, state=RUNNABLE, group=TGRP-ZkFailoverTest] at java.base@11.0.6/sun.nio.ch.IOUtil.write1(Native Method) at java.base@11.0.6/sun.nio.ch.KQueueSelectorImpl.wakeup(KQueueSelectorImpl.java:286) at java.base@11.0.6/java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:213) at java.base@11.0.6/java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:219) at java.base@11.0.6/sun.nio.ch.SelectorImpl.begin(SelectorImpl.java:94) at java.base@11.0.6/sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:118) at java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124) at java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141) at app//org.apache.zookeeper.server.NIOServerCnxnFactory$AcceptThread.select(NIOServerCnxnFactory.java:229) at app//org.apache.zookeeper.server.NIOServerCnxnFactory$AcceptThread.run(NIOServerCnxnFactory.java:205) 6) Thread[id=16386, name=NIOWorkerThread-4, state=WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.6/java.lang.Thread.run(Thread.java:834) 7) Thread[id=16390, name=NIOWorkerThread-7, state=WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.6/java.lang.Thread.run(Thread.java:834) 8) Thread[id=16387, name=NIOWorkerThread-5, state=WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.6/java.lang.Thread.run(Thread.java:834) 9) Thread[id=16395, name=NIOWorkerThread-11, state=WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.6/java.lang.Thread.run(Thread.java:834) 10) Thread[id=16394, name=NIOWorkerThread-10, state=WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.6/java.lang.Thread.run(Thread.java:834) 11) Thread[id=16382, name=NIOWorkerThread-3, state=WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.6/java.lang.Thread.run(Thread.java:834) 12) Thread[id=16389, name=NIOWorkerThread-6, state=WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.6/java.lang.Thread.run(Thread.java:834) 13) Thread[id=16393, name=NIOWorkerThread-9, state=WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.6/java.lang.Thread.run(Thread.java:834) 14) Thread[id=16378, name=NIOWorkerThread-1, state=WAITING, group=TGRP-ZkFailoverTest] at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method) at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114) at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=16391, name=NIOWorkerThread-8, state=WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
2) Thread[id=16397, name=NIOWorkerThread-12, state=WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
3) Thread[id=16373, name=NIOServerCxnFactory.SelectorThread-0, state=RUNNABLE, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/sun.nio.ch.IOUtil.write1(Native Method)
at java.base@11.0.6/sun.nio.ch.KQueueSelectorImpl.wakeup(KQueueSelectorImpl.java:286)
at java.base@11.0.6/java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:213)
at java.base@11.0.6/java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:219)
at java.base@11.0.6/sun.nio.ch.SelectorImpl.begin(SelectorImpl.java:94)
at java.base@11.0.6/sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:118)
at java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
at java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
at app//org.apache.zookeeper.server.NIOServerCnxnFactory$SelectorThread.select(NIOServerCnxnFactory.java:426)
at app//org.apache.zookeeper.server.NIOServerCnxnFactory$SelectorThread.run(NIOServerCnxnFactory.java:391)
4) Thread[id=16381, name=NIOWorkerThread-2, state=WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
5) Thread[id=16374, name=NIOServerCxnFactory.AcceptThread:0.0.0.0/0.0.0.0:58339, state=RUNNABLE, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/sun.nio.ch.IOUtil.write1(Native Method)
at java.base@11.0.6/sun.nio.ch.KQueueSelectorImpl.wakeup(KQueueSelectorImpl.java:286)
at java.base@11.0.6/java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:213)
at java.base@11.0.6/java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:219)
at java.base@11.0.6/sun.nio.ch.SelectorImpl.begin(SelectorImpl.java:94)
at java.base@11.0.6/sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:118)
at java.base@11.0.6/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
at java.base@11.0.6/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
at app//org.apache.zookeeper.server.NIOServerCnxnFactory$AcceptThread.select(NIOServerCnxnFactory.java:229)
at app//org.apache.zookeeper.server.NIOServerCnxnFactory$AcceptThread.run(NIOServerCnxnFactory.java:205)
6) Thread[id=16386, name=NIOWorkerThread-4, state=WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
7) Thread[id=16390, name=NIOWorkerThread-7, state=WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
8) Thread[id=16387, name=NIOWorkerThread-5, state=WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
9) Thread[id=16395, name=NIOWorkerThread-11, state=WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
10) Thread[id=16394, name=NIOWorkerThread-10, state=WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
11) Thread[id=16382, name=NIOWorkerThread-3, state=WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
12) Thread[id=16389, name=NIOWorkerThread-6, state=WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
13) Thread[id=16393, name=NIOWorkerThread-9, state=WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
14) Thread[id=16378, name=NIOWorkerThread-1, state=WAITING, group=TGRP-ZkFailoverTest]
at java.base@11.0.6/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@11.0.6/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@11.0.6/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
at java.base@11.0.6/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
at java.base@11.0.6/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base@11.0.6/java.lang.Thread.run(Thread.java:834)
at __randomizedtesting.SeedInfo.seed([84019185229D1135]:0)
FAILED: org.apache.solr.cloud.api.collections.CollectionsAPIDistributedZkTest.testCollectionsAPI
Error Message:
Failed while waiting for active collection Timeout waiting to see state for collection=awhollynewcollection_0 :DocCollection(awhollynewcollection_0//collections/awhollynewcollection_0/state.json/7)={ "pullReplicas":"0", "replicationFactor":"4", "shards":{ "shard1":{ "range":"80000000-b332ffff", "state":"active", "replicas":{ "core_node3":{ "core":"awhollynewcollection_0_shard1_replica_n1", "base_url":"http://127.0.0.1:59333/solr", "node_name":"127.0.0.1:59333_solr", "state":"down", "type":"NRT", "force_set_state":"false"}, "core_node5":{ "core":"awhollynewcollection_0_shard1_replica_n2", "base_url":"http://127.0.0.1:59332/solr", "node_name":"127.0.0.1:59332_solr", "state":"active", "type":"NRT", "force_set_state":"false", "leader":"true"}, "core_node7":{ "core":"awhollynewcollection_0_shard1_replica_n4", "base_url":"http://127.0.0.1:59328/solr", "node_name":"127.0.0.1:59328_solr", "state":"down", "type":"NRT", "force_set_state":"false"}, "core_node9":{ "core":"awhollynewcollection_0_shard1_replica_n6", "base_url":"http://127.0.0.1:59330/solr", "node_name":"127.0.0.1:59330_solr", "state":"down", "type":"NRT", "force_set_state":"false"}}}, "shard2":{ "range":"b3330000-e665ffff", "state":"active", "replicas":{ "core_node11":{ "core":"awhollynewcollection_0_shard2_replica_n8", "base_url":"http://127.0.0.1:59330/solr", "node_name":"127.0.0.1:59330_solr", "state":"active", "type":"NRT", "force_set_state":"false", "leader":"true"}, "core_node13":{ "core":"awhollynewcollection_0_shard2_replica_n10", "base_url":"http://127.0.0.1:59328/solr", "node_name":"127.0.0.1:59328_solr", "state":"down", "type":"NRT", "force_set_state":"false"}, "core_node15":{ "core":"awhollynewcollection_0_shard2_replica_n12", "base_url":"http://127.0.0.1:59332/solr", "node_name":"127.0.0.1:59332_solr", "state":"down", "type":"NRT", "force_set_state":"false"}, "core_node17":{ "core":"awhollynewcollection_0_shard2_replica_n14", "base_url":"http://127.0.0.1:59333/solr", "node_name":"127.0.0.1:59333_solr", "state":"down", "type":"NRT", "force_set_state":"false"}}}, "shard3":{ "range":"e6660000-1998ffff", "state":"active", "replicas":{ "core_node19":{ "core":"awhollynewcollection_0_shard3_replica_n16", "base_url":"http://127.0.0.1:59333/solr", "node_name":"127.0.0.1:59333_solr", "state":"down", "type":"NRT", "force_set_state":"false"}, "core_node21":{ "core":"awhollynewcollection_0_shard3_replica_n18", "base_url":"http://127.0.0.1:59332/solr", "node_name":"127.0.0.1:59332_solr", "state":"active", "type":"NRT", "force_set_state":"false", "leader":"true"}, "core_node23":{ "core":"awhollynewcollection_0_shard3_replica_n20", "base_url":"http://127.0.0.1:59328/solr", "node_name":"127.0.0.1:59328_solr", "state":"down", "type":"NRT", "force_set_state":"false"}, "core_node25":{ "core":"awhollynewcollection_0_shard3_replica_n22", "base_url":"http://127.0.0.1:59330/solr", "node_name":"127.0.0.1:59330_solr", "state":"down", "type":"NRT", "force_set_state":"false"}}}, "shard4":{ "range":"19990000-4ccbffff", "state":"active", "replicas":{ "core_node27":{ "core":"awhollynewcollection_0_shard4_replica_n24", "base_url":"http://127.0.0.1:59330/solr", "node_name":"127.0.0.1:59330_solr", "state":"down", "type":"NRT", "force_set_state":"false"}, "core_node29":{ "core":"awhollynewcollection_0_shard4_replica_n26", "base_url":"http://127.0.0.1:59328/solr", "node_name":"127.0.0.1:59328_solr", "state":"down", "type":"NRT", "force_set_state":"false"}, "core_node31":{ "core":"awhollynewcollection_0_shard4_replica_n28", "base_url":"http://127.0.0.1:59332/solr", "node_name":"127.0.0.1:59332_solr", "state":"active", "type":"NRT", "force_set_state":"false", "leader":"true"}, "core_node33":{ "core":"awhollynewcollection_0_shard4_replica_n30", "base_url":"http://127.0.0.1:59333/solr", "node_name":"127.0.0.1:59333_solr", "state":"down", "type":"NRT", "force_set_state":"false"}}}, "shard5":{ "range":"4ccc0000-7fffffff", "state":"active", "replicas":{ "core_node35":{ "core":"awhollynewcollection_0_shard5_replica_n32", "base_url":"http://127.0.0.1:59333/solr", "node_name":"127.0.0.1:59333_solr", "state":"down", "type":"NRT", "force_set_state":"false"}, "core_node37":{ "core":"awhollynewcollection_0_shard5_replica_n34", "base_url":"http://127.0.0.1:59332/solr", "node_name":"127.0.0.1:59332_solr", "state":"active", "type":"NRT", "force_set_state":"false", "leader":"true"}, "core_node39":{ "core":"awhollynewcollection_0_shard5_replica_n36", "base_url":"http://127.0.0.1:59328/solr", "node_name":"127.0.0.1:59328_solr", "state":"down", "type":"NRT", "force_set_state":"false"}, "core_node40":{ "core":"awhollynewcollection_0_shard5_replica_n38", "base_url":"http://127.0.0.1:59330/solr", "node_name":"127.0.0.1:59330_solr", "state":"down", "type":"NRT", "force_set_state":"false"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"6", "autoAddReplicas":"false", "nrtReplicas":"4", "tlogReplicas":"0"} Live Nodes: [127.0.0.1:59328_solr, 127.0.0.1:59330_solr, 127.0.0.1:59332_solr, 127.0.0.1:59333_solr] Last available state: DocCollection(awhollynewcollection_0//collections/awhollynewcollection_0/state.json/7)={ "pullReplicas":"0", "replicationFactor":"4", "shards":{ "shard1":{ "range":"80000000-b332ffff", "state":"active", "replicas":{ "core_node3":{ "core":"awhollynewcollection_0_shard1_replica_n1", "base_url":"http://127.0.0.1:59333/solr", "node_name":"127.0.0.1:59333_solr", "state":"down", "type":"NRT", "force_set_state":"false"}, "core_node5":{ "core":"awhollynewcollection_0_shard1_replica_n2", "base_url":"http://127.0.0.1:59332/solr", "node_name":"127.0.0.1:59332_solr", "state":"active", "type":"NRT", "force_set_state":"false", "leader":"true"}, "core_node7":{ "core":"awhollynewcollection_0_shard1_replica_n4", "base_url":"http://127.0.0.1:59328/solr", "node_name":"127.0.0.1:59328_solr", "state":"down", "type":"NRT", "force_set_state":"false"}, "core_node9":{ "core":"awhollynewcollection_0_shard1_replica_n6", "base_url":"http://127.0.0.1:59330/solr", "node_name":"127.0.0.1:59330_solr", "state":"down", "type":"NRT", "force_set_state":"false"}}}, "shard2":{ "range":"b3330000-e665ffff", "state":"active", "replicas":{ "core_node11":{ "core":"awhollynewcollection_0_shard2_replica_n8", "base_url":"http://127.0.0.1:59330/solr", "node_name":"127.0.0.1:59330_solr", "state":"active", "type":"NRT", "force_set_state":"false", "leader":"true"}, "core_node13":{ "core":"awhollynewcollection_0_shard2_replica_n10", "base_url":"http://127.0.0.1:59328/solr", "node_name":"127.0.0.1:59328_solr", "state":"down", "type":"NRT", "force_set_state":"false"}, "core_node15":{ "core":"awhollynewcollection_0_shard2_replica_n12", "base_url":"http://127.0.0.1:59332/solr", "node_name":"127.0.0.1:59332_solr", "state":"down", "type":"NRT", "force_set_state":"false"}, "core_node17":{ "core":"awhollynewcollection_0_shard2_replica_n14", "base_url":"http://127.0.0.1:59333/solr", "node_name":"127.0.0.1:59333_solr", "state":"down", "type":"NRT", "force_set_state":"false"}}}, "shard3":{ "range":"e6660000-1998ffff", "state":"active", "replicas":{ "core_node19":{ "core":"awhollynewcollection_0_shard3_replica_n16", "base_url":"http://127.0.0.1:59333/solr", "node_name":"127.0.0.1:59333_solr", "state":"down", "type":"NRT", "force_set_state":"false"}, "core_node21":{ "core":"awhollynewcollection_0_shard3_replica_n18", "base_url":"http://127.0.0.1:59332/solr", "node_name":"127.0.0.1:59332_solr", "state":"active", "type":"NRT", "force_set_state":"false", "leader":"true"}, "core_node23":{ "core":"awhollynewcollection_0_shard3_replica_n20", "base_url":"http://127.0.0.1:59328/solr", "node_name":"127.0.0.1:59328_solr", "state":"down", "type":"NRT", "force_set_state":"false"}, "core_node25":{ "core":"awhollynewcollection_0_shard3_replica_n22", "base_url":"http://127.0.0.1:59330/solr", "node_name":"127.0.0.1:59330_solr", "state":"down", "type":"NRT", "force_set_state":"false"}}}, "shard4":{ "range":"19990000-4ccbffff", "state":"active", "replicas":{ "core_node27":{ "core":"awhollynewcollection_0_shard4_replica_n24", "base_url":"http://127.0.0.1:59330/solr", "node_name":"127.0.0.1:59330_solr", "state":"down", "type":"NRT", "force_set_state":"false"}, "core_node29":{ "core":"awhollynewcollection_0_shard4_replica_n26", "base_url":"http://127.0.0.1:59328/solr", "node_name":"127.0.0.1:59328_solr", "state":"down", "type":"NRT", "force_set_state":"false"}, "core_node31":{ "core":"awhollynewcollection_0_shard4_replica_n28", "base_url":"http://127.0.0.1:59332/solr", "node_name":"127.0.0.1:59332_solr", "state":"active", "type":"NRT", "force_set_state":"false", "leader":"true"}, "core_node33":{ "core":"awhollynewcollection_0_shard4_replica_n30", "base_url":"http://127.0.0.1:59333/solr", "node_name":"127.0.0.1:59333_solr", "state":"down", "type":"NRT", "force_set_state":"false"}}}, "shard5":{ "range":"4ccc0000-7fffffff", "state":"active", "replicas":{ "core_node35":{ "core":"awhollynewcollection_0_shard5_replica_n32", "base_url":"http://127.0.0.1:59333/solr", "node_name":"127.0.0.1:59333_solr", "state":"down", "type":"NRT", "force_set_state":"false"}, "core_node37":{ "core":"awhollynewcollection_0_shard5_replica_n34", "base_url":"http://127.0.0.1:59332/solr", "node_name":"127.0.0.1:59332_solr", "state":"active", "type":"NRT", "force_set_state":"false", "leader":"true"}, "core_node39":{ "core":"awhollynewcollection_0_shard5_replica_n36", "base_url":"http://127.0.0.1:59328/solr", "node_name":"127.0.0.1:59328_solr", "state":"down", "type":"NRT", "force_set_state":"false"}, "core_node40":{ "core":"awhollynewcollection_0_shard5_replica_n38", "base_url":"http://127.0.0.1:59330/solr", "node_name":"127.0.0.1:59330_solr", "state":"down", "type":"NRT", "force_set_state":"false"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"6", "autoAddReplicas":"false", "nrtReplicas":"4", "tlogReplicas":"0"}
Stack Trace:
java.lang.RuntimeException: Failed while waiting for active collection
Timeout waiting to see state for collection=awhollynewcollection_0 :DocCollection(awhollynewcollection_0//collections/awhollynewcollection_0/state.json/7)={
"pullReplicas":"0",
"replicationFactor":"4",
"shards":{
"shard1":{
"range":"80000000-b332ffff",
"state":"active",
"replicas":{
"core_node3":{
"core":"awhollynewcollection_0_shard1_replica_n1",
"base_url":"http://127.0.0.1:59333/solr",
"node_name":"127.0.0.1:59333_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"},
"core_node5":{
"core":"awhollynewcollection_0_shard1_replica_n2",
"base_url":"http://127.0.0.1:59332/solr",
"node_name":"127.0.0.1:59332_solr",
"state":"active",
"type":"NRT",
"force_set_state":"false",
"leader":"true"},
"core_node7":{
"core":"awhollynewcollection_0_shard1_replica_n4",
"base_url":"http://127.0.0.1:59328/solr",
"node_name":"127.0.0.1:59328_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"},
"core_node9":{
"core":"awhollynewcollection_0_shard1_replica_n6",
"base_url":"http://127.0.0.1:59330/solr",
"node_name":"127.0.0.1:59330_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"}}},
"shard2":{
"range":"b3330000-e665ffff",
"state":"active",
"replicas":{
"core_node11":{
"core":"awhollynewcollection_0_shard2_replica_n8",
"base_url":"http://127.0.0.1:59330/solr",
"node_name":"127.0.0.1:59330_solr",
"state":"active",
"type":"NRT",
"force_set_state":"false",
"leader":"true"},
"core_node13":{
"core":"awhollynewcollection_0_shard2_replica_n10",
"base_url":"http://127.0.0.1:59328/solr",
"node_name":"127.0.0.1:59328_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"},
"core_node15":{
"core":"awhollynewcollection_0_shard2_replica_n12",
"base_url":"http://127.0.0.1:59332/solr",
"node_name":"127.0.0.1:59332_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"},
"core_node17":{
"core":"awhollynewcollection_0_shard2_replica_n14",
"base_url":"http://127.0.0.1:59333/solr",
"node_name":"127.0.0.1:59333_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"}}},
"shard3":{
"range":"e6660000-1998ffff",
"state":"active",
"replicas":{
"core_node19":{
"core":"awhollynewcollection_0_shard3_replica_n16",
"base_url":"http://127.0.0.1:59333/solr",
"node_name":"127.0.0.1:59333_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"},
"core_node21":{
"core":"awhollynewcollection_0_shard3_replica_n18",
"base_url":"http://127.0.0.1:59332/solr",
"node_name":"127.0.0.1:59332_solr",
"state":"active",
"type":"NRT",
"force_set_state":"false",
"leader":"true"},
"core_node23":{
"core":"awhollynewcollection_0_shard3_replica_n20",
"base_url":"http://127.0.0.1:59328/solr",
"node_name":"127.0.0.1:59328_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"},
"core_node25":{
"core":"awhollynewcollection_0_shard3_replica_n22",
"base_url":"http://127.0.0.1:59330/solr",
"node_name":"127.0.0.1:59330_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"}}},
"shard4":{
"range":"19990000-4ccbffff",
"state":"active",
"replicas":{
"core_node27":{
"core":"awhollynewcollection_0_shard4_replica_n24",
"base_url":"http://127.0.0.1:59330/solr",
"node_name":"127.0.0.1:59330_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"},
"core_node29":{
"core":"awhollynewcollection_0_shard4_replica_n26",
"base_url":"http://127.0.0.1:59328/solr",
"node_name":"127.0.0.1:59328_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"},
"core_node31":{
"core":"awhollynewcollection_0_shard4_replica_n28",
"base_url":"http://127.0.0.1:59332/solr",
"node_name":"127.0.0.1:59332_solr",
"state":"active",
"type":"NRT",
"force_set_state":"false",
"leader":"true"},
"core_node33":{
"core":"awhollynewcollection_0_shard4_replica_n30",
"base_url":"http://127.0.0.1:59333/solr",
"node_name":"127.0.0.1:59333_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"}}},
"shard5":{
"range":"4ccc0000-7fffffff",
"state":"active",
"replicas":{
"core_node35":{
"core":"awhollynewcollection_0_shard5_replica_n32",
"base_url":"http://127.0.0.1:59333/solr",
"node_name":"127.0.0.1:59333_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"},
"core_node37":{
"core":"awhollynewcollection_0_shard5_replica_n34",
"base_url":"http://127.0.0.1:59332/solr",
"node_name":"127.0.0.1:59332_solr",
"state":"active",
"type":"NRT",
"force_set_state":"false",
"leader":"true"},
"core_node39":{
"core":"awhollynewcollection_0_shard5_replica_n36",
"base_url":"http://127.0.0.1:59328/solr",
"node_name":"127.0.0.1:59328_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"},
"core_node40":{
"core":"awhollynewcollection_0_shard5_replica_n38",
"base_url":"http://127.0.0.1:59330/solr",
"node_name":"127.0.0.1:59330_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"6",
"autoAddReplicas":"false",
"nrtReplicas":"4",
"tlogReplicas":"0"}
Live Nodes: [127.0.0.1:59328_solr, 127.0.0.1:59330_solr, 127.0.0.1:59332_solr, 127.0.0.1:59333_solr]
Last available state: DocCollection(awhollynewcollection_0//collections/awhollynewcollection_0/state.json/7)={
"pullReplicas":"0",
"replicationFactor":"4",
"shards":{
"shard1":{
"range":"80000000-b332ffff",
"state":"active",
"replicas":{
"core_node3":{
"core":"awhollynewcollection_0_shard1_replica_n1",
"base_url":"http://127.0.0.1:59333/solr",
"node_name":"127.0.0.1:59333_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"},
"core_node5":{
"core":"awhollynewcollection_0_shard1_replica_n2",
"base_url":"http://127.0.0.1:59332/solr",
"node_name":"127.0.0.1:59332_solr",
"state":"active",
"type":"NRT",
"force_set_state":"false",
"leader":"true"},
"core_node7":{
"core":"awhollynewcollection_0_shard1_replica_n4",
"base_url":"http://127.0.0.1:59328/solr",
"node_name":"127.0.0.1:59328_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"},
"core_node9":{
"core":"awhollynewcollection_0_shard1_replica_n6",
"base_url":"http://127.0.0.1:59330/solr",
"node_name":"127.0.0.1:59330_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"}}},
"shard2":{
"range":"b3330000-e665ffff",
"state":"active",
"replicas":{
"core_node11":{
"core":"awhollynewcollection_0_shard2_replica_n8",
"base_url":"http://127.0.0.1:59330/solr",
"node_name":"127.0.0.1:59330_solr",
"state":"active",
"type":"NRT",
"force_set_state":"false",
"leader":"true"},
"core_node13":{
"core":"awhollynewcollection_0_shard2_replica_n10",
"base_url":"http://127.0.0.1:59328/solr",
"node_name":"127.0.0.1:59328_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"},
"core_node15":{
"core":"awhollynewcollection_0_shard2_replica_n12",
"base_url":"http://127.0.0.1:59332/solr",
"node_name":"127.0.0.1:59332_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"},
"core_node17":{
"core":"awhollynewcollection_0_shard2_replica_n14",
"base_url":"http://127.0.0.1:59333/solr",
"node_name":"127.0.0.1:59333_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"}}},
"shard3":{
"range":"e6660000-1998ffff",
"state":"active",
"replicas":{
"core_node19":{
"core":"awhollynewcollection_0_shard3_replica_n16",
"base_url":"http://127.0.0.1:59333/solr",
"node_name":"127.0.0.1:59333_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"},
"core_node21":{
"core":"awhollynewcollection_0_shard3_replica_n18",
"base_url":"http://127.0.0.1:59332/solr",
"node_name":"127.0.0.1:59332_solr",
"state":"active",
"type":"NRT",
"force_set_state":"false",
"leader":"true"},
"core_node23":{
"core":"awhollynewcollection_0_shard3_replica_n20",
"base_url":"http://127.0.0.1:59328/solr",
"node_name":"127.0.0.1:59328_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"},
"core_node25":{
"core":"awhollynewcollection_0_shard3_replica_n22",
"base_url":"http://127.0.0.1:59330/solr",
"node_name":"127.0.0.1:59330_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"}}},
"shard4":{
"range":"19990000-4ccbffff",
"state":"active",
"replicas":{
"core_node27":{
"core":"awhollynewcollection_0_shard4_replica_n24",
"base_url":"http://127.0.0.1:59330/solr",
"node_name":"127.0.0.1:59330_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"},
"core_node29":{
"core":"awhollynewcollection_0_shard4_replica_n26",
"base_url":"http://127.0.0.1:59328/solr",
"node_name":"127.0.0.1:59328_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"},
"core_node31":{
"core":"awhollynewcollection_0_shard4_replica_n28",
"base_url":"http://127.0.0.1:59332/solr",
"node_name":"127.0.0.1:59332_solr",
"state":"active",
"type":"NRT",
"force_set_state":"false",
"leader":"true"},
"core_node33":{
"core":"awhollynewcollection_0_shard4_replica_n30",
"base_url":"http://127.0.0.1:59333/solr",
"node_name":"127.0.0.1:59333_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"}}},
"shard5":{
"range":"4ccc0000-7fffffff",
"state":"active",
"replicas":{
"core_node35":{
"core":"awhollynewcollection_0_shard5_replica_n32",
"base_url":"http://127.0.0.1:59333/solr",
"node_name":"127.0.0.1:59333_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"},
"core_node37":{
"core":"awhollynewcollection_0_shard5_replica_n34",
"base_url":"http://127.0.0.1:59332/solr",
"node_name":"127.0.0.1:59332_solr",
"state":"active",
"type":"NRT",
"force_set_state":"false",
"leader":"true"},
"core_node39":{
"core":"awhollynewcollection_0_shard5_replica_n36",
"base_url":"http://127.0.0.1:59328/solr",
"node_name":"127.0.0.1:59328_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"},
"core_node40":{
"core":"awhollynewcollection_0_shard5_replica_n38",
"base_url":"http://127.0.0.1:59330/solr",
"node_name":"127.0.0.1:59330_solr",
"state":"down",
"type":"NRT",
"force_set_state":"false"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"6",
"autoAddReplicas":"false",
"nrtReplicas":"4",
"tlogReplicas":"0"}
at __randomizedtesting.SeedInfo.seed([84019185229D1135:CC74E53124AE3EA0]:0)
at org.apache.solr.cloud.MiniSolrCloudCluster.waitForActiveCollection(MiniSolrCloudCluster.java:765)
at org.apache.solr.cloud.MiniSolrCloudCluster.waitForActiveCollection(MiniSolrCloudCluster.java:771)
at org.apache.solr.cloud.api.collections.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:424)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.Te
[...truncated too long message...]
icRegistry@367def2c
[junit4] 2> 1439835 INFO (jetty-closer-16821-thread-4) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
[junit4] 2> 1439939 INFO (jetty-closer-16821-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72199764074758156-127.0.0.1:60451_solr-n_0000000000) closing
[junit4] 2> 1439941 INFO (zkCallback-16804-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 1439941 INFO (zkCallback-16772-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (2)
[junit4] 2> 1439944 INFO (jetty-closer-16821-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@77923794{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
[junit4] 2> 1439944 INFO (jetty-closer-16821-thread-2) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@914d149{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
[junit4] 2> 1439945 INFO (jetty-closer-16821-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@107612f{/solr,null,UNAVAILABLE}
[junit4] 2> 1439945 INFO (jetty-closer-16821-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5a26c40f{/solr,null,UNAVAILABLE}
[junit4] 2> 1439946 INFO (jetty-closer-16821-thread-2) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 1439946 INFO (jetty-closer-16821-thread-1) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 1440056 INFO (jetty-closer-16821-thread-3) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@41433f36{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
[junit4] 2> 1440056 INFO (jetty-closer-16821-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@739eaf07{/solr,null,UNAVAILABLE}
[junit4] 2> 1440056 INFO (jetty-closer-16821-thread-3) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 1440158 INFO (jetty-closer-16821-thread-4) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@1fcb53f4{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
[junit4] 2> 1440159 INFO (jetty-closer-16821-thread-4) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@62df5bae{/solr,null,UNAVAILABLE}
[junit4] 2> 1440159 INFO (jetty-closer-16821-thread-4) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 1440161 INFO (TEST-CollectionsAPIDistributedZkTest.testTooManyReplicas-seed#[84019185229D1135]) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
[junit4] 2> 1440385 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/aliases.json
[junit4] 2> 5 /solr/clusterprops.json
[junit4] 2> 4 /solr/packages.json
[junit4] 2> 4 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/clusterstate.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 18 /solr/live_nodes
[junit4] 2> 15 /solr/collections
[junit4] 2> 11 /solr/overseer/queue
[junit4] 2> 4 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> 1440388 INFO (TEST-CollectionsAPIDistributedZkTest.testTooManyReplicas-seed#[84019185229D1135]) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:60435
[junit4] 2> 1440388 INFO (TEST-CollectionsAPIDistributedZkTest.testTooManyReplicas-seed#[84019185229D1135]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:60435
[junit4] 2> 1440388 INFO (TEST-CollectionsAPIDistributedZkTest.testTooManyReplicas-seed#[84019185229D1135]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 60435
[junit4] 2> 1440388 INFO (TEST-CollectionsAPIDistributedZkTest.testTooManyReplicas-seed#[84019185229D1135]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testTooManyReplicas
[junit4] 2> 1440389 INFO (TEST-CollectionsAPIDistributedZkTest.testTooManyReplicas-seed#[84019185229D1135]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testTooManyReplicas
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.api.collections.CollectionsAPIDistributedZkTest_84019185229D1135-001
[junit4] 2> May 11, 2020 4:12:19 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene84): {}, docValues:{}, maxPointsInLeafNode=452, maxMBSortInHeap=6.055419943945679, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@4a69717e), locale=en-BE, timezone=America/Creston
[junit4] 2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 11.0.6 (64-bit)/cpus=6,threads=1,free=143893224,total=524288000
[junit4] 2> NOTE: All tests run in this JVM: [UUIDFieldTest, TestSolrFieldCacheBean, FuzzySearchTest, LeaderElectionIntegrationTest, HighlighterConfigTest, OverseerCollectionConfigSetProcessorTest, TestGraphTermsQParserPlugin, AddBlockUpdateTest, FileUtilsTest, DocumentBuilderTest, CoreAdminRequestStatusTest, CloneFieldUpdateProcessorFactoryTest, TestMultiWordSynonyms, BasicDistributedZk2Test, TestLRUCache, SSLMigrationTest, TestCollectionsAPIViaSolrCloudCluster, PluginInfoTest, ParsingFieldUpdateProcessorsTest, AtomicUpdatesTest, OpenExchangeRatesOrgProviderTest, TestCSVResponseWriter, TestNonDefinedSimilarityFactory, AutoAddReplicasIntegrationTest, TestDistribPackageStore, EchoParamsTest, CdcrVersionReplicationTest, RequiredFieldsTest, ZkSolrClientTest, TestDefaultStatsCache, TestMacroExpander, TestStressLucene, TestNRTOpen, TestUnifiedSolrHighlighter, ZkCLITest, TestTolerantSearch, FacetPivotSmallTest, TestNamedUpdateProcessors, TestAddFieldRealTimeGet, IndexSchemaRuntimeFieldTest, TestManagedSchemaThreadSafety, UUIDUpdateProcessorFallbackTest, TestSimGenericDistributedQueue, BigEndianAscendingWordDeserializerTest, CircularListTest, Tagger2Test, TestReplicationHandler, TestHdfsUpdateLog, TestDownShardTolerantSearch, MultiThreadedOCPTest, DistributedDebugComponentTest, ZkStateWriterTest, TestIndexingPerformance, TestSha256AuthenticationProvider, MissingSegmentRecoveryTest, TestPseudoReturnFields, CollectionsAPISolrJTest, TestDistributedSearch, WordBreakSolrSpellCheckerTest, TestSchemaSimilarityResource, TestTolerantUpdateProcessorCloud, SignatureUpdateProcessorFactoryTest, TestScoreJoinQPNoScore, TestRebalanceLeaders, SolrRequestParserTest, ConfigureRecoveryStrategyTest, SolrIndexConfigTest, SpellCheckCollatorTest, DeleteShardTest, TestTrackingShardHandlerFactory, TestCollectionAPIs, RankQueryTest, LeaderVoteWaitTimeoutTest, BlockJoinFacetRandomTest, ConnectionReuseTest, ClusterStateMockUtilTest, CreateRoutedAliasTest, ResponseBuilderTest, TestFieldCacheWithThreads, AlternateDirectoryTest, TestFieldCache, UpdateParamsTest, TestFastLRUCache, TestCloudInspectUtil, FieldMutatingUpdateProcessorTest, TestLogWatcher, TestZkChroot, TestSystemIdResolver, HLLSerializationTest, DistributedFacetPivotSmallAdvancedTest, HdfsAutoAddReplicasIntegrationTest, SharedFSAutoReplicaFailoverTest, SliceStateTest, SolrCLIZkUtilsTest, SplitShardTest, TestCloudPseudoReturnFields, TestCloudSearcherWarming, TestPullReplica, TestPullReplicaErrorHandling, TestSolrCloudWithSecureImpersonation, TestStressLiveNodes, CollectionsAPIDistributedZkTest]
[junit4] Completed [906/908 (3!)] on J1 in 162.77s, 19 tests, 1 error <<< FAILURES!
[...truncated 48027 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-MacOSX/981/consoleText
[repro] Revision: c7de68402344882b87eb2528453413a3be8c7a6d
[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseParallelGC"
[repro] Repro line: ant test -Dtestcase=HttpPartitionWithTlogReplicasTest -Dtests.seed=84019185229D1135 -Dtests.slow=true -Dtests.locale=sn-ZW -Dtests.timezone=America/Guyana -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[repro] Repro line: ant test -Dtestcase=ZkFailoverTest -Dtests.method=testRestartZkWhenClusterDown -Dtests.seed=84019185229D1135 -Dtests.slow=true -Dtests.locale=as-IN -Dtests.timezone=Asia/Oral -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[repro] Repro line: ant test -Dtestcase=ZkFailoverTest -Dtests.seed=84019185229D1135 -Dtests.slow=true -Dtests.locale=as-IN -Dtests.timezone=Asia/Oral -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[repro] Repro line: ant test -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.method=testCollectionsAPI -Dtests.seed=84019185229D1135 -Dtests.slow=true -Dtests.locale=en-BE -Dtests.timezone=America/Creston -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] CollectionsAPIDistributedZkTest
[repro] ZkFailoverTest
[repro] HttpPartitionWithTlogReplicasTest
[repro] ant compile-test
[...truncated 3484 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=15 -Dtests.class="*.CollectionsAPIDistributedZkTest|*.ZkFailoverTest|*.HttpPartitionWithTlogReplicasTest" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseParallelGC" -Dtests.seed=84019185229D1135 -Dtests.slow=true -Dtests.locale=en-BE -Dtests.timezone=America/Creston -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[...truncated 217 lines...]
[repro] Failures w/original seeds:
[repro] 0/5 failed: org.apache.solr.cloud.HttpPartitionWithTlogReplicasTest
[repro] 0/5 failed: org.apache.solr.cloud.ZkFailoverTest
[repro] 0/5 failed: org.apache.solr.cloud.api.collections.CollectionsAPIDistributedZkTest
[repro] Exiting with code 0
[...truncated 73 lines...]
[JENKINS] Lucene-Solr-8.x-MacOSX (64bit/jdk-14) - Build # 982 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-MacOSX/982/
Java: 64bit/jdk-14 -XX:-UseCompressedOops -XX:+UseSerialGC
2 tests failed.
FAILED: org.noggit.TestJSONParser.testArray
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([AF426575977FD20A]:0)
FAILED: junit.framework.TestSuite.org.noggit.TestJSONParser
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([AF426575977FD20A]:0)
Build Log:
[...truncated 17612 lines...]
[junit4] Suite: org.noggit.TestJSONParser
[junit4] 2> 247778 INFO (SUITE-TestJSONParser-seed#[AF426575977FD20A]-worker) [ ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/server/solr/configsets/_default/conf'
[junit4] 2> 247779 INFO (SUITE-TestJSONParser-seed#[AF426575977FD20A]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-solrj/test/J2/temp/org.noggit.TestJSONParser_AF426575977FD20A-001/data-dir-11-001
[junit4] 2> 247779 WARN (SUITE-TestJSONParser-seed#[AF426575977FD20A]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=298 numCloses=298
[junit4] 2> 247779 INFO (SUITE-TestJSONParser-seed#[AF426575977FD20A]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 247780 INFO (SUITE-TestJSONParser-seed#[AF426575977FD20A]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 247780 INFO (SUITE-TestJSONParser-seed#[AF426575977FD20A]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 247782 INFO (TEST-TestJSONParser.testAPI-seed#[AF426575977FD20A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testAPI
[junit4] 2> 247782 INFO (TEST-TestJSONParser.testAPI-seed#[AF426575977FD20A]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testAPI
[junit4] 2> 247784 INFO (TEST-TestJSONParser.testObject-seed#[AF426575977FD20A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testObject
[junit4] 2> 250543 INFO (TEST-TestJSONParser.testObject-seed#[AF426575977FD20A]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testObject
[junit4] 2> 250557 INFO (TEST-TestJSONParser.testTopLevelValues-seed#[AF426575977FD20A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testTopLevelValues
[junit4] 2> 250560 INFO (TEST-TestJSONParser.testTopLevelValues-seed#[AF426575977FD20A]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testTopLevelValues
[junit4] 2> 250571 INFO (TEST-TestJSONParser.testArray-seed#[AF426575977FD20A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testArray
[junit4] 2> mei 12, 2020 7:48:04 A.M. com.carrotsearch.randomizedtesting.ThreadLeakControl$2 evaluate
[junit4] 2> WARNING: Suite execution timed out: org.noggit.TestJSONParser
[junit4] 2> ==== jstack at approximately timeout time ====
[junit4] 2> "main" ID=1 WAITING on com.carrotsearch.randomizedtesting.RandomizedRunner$2@45c4dee9
[junit4] 2> at java.base@14/java.lang.Object.wait(Native Method)
[junit4] 2> - waiting on com.carrotsearch.randomizedtesting.RandomizedRunner$2@45c4dee9
[junit4] 2> at java.base@14/java.lang.Thread.join(Thread.java:1303)
[junit4] 2> at java.base@14/java.lang.Thread.join(Thread.java:1371)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:639)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner.run(RandomizedRunner.java:496)
[junit4] 2> at app//com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:269)
[junit4] 2> at app//com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:394)
[junit4] 2> at app//com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:13)
[junit4] 2>
[junit4] 2> "Reference Handler" ID=2 RUNNABLE
[junit4] 2> at java.base@14/java.lang.ref.Reference.waitForReferencePendingList(Native Method)
[junit4] 2> at java.base@14/java.lang.ref.Reference.processPendingReferences(Reference.java:241)
[junit4] 2> at java.base@14/java.lang.ref.Reference$ReferenceHandler.run(Reference.java:213)
[junit4] 2>
[junit4] 2> "Finalizer" ID=3 WAITING on java.lang.ref.ReferenceQueue$Lock@6abff00c
[junit4] 2> at java.base@14/java.lang.Object.wait(Native Method)
[junit4] 2> - waiting on java.lang.ref.ReferenceQueue$Lock@6abff00c
[junit4] 2> at java.base@14/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
[junit4] 2> at java.base@14/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
[junit4] 2> at java.base@14/java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:170)
[junit4] 2>
[junit4] 2> "Signal Dispatcher" ID=4 RUNNABLE
[junit4] 2>
[junit4] 2> "Common-Cleaner" ID=10 TIMED_WAITING on java.lang.ref.ReferenceQueue$Lock@225ad6b8
[junit4] 2> at java.base@14/java.lang.Object.wait(Native Method)
[junit4] 2> - timed waiting on java.lang.ref.ReferenceQueue$Lock@225ad6b8
[junit4] 2> at java.base@14/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
[junit4] 2> at java.base@14/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:148)
[junit4] 2> at java.base@14/java.lang.Thread.run(Thread.java:832)
[junit4] 2> at java.base@14/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)
[junit4] 2>
[junit4] 2> "Notification Thread" ID=11 RUNNABLE
[junit4] 2>
[junit4] 2> "JUnit4-serializer-daemon" ID=12 TIMED_WAITING
[junit4] 2> at java.base@14/java.lang.Thread.sleep(Native Method)
[junit4] 2> at app//com.carrotsearch.ant.tasks.junit4.events.Serializer$1.run(Serializer.java:50)
[junit4] 2>
[junit4] 2> "Log4j2-TF-1-AsyncLoggerConfig-1" ID=15 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@418a678c
[junit4] 2> at java.base@14/jdk.internal.misc.Unsafe.park(Native Method)
[junit4] 2> - timed waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@418a678c
[junit4] 2> at java.base@14/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252)
[junit4] 2> at java.base@14/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1661)
[junit4] 2> at app//com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
[junit4] 2> at app//com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
[junit4] 2> at app//com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
[junit4] 2> at app//com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
[junit4] 2> at java.base@14/java.lang.Thread.run(Thread.java:832)
[junit4] 2>
[junit4] 2> "ForkJoinPool.commonPool-worker-3" ID=1061 WAITING on java.util.concurrent.ForkJoinPool@5cba165d
[junit4] 2> at java.base@14/jdk.internal.misc.Unsafe.park(Native Method)
[junit4] 2> - waiting on java.util.concurrent.ForkJoinPool@5cba165d
[junit4] 2> at java.base@14/java.util.concurrent.locks.LockSupport.park(LockSupport.java:211)
[junit4] 2> at java.base@14/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1633)
[junit4] 2> at java.base@14/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:177)
[junit4] 2>
[junit4] 2> "ForkJoinPool.commonPool-worker-9" ID=6777 WAITING on java.util.concurrent.ForkJoinPool@5cba165d
[junit4] 2> at java.base@14/jdk.internal.misc.Unsafe.park(Native Method)
[junit4] 2> - waiting on java.util.concurrent.ForkJoinPool@5cba165d
[junit4] 2> at java.base@14/java.util.concurrent.locks.LockSupport.park(LockSupport.java:211)
[junit4] 2> at java.base@14/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1633)
[junit4] 2> at java.base@14/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:177)
[junit4] 2>
[junit4] 2> "ForkJoinPool.commonPool-worker-11" ID=6780 WAITING on java.util.concurrent.ForkJoinPool@5cba165d
[junit4] 2> at java.base@14/jdk.internal.misc.Unsafe.park(Native Method)
[junit4] 2> - waiting on java.util.concurrent.ForkJoinPool@5cba165d
[junit4] 2> at java.base@14/java.util.concurrent.locks.LockSupport.park(LockSupport.java:211)
[junit4] 2> at java.base@14/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1633)
[junit4] 2> at java.base@14/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:177)
[junit4] 2>
[junit4] 2> "ForkJoinPool.commonPool-worker-13" ID=6782 WAITING on java.util.concurrent.ForkJoinPool@5cba165d
[junit4] 2> at java.base@14/jdk.internal.misc.Unsafe.park(Native Method)
[junit4] 2> - waiting on java.util.concurrent.ForkJoinPool@5cba165d
[junit4] 2> at java.base@14/java.util.concurrent.locks.LockSupport.park(LockSupport.java:211)
[junit4] 2> at java.base@14/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1635)
[junit4] 2> at java.base@14/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:177)
[junit4] 2>
[junit4] 2> "ForkJoinPool.commonPool-worker-7" ID=6776 TIMED_WAITING on java.util.concurrent.ForkJoinPool@5cba165d
[junit4] 2> at java.base@14/jdk.internal.misc.Unsafe.park(Native Method)
[junit4] 2> - timed waiting on java.util.concurrent.ForkJoinPool@5cba165d
[junit4] 2> at java.base@14/java.util.concurrent.locks.LockSupport.parkUntil(LockSupport.java:293)
[junit4] 2> at java.base@14/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1624)
[junit4] 2> at java.base@14/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:177)
[junit4] 2>
[junit4] 2> "SUITE-TestJSONParser-seed#[AF426575977FD20A]" ID=6831 RUNNABLE
[junit4] 2> at java.management@14/sun.management.ThreadImpl.dumpThreads0(Native Method)
[junit4] 2> at java.management@14/sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:521)
[junit4] 2> at java.management@14/sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:509)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.ThreadLeakControl.formatThreadStacksFull(ThreadLeakControl.java:681)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.ThreadLeakControl.access$1000(ThreadLeakControl.java:65)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:415)
[junit4] 2> - locked java.lang.Object@4990b256
[junit4] 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:708)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:138)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:629)
[junit4] 2>
[junit4] 2> "TEST-TestJSONParser.testArray-seed#[AF426575977FD20A]" ID=6832 RUNNABLE
[junit4] 2> at java.base@14/java.lang.Throwable.fillInStackTrace(Native Method)
[junit4] 2> at java.base@14/java.lang.Throwable.fillInStackTrace(Throwable.java:799)
[junit4] 2> - locked org.noggit.JSONParser$ParseException@3d0b42ca
[junit4] 2> at java.base@14/java.lang.Throwable.<init>(Throwable.java:272)
[junit4] 2> at java.base@14/java.lang.Exception.<init>(Exception.java:67)
[junit4] 2> at java.base@14/java.lang.RuntimeException.<init>(RuntimeException.java:63)
[junit4] 2> at app//org.noggit.JSONParser$ParseException.<init>(JSONParser.java:103)
[junit4] 2> at app//org.noggit.JSONParser.err(JSONParser.java:452)
[junit4] 2> at app//org.noggit.JSONParser.getMore(JSONParser.java:248)
[junit4] 2> at app//org.noggit.JSONParser.readStringChars2(JSONParser.java:754)
[junit4] 2> at app//org.noggit.JSONParser.nextEvent(JSONParser.java:1061)
[junit4] 2> at app//org.noggit.TestJSONParser.testCorruption(TestJSONParser.java:185)
[junit4] 2> at app//org.noggit.TestJSONParser.parse(TestJSONParser.java:132)
[junit4] 2> at app//org.noggit.TestJSONParser.testArray(TestJSONParser.java:535)
[junit4] 2> at java.base@14/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at java.base@14/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at java.base@14/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.base@14/java.lang.reflect.Method.invoke(Method.java:564)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at app//org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
[junit4] 2> at app//org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at app//org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
[junit4] 2> at app//org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at app//org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at app//org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at app//org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at app//org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
[junit4] 2> at app//org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[junit4] 2> at app//org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
[junit4] 2> at app//org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
[junit4] 2> at java.base@14/java.lang.Thread.run(Thread.java:832)
[junit4] 2>
[junit4] 2> ^^==============================================
[junit4] 2>
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestJSONParser -Dtests.method=testArray -Dtests.seed=AF426575977FD20A -Dtests.slow=true -Dtests.locale=nl-BQ -Dtests.timezone=Australia/Brisbane -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 4.59s J2 | TestJSONParser.testArray <<<
[junit4] > Throwable #1: java.lang.Exception: Test abandoned because suite timeout was reached.
[junit4] > at __randomizedtesting.SeedInfo.seed([AF426575977FD20A]:0)
[junit4] 2> mei 12, 2020 7:48:04 A.M. com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> 260244 INFO (TEST-TestJSONParser.testArray-seed#[AF426575977FD20A]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testArray
[junit4] 2> 260244 INFO (SUITE-TestJSONParser-seed#[AF426575977FD20A]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene84): {}, docValues:{}, maxPointsInLeafNode=633, maxMBSortInHeap=5.2111777812094795, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@62e6403a), locale=nl-BQ, timezone=Australia/Brisbane
[junit4] 2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 14 (64-bit)/cpus=6,threads=1,free=60604632,total=334553088
[junit4] 2> NOTE: All tests run in this JVM: [ConcurrentUpdateSolrClientBadInputTest, AbsoluteValueEvaluatorTest, RegressionEvaluatorTest, TermsFacetMapTest, TestCloudSolrClientConnections, CloudHttp2SolrClientTest, TestPolicyOld, CoalesceEvaluatorTest, SubtractEvaluatorTest, ArcSineEvaluatorTest, SolrPingTest, CumulativeProbabilityEvaluatorTest, NestableJsonFacetTest, SolrZkClientTest, NotEvaluatorTest, TestDelegationTokenResponse, UsingSolrJRefGuideExamplesTest, StreamDecoratorTest, HyperbolicSineEvaluatorTest, TestFastWriter, TestJSONParser]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestJSONParser -Dtests.seed=AF426575977FD20A -Dtests.slow=true -Dtests.locale=nl-BQ -Dtests.timezone=Australia/Brisbane -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J2 | TestJSONParser (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4] > at __randomizedtesting.SeedInfo.seed([AF426575977FD20A]:0)
[junit4] Completed [207/208 (1!)] on J2 in 12.49s, 4 tests, 2 errors <<< FAILURES!
[...truncated 43650 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-MacOSX/982/consoleText
[repro] Revision: b77d693c807e6afb9063bbf67dafc63abf28f121
[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC"
[repro] Repro line: ant test -Dtestcase=TestJSONParser -Dtests.method=testArray -Dtests.seed=AF426575977FD20A -Dtests.slow=true -Dtests.locale=nl-BQ -Dtests.timezone=Australia/Brisbane -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] Repro line: ant test -Dtestcase=TestJSONParser -Dtests.seed=AF426575977FD20A -Dtests.slow=true -Dtests.locale=nl-BQ -Dtests.timezone=Australia/Brisbane -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/solrj
[repro] TestJSONParser
[repro] ant compile-test
[...truncated 2618 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestJSONParser" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC" -Dtests.seed=AF426575977FD20A -Dtests.slow=true -Dtests.locale=nl-BQ -Dtests.timezone=Australia/Brisbane -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[...truncated 126 lines...]
[repro] Failures w/original seeds:
[repro] 0/5 failed: org.noggit.TestJSONParser
[repro] Exiting with code 0
[...truncated 73 lines...]