You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/12/08 14:21:06 UTC

[JENKINS-EA] Lucene-Solr-7.x-Linux (64bit/jdk-12-ea+12) - Build # 3192 - Still Unstable!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/3192/
Java: 64bit/jdk-12-ea+12 -XX:-UseCompressedOops -XX:+UseParallelGC

11 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TriLevelCompositeIdRoutingTest

Error Message:
42 threads leaked from SUITE scope at org.apache.solr.cloud.TriLevelCompositeIdRoutingTest:     1) Thread[id=770, name=Scheduler-787107667, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    2) Thread[id=759, name=Thread-129, state=WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/java.lang.Object.wait(Native Method)         at java.base@12-ea/java.lang.Object.wait(Object.java:328)         at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1892)    3) Thread[id=712, name=MetricsHistoryHandler-188-thread-1, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    4) Thread[id=738, name=Thread-128, state=WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/java.lang.Object.wait(Native Method)         at java.base@12-ea/java.lang.Object.wait(Object.java:328)         at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1892)    5) Thread[id=684, name=Scheduler-1916308427, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    6) Thread[id=669, name=qtp272754038-669, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    7) Thread[id=737, name=MetricsHistoryHandler-197-thread-1, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    8) Thread[id=676, name=qtp267958823-676, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)         at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f98c4036858.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    9) Thread[id=680, name=qtp267958823-680, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   10) Thread[id=708, name=qtp226432624-708, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   11) Thread[id=711, name=qtp226432624-711, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   12) Thread[id=771, name=Scheduler-1625767389, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   13) Thread[id=713, name=Scheduler-800973497, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   14) Thread[id=662, name=qtp272754038-662, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)         at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f98c4036858.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   15) Thread[id=707, name=qtp226432624-707-acceptor-0@376af163-ServerConnector@57ae2ca9{SSL,[ssl, http/1.1]}{127.0.0.1:46095}, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:525)         at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:277)         at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:385)         at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:648)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   16) Thread[id=718, name=coreContainerWorkExecutor-180-thread-1, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@12-ea/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   17) Thread[id=739, name=coreContainerWorkExecutor-185-thread-1, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@12-ea/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   18) Thread[id=665, name=qtp272754038-665, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)         at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f98c4036858.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   19) Thread[id=678, name=qtp267958823-678, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)         at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f98c4036858.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   20) Thread[id=666, name=qtp272754038-666, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)         at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f98c4036858.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   21) Thread[id=667, name=qtp272754038-667, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   22) Thread[id=682, name=qtp267958823-682, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   23) Thread[id=700, name=qtp226432624-700, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)         at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f98c4036858.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   24) Thread[id=760, name=coreContainerWorkExecutor-191-thread-1, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@12-ea/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   25) Thread[id=703, name=qtp226432624-703, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)         at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f98c4036858.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   26) Thread[id=663, name=qtp272754038-663, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)         at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f98c4036858.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   27) Thread[id=668, name=qtp272754038-668, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   28) Thread[id=717, name=Thread-127, state=WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/java.lang.Object.wait(Native Method)         at java.base@12-ea/java.lang.Object.wait(Object.java:328)         at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1892)   29) Thread[id=677, name=qtp267958823-677, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)         at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f98c4036858.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   30) Thread[id=679, name=qtp267958823-679-acceptor-0@22bec9dc-ServerConnector@3605c662{SSL,[ssl, http/1.1]}{127.0.0.1:40281}, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:525)         at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:277)         at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:385)         at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:648)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   31) Thread[id=772, name=Scheduler-1279401035, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   32) Thread[id=736, name=SolrRrdBackendFactory-196-thread-1, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   33) Thread[id=757, name=SolrRrdBackendFactory-203-thread-1, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   34) Thread[id=695, name=qtp226432624-695, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)         at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f98c4036858.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   35) Thread[id=698, name=qtp226432624-698, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)         at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f98c4036858.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   36) Thread[id=709, name=qtp226432624-709, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   37) Thread[id=758, name=MetricsHistoryHandler-204-thread-1, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   38) Thread[id=664, name=qtp272754038-664-acceptor-0@3dd6e08f-ServerConnector@5e3d94eb{SSL,[ssl, http/1.1]}{127.0.0.1:44935}, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:525)         at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:277)         at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:385)         at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:648)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   39) Thread[id=670, name=Scheduler-729896217, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   40) Thread[id=675, name=qtp267958823-675, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)         at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f98c4036858.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   41) Thread[id=710, name=SolrRrdBackendFactory-187-thread-1, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   42) Thread[id=681, name=qtp267958823-681, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 42 threads leaked from SUITE scope at org.apache.solr.cloud.TriLevelCompositeIdRoutingTest: 
   1) Thread[id=770, name=Scheduler-787107667, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   2) Thread[id=759, name=Thread-129, state=WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/java.lang.Object.wait(Native Method)
        at java.base@12-ea/java.lang.Object.wait(Object.java:328)
        at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1892)
   3) Thread[id=712, name=MetricsHistoryHandler-188-thread-1, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   4) Thread[id=738, name=Thread-128, state=WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/java.lang.Object.wait(Native Method)
        at java.base@12-ea/java.lang.Object.wait(Object.java:328)
        at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1892)
   5) Thread[id=684, name=Scheduler-1916308427, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   6) Thread[id=669, name=qtp272754038-669, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   7) Thread[id=737, name=MetricsHistoryHandler-197-thread-1, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   8) Thread[id=676, name=qtp267958823-676, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f98c4036858.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   9) Thread[id=680, name=qtp267958823-680, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  10) Thread[id=708, name=qtp226432624-708, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  11) Thread[id=711, name=qtp226432624-711, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  12) Thread[id=771, name=Scheduler-1625767389, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  13) Thread[id=713, name=Scheduler-800973497, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  14) Thread[id=662, name=qtp272754038-662, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f98c4036858.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  15) Thread[id=707, name=qtp226432624-707-acceptor-0@376af163-ServerConnector@57ae2ca9{SSL,[ssl, http/1.1]}{127.0.0.1:46095}, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
        at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:525)
        at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:277)
        at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:385)
        at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:648)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  16) Thread[id=718, name=coreContainerWorkExecutor-180-thread-1, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@12-ea/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  17) Thread[id=739, name=coreContainerWorkExecutor-185-thread-1, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@12-ea/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  18) Thread[id=665, name=qtp272754038-665, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f98c4036858.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  19) Thread[id=678, name=qtp267958823-678, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f98c4036858.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  20) Thread[id=666, name=qtp272754038-666, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f98c4036858.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  21) Thread[id=667, name=qtp272754038-667, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  22) Thread[id=682, name=qtp267958823-682, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  23) Thread[id=700, name=qtp226432624-700, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f98c4036858.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  24) Thread[id=760, name=coreContainerWorkExecutor-191-thread-1, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@12-ea/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  25) Thread[id=703, name=qtp226432624-703, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f98c4036858.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  26) Thread[id=663, name=qtp272754038-663, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f98c4036858.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  27) Thread[id=668, name=qtp272754038-668, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  28) Thread[id=717, name=Thread-127, state=WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/java.lang.Object.wait(Native Method)
        at java.base@12-ea/java.lang.Object.wait(Object.java:328)
        at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1892)
  29) Thread[id=677, name=qtp267958823-677, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f98c4036858.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  30) Thread[id=679, name=qtp267958823-679-acceptor-0@22bec9dc-ServerConnector@3605c662{SSL,[ssl, http/1.1]}{127.0.0.1:40281}, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
        at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:525)
        at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:277)
        at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:385)
        at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:648)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  31) Thread[id=772, name=Scheduler-1279401035, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  32) Thread[id=736, name=SolrRrdBackendFactory-196-thread-1, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  33) Thread[id=757, name=SolrRrdBackendFactory-203-thread-1, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  34) Thread[id=695, name=qtp226432624-695, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f98c4036858.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  35) Thread[id=698, name=qtp226432624-698, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f98c4036858.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  36) Thread[id=709, name=qtp226432624-709, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  37) Thread[id=758, name=MetricsHistoryHandler-204-thread-1, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  38) Thread[id=664, name=qtp272754038-664-acceptor-0@3dd6e08f-ServerConnector@5e3d94eb{SSL,[ssl, http/1.1]}{127.0.0.1:44935}, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
        at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:525)
        at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:277)
        at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:385)
        at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:648)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  39) Thread[id=670, name=Scheduler-729896217, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  40) Thread[id=675, name=qtp267958823-675, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f98c4036858.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  41) Thread[id=710, name=SolrRrdBackendFactory-187-thread-1, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  42) Thread[id=681, name=qtp267958823-681, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)
        at app//org.eclipse.jetty.util.thread.Queued

[...truncated too long message...]

hatYouKill.java:168)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
   [junit4]    >         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f98c4036858.run(Unknown Source)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
   [junit4]    >         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   [junit4]    >   26) Thread[id=698, name=qtp226432624-698, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]
   [junit4]    >         at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)
   [junit4]    >         at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
   [junit4]    >         at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
   [junit4]    >         at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
   [junit4]    >         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
   [junit4]    >         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
   [junit4]    >         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f98c4036858.run(Unknown Source)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
   [junit4]    >         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   [junit4]    >   27) Thread[id=758, name=MetricsHistoryHandler-204-thread-1, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
   [junit4]    >         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
   [junit4]    >         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
   [junit4]    >         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
   [junit4]    >         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
   [junit4]    >         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
   [junit4]    >         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
   [junit4]    >         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
   [junit4]    >         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   [junit4]    >   28) Thread[id=670, name=Scheduler-729896217, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
   [junit4]    >         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
   [junit4]    >         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
   [junit4]    >         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
   [junit4]    >         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
   [junit4]    >         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
   [junit4]    >         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
   [junit4]    >         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
   [junit4]    >         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   [junit4]    >   29) Thread[id=675, name=qtp267958823-675, state=RUNNABLE, group=TGRP-TriLevelCompositeIdRoutingTest]
   [junit4]    >         at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)
   [junit4]    >         at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
   [junit4]    >         at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
   [junit4]    >         at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
   [junit4]    >         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
   [junit4]    >         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
   [junit4]    >         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f98c4036858.run(Unknown Source)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
   [junit4]    >         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   [junit4]    >   30) Thread[id=710, name=SolrRrdBackendFactory-187-thread-1, state=TIMED_WAITING, group=TGRP-TriLevelCompositeIdRoutingTest]
   [junit4]    >         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
   [junit4]    >         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
   [junit4]    >         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
   [junit4]    >         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
   [junit4]    >         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
   [junit4]    >         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
   [junit4]    >         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
   [junit4]    >         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([1C2C2DCD4D281CB2]:0)
   [junit4] Completed [15/15 (4!)] on J1 in 45.60s, 1 test, 3 errors <<< FAILURES!

[...truncated 15 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1572: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1099: There were test failures: 15 suites, 40 tests, 2 suite-level errors, 4 errors [seed: 1C2C2DCD4D281CB2]

Total time: 1 minute 16 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   1/5 failed: org.apache.solr.cloud.SplitShardTest
[repro]   1/5 failed: org.apache.solr.cloud.TriLevelCompositeIdRoutingTest
[repro]   2/5 failed: org.apache.solr.handler.component.DistributedDebugComponentTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=d9cd9f78b1182125a7fb02d724608d5f355df785, workspace=/var/lib/jenkins/workspace/Lucene-Solr-7.x-Linux
[WARNINGS] Computing warning deltas based on reference build #3191
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk-11) - Build # 3195 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/3195/
Java: 64bit/jdk-11 -XX:+UseCompressedOops -XX:+UseG1GC

15 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.handler.TestSolrConfigHandlerCloud

Error Message:
59 threads leaked from SUITE scope at org.apache.solr.handler.TestSolrConfigHandlerCloud:     1) Thread[id=26900, name=SolrRrdBackendFactory-9217-thread-1, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11/java.lang.Thread.run(Thread.java:834)    2) Thread[id=26917, name=qtp1025025684-26917, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/sun.nio.ch.EPoll.wait(Native Method)         at java.base@11/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@11/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@11/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$342/0x00000001004fb040.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@11/java.lang.Thread.run(Thread.java:834)    3) Thread[id=27006, name=recoveryExecutor-8594-thread-1, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@11/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@11/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11/java.lang.Thread.run(Thread.java:834)    4) Thread[id=26859, name=qtp1488677467-26859-acceptor-0@c911aaf-ServerConnector@19bf39e0{SSL,[ssl, http/1.1]}{127.0.0.1:38557}, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at java.base@11/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:533)         at java.base@11/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:285)         at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:385)         at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:648)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@11/java.lang.Thread.run(Thread.java:834)    5) Thread[id=26843, name=qtp15735308-26843, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/sun.nio.ch.EPoll.wait(Native Method)         at java.base@11/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@11/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@11/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$342/0x00000001004fb040.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@11/java.lang.Thread.run(Thread.java:834)    6) Thread[id=26969, name=SolrRrdBackendFactory-9237-thread-1, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11/java.lang.Thread.run(Thread.java:834)    7) Thread[id=26860, name=qtp1488677467-26860, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@11/java.lang.Thread.run(Thread.java:834)    8) Thread[id=26841, name=qtp15735308-26841, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/sun.nio.ch.EPoll.wait(Native Method)         at java.base@11/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@11/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@11/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$342/0x00000001004fb040.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@11/java.lang.Thread.run(Thread.java:834)    9) Thread[id=26873, name=qtp251493593-26873, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/sun.nio.ch.EPoll.wait(Native Method)         at java.base@11/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@11/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@11/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$342/0x00000001004fb040.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@11/java.lang.Thread.run(Thread.java:834)   10) Thread[id=26844, name=qtp15735308-26844, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/sun.nio.ch.EPoll.wait(Native Method)         at java.base@11/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@11/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@11/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$342/0x00000001004fb040.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@11/java.lang.Thread.run(Thread.java:834)   11) Thread[id=26879, name=qtp251493593-26879, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@11/java.lang.Thread.run(Thread.java:834)   12) Thread[id=26861, name=qtp1488677467-26861, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@11/java.lang.Thread.run(Thread.java:834)   13) Thread[id=26925, name=Scheduler-81609907, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11/java.lang.Thread.run(Thread.java:834)   14) Thread[id=26845, name=qtp15735308-26845-acceptor-0@76def5a1-ServerConnector@1b3ddf7e{SSL,[ssl, http/1.1]}{127.0.0.1:46411}, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at java.base@11/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:533)         at java.base@11/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:285)         at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:385)         at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:648)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@11/java.lang.Thread.run(Thread.java:834)   15) Thread[id=26907, name=Thread-4874, state=WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/java.lang.Object.wait(Native Method)         at java.base@11/java.lang.Object.wait(Object.java:328)         at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1892)   16) Thread[id=26846, name=qtp15735308-26846, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@11/java.lang.Thread.run(Thread.java:834)   17) Thread[id=26986, name=Scheduler-1338013410, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11/java.lang.Thread.run(Thread.java:834)   18) Thread[id=26919, name=qtp1025025684-26919, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/sun.nio.ch.EPoll.wait(Native Method)         at java.base@11/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@11/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@11/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$342/0x00000001004fb040.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@11/java.lang.Thread.run(Thread.java:834)   19) Thread[id=26880, name=qtp251493593-26880, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@11/java.lang.Thread.run(Thread.java:834)   20) Thread[id=26848, name=qtp15735308-26848, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@11/java.lang.Thread.run(Thread.java:834)   21) Thread[id=26914, name=MetricsHistoryHandler-9222-thread-1, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11/java.lang.Thread.run(Thread.java:834)   22) Thread[id=26929, name=Thread-4883, state=WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/java.lang.Object.wait(Native Method)         at java.base@11/java.lang.Object.wait(Object.java:328)         at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1892)   23) Thread[id=26902, name=MetricsHistoryHandler-9218-thread-1, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11/java.lang.Thread.run(Thread.java:834)   24) Thread[id=26984, name=Scheduler-1358164506, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11/java.lang.Thread.run(Thread.java:834)   25) Thread[id=26971, name=Thread-4885, state=WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/java.lang.Object.wait(Native Method)         at java.base@11/java.lang.Object.wait(Object.java:328)         at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1892)   26) Thread[id=26924, name=qtp1025025684-26924, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@11/java.lang.Thread.run(Thread.java:834)   27) Thread[id=26877, name=qtp251493593-26877, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/sun.nio.ch.EPoll.wait(Native Method)         at java.base@11/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@11/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@11/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$342/0x00000001004fb040.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@11/java.lang.Thread.run(Thread.java:834)   28) Thread[id=26970, name=MetricsHistoryHandler-9238-thread-1, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11/java.lang.Thread.run(Thread.java:834)   29) Thread[id=26911, name=coreContainerWorkExecutor-9207-thread-1, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@11/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@11/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11/java.lang.Thread.run(Thread.java:834)   30) Thread[id=27005, name=updateExecutor-8593-thread-1, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@11/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@11/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11/java.lang.Thread.run(Thread.java:834)   31) Thread[id=26842, name=qtp15735308-26842, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/sun.nio.ch.EPoll.wait(Native Method)         at java.base@11/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@11/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@11/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$342/0x00000001004fb040.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@11/java.lang.Thread.run(Thread.java:834)   32) Thread[id=26930, name=coreContainerWorkExecutor-9205-thread-1, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@11/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@11/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11/java.lang.Thread.run(Thread.java:834)   33) Thread[id=26862, name=Scheduler-1676730913, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11/java.lang.Thread.run(Thread.java:834)   34) Thread[id=26921, name=qtp1025025684-26921-acceptor-0@3b5f60f5-ServerConnector@7accd5e8{SSL,[ssl, http/1.1]}{127.0.0.1:37717}, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at java.base@11/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:533)         at java.base@11/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:285)         at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:385)         at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:648)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@11/java.lang.Thread.run(Thread.java:834)   35) Thread[id=26918, name=qtp1025025684-26918, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/sun.nio.ch.EPoll.wait(Native Method)         at java.base@11/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@11/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@11/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$342/0x00000001004fb040.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@11/java.lang.Thread.run(Thread.java:834)   36) Thread[id=26857, name=qtp1488677467-26857, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/sun.nio.ch.EPoll.wait(Native Method)         at java.base@11/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@11/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@11/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$342/0x00000001004fb040.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@11/java.lang.Thread.run(Thread.java:834)   37) Thread[id=26985, name=Scheduler-428236896, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11/java.lang.Thread.run(Thread.java:834)   38) Thread[id=26855, name=qtp1488677467-26855, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/sun.nio.ch.EPoll.wait(Native Method)         at java.base@11/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@11/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@11/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$342/0x00000001004fb040.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@11/java.lang.Thread.run(Thread.java:834)   39) Thread[id=26922, name=qtp1025025684-26922, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@11/java.lang.Thread.run(Thread.java:834)   40) Thread[id=26847, name=qtp15735308-26847, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@11/java.lang.Thread.run(Thread.java:834)   41) Thread[id=26949, name=MetricsHistoryHandler-9231-thread-1, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11/java.lang.Thread.run(Thread.java:834)   42) Thread[id=26858, name=qtp1488677467-26858, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@11/java.lang.Thread.run(Thread.java:834)   43) Thread[id=26950, name=Thread-4884, state=WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/java.lang.Object.wait(Native Method)         at java.base@11/java.lang.Object.wait(Object.java:328)         at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1892)   44) Thread[id=26849, name=Scheduler-391686753, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11/java.lang.Thread.run(Thread.java:834)   45) Thread[id=26884, name=Scheduler-1467199824, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11/java.lang.Thread.run(Thread.java:834)   46) Thread[id=26948, name=SolrRrdBackendFactory-9230-thread-1, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11/java.lang.Thread.run(Thread.java:834)   47) Thread[id=26972, name=coreContainerWorkExecutor-9224-thread-1, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@11/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@11/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11/java.lang.Thread.run(Thread.java:834)   48) Thread[id=27010, name=updateExecutor-8571-thread-1, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@11/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@11/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11/java.lang.Thread.run(Thread.java:834)   49) Thread[id=26913, name=SolrRrdBackendFactory-9221-thread-1, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11/java.lang.Thread.run(Thread.java:834)   50) Thread[id=26854, name=qtp1488677467-26854, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/sun.nio.ch.EPoll.wait(Native Method)         at java.base@11/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@11/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@11/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$342/0x00000001004fb040.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@11/java.lang.Thread.run(Thread.java:834)   51) Thread[id=26920, name=qtp1025025684-26920, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/sun.nio.ch.EPoll.wait(Native Method)         at java.base@11/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@11/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@11/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$342/0x00000001004fb040.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@11/java.lang.Thread.run(Thread.java:834)   52) Thread[id=26923, name=qtp1025025684-26923, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@11/java.lang.Thread.run(Thread.java:834)   53) Thread[id=26987, name=Scheduler-1103958071, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11/java.lang.Thread.run(Thread.java:834)   54) Thread[id=26875, name=qtp251493593-26875, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/sun.nio.ch.EPoll.wait(Native Method)         at java.base@11/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@11/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@11/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$342/0x00000001004fb040.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@11/java.lang.Thread.run(Thread.java:834)   55) Thread[id=26878, name=qtp251493593-26878-acceptor-0@274f2e34-ServerConnector@4edc2f56{SSL,[ssl, http/1.1]}{127.0.0.1:43275}, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at java.base@11/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:533)         at java.base@11/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:285)         at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:385)         at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:648)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@11/java.lang.Thread.run(Thread.java:834)   56) Thread[id=26874, name=qtp251493593-26874, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/sun.nio.ch.EPoll.wait(Native Method)         at java.base@11/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@11/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@11/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$342/0x00000001004fb040.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@11/java.lang.Thread.run(Thread.java:834)   57) Thread[id=26951, name=coreContainerWorkExecutor-9215-thread-1, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@11/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@11/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)         at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11/java.lang.Thread.run(Thread.java:834)   58) Thread[id=26881, name=qtp251493593-26881, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@11/java.lang.Thread.run(Thread.java:834)   59) Thread[id=26856, name=qtp1488677467-26856, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]         at java.base@11/sun.nio.ch.EPoll.wait(Native Method)         at java.base@11/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@11/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@11/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$342/0x00000001004fb040.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@11/java.lang.Thread.run(Thread.java:834)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 59 threads leaked from SUITE scope at org.apache.solr.handler.TestSolrConfigHandlerCloud: 
   1) Thread[id=26900, name=SolrRrdBackendFactory-9217-thread-1, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@11/java.lang.Thread.run(Thread.java:834)
   2) Thread[id=26917, name=qtp1025025684-26917, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@11/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@11/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@11/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$342/0x00000001004fb040.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@11/java.lang.Thread.run(Thread.java:834)
   3) Thread[id=27006, name=recoveryExecutor-8594-thread-1, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@11/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@11/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@11/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
        at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@11/java.lang.Thread.run(Thread.java:834)
   4) Thread[id=26859, name=qtp1488677467-26859-acceptor-0@c911aaf-ServerConnector@19bf39e0{SSL,[ssl, http/1.1]}{127.0.0.1:38557}, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
        at java.base@11/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:533)
        at java.base@11/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:285)
        at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:385)
        at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:648)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@11/java.lang.Thread.run(Thread.java:834)
   5) Thread[id=26843, name=qtp15735308-26843, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@11/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@11/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@11/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$342/0x00000001004fb040.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@11/java.lang.Thread.run(Thread.java:834)
   6) Thread[id=26969, name=SolrRrdBackendFactory-9237-thread-1, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@11/java.lang.Thread.run(Thread.java:834)
   7) Thread[id=26860, name=qtp1488677467-26860, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)
        at java.base@11/java.lang.Thread.run(Thread.java:834)
   8) Thread[id=26841, name=qtp15735308-26841, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@11/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@11/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@11/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$342/0x00000001004fb040.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@11/java.lang.Thread.run(Thread.java:834)
   9) Thread[id=26873, name=qtp251493593-26873, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@11/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@11/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@11/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$342/0x00000001004fb040.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@11/java.lang.Thread.run(Thread.java:834)
  10) Thread[id=26844, name=qtp15735308-26844, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@11/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@11/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@11/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$342/0x00000001004fb040.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@11/java.lang.Thread.run(Thread.java:834)
  11) Thread[id=26879, name=qtp251493593-26879, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)
        at java.base@11/java.lang.Thread.run(Thread.java:834)
  12) Thread[id=26861, name=qtp1488677467-26861, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)
        at java.base@11/java.lang.Thread.run(Thread.java:834)
  13) Thread[id=26925, name=Scheduler-81609907, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@11/java.lang.Thread.run(Thread.java:834)
  14) Thread[id=26845, name=qtp15735308-26845-acceptor-0@76def5a1-ServerConnector@1b3ddf7e{SSL,[ssl, http/1.1]}{127.0.0.1:46411}, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
        at java.base@11/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:533)
        at java.base@11/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:285)
        at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:385)
        at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:648)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@11/java.lang.Thread.run(Thread.java:834)
  15) Thread[id=26907, name=Thread-4874, state=WAITING, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/java.lang.Object.wait(Native Method)
        at java.base@11/java.lang.Object.wait(Object.java:328)
        at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1892)
  16) Thread[id=26846, name=qtp15735308-26846, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)
        at java.base@11/java.lang.Thread.run(Thread.java:834)
  17) Thread[id=26986, name=Scheduler-1338013410, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@11/java.lang.Thread.run(Thread.java:834)
  18) Thread[id=26919, name=qtp1025025684-26919, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@11/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@11/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@11/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$342/0x00000001004fb040.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@11/java.lang.Thread.run(Thread.java:834)
  19) Thread[id=26880, name=qtp251493593-26880, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)
        at java.base@11/java.lang.Thread.run(Thread.java:834)
  20) Thread[id=26848, name=qtp15735308-26848, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)
        at java.base@11/java.lang.Thread.run(Thread.java:834)
  21) Thread[id=26914, name=MetricsHistoryHandler-9222-thread-1, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@11/java.lang.Thread.run(Thread.java:834)
  22) Thread[id=26929, name=Thread-4883, state=WAITING, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/java.lang.Object.wait(Native Method)
        at java.base@11/java.lang.Object.wait(Object.java:328)
        at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1892)
  23) Thread[id=26902, name=MetricsHistoryHandler-9218-thread-1, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@11/java.lang.Thread.run(Thread.java:834)
  24) Thread[id=26984, name=Scheduler-1358164506, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@11/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@11/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@11/java.lang.Thread.run(Thread.java:834)
  25) Thread[id=26971, name=Thread-4885, state=WAITING, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/java.lang.Object.wait(Native Method)
        at java.base@11/java.lang.Object.wait(Object.java:328)
        at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1892)
  26) Thread[id=26924, name=qtp1025025684-26924, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)
        at java.base@11/java.lang.Thread.run(Thread.java:834)
  27) Thread[id=26877, name=qtp251493593-26877, state=RUNNABLE, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@11/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@11/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@11/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$342/0x00000001004fb040.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@11/java.lang.Thread.run(Thread.java:834)
  28) Thread[id=26970, name=MetricsHistoryHandler-9238-thread-1, state=TIMED_WAITING, group=TGRP-TestSolrConfigHandlerCloud]
        at java.base@11/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@11/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@11/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@11/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
       

[...truncated too long message...]

tractConnector Stopped ServerConnector@3a48bf52{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 119024 INFO  (jetty-closer-1944-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3812a59d{/solr,null,UNAVAILABLE}
   [junit4]   2> 119024 INFO  (jetty-closer-1944-thread-1) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 119026 INFO  (jetty-closer-1944-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 119026 INFO  (jetty-closer-1944-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@584a0f9c: rootName = solr_42215, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@cf271d0
   [junit4]   2> 119026 INFO  (jetty-closer-1944-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 119026 INFO  (closeThreadPool-2032-thread-2) [    ] o.a.s.c.Overseer Overseer (id=72162381807222794-127.0.0.1:42215_solr-n_0000000001) closing
   [junit4]   2> 119026 INFO  (OverseerStateUpdate-72162381807222794-127.0.0.1:42215_solr-n_0000000001) [n:127.0.0.1:42215_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:42215_solr
   [junit4]   2> 119027 INFO  (OverseerAutoScalingTriggerThread-72162381807222794-127.0.0.1:42215_solr-n_0000000001) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 119027 INFO  (closeThreadPool-2032-thread-1) [    ] o.a.s.c.Overseer Overseer (id=72162381807222794-127.0.0.1:42215_solr-n_0000000001) closing
   [junit4]   2> 119028 INFO  (jetty-closer-1944-thread-2) [    ] o.a.s.c.Overseer Overseer (id=72162381807222794-127.0.0.1:42215_solr-n_0000000001) closing
   [junit4]   2> 119028 INFO  (zkCallback-2015-thread-3) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 119028 INFO  (zkCallback-2022-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 119028 INFO  (zkCallback-2015-thread-1) [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37911_solr
   [junit4]   2> 119028 INFO  (jetty-closer-1944-thread-3) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 119028 INFO  (jetty-closer-1944-thread-2) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@1e8d610f{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 119028 INFO  (jetty-closer-1944-thread-3) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1b10921e: rootName = solr_37911, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@2ef141c0
   [junit4]   2> 119029 INFO  (jetty-closer-1944-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7aaf5d49{/solr,null,UNAVAILABLE}
   [junit4]   2> 119029 INFO  (jetty-closer-1944-thread-2) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 119030 INFO  (jetty-closer-1944-thread-3) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 119030 INFO  (jetty-closer-1944-thread-3) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5a9861ea: rootName = solr_37911, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@cf271d0
   [junit4]   2> 119030 INFO  (jetty-closer-1944-thread-3) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 119032 INFO  (jetty-closer-1944-thread-3) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@6b5dcf5a{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 119032 INFO  (jetty-closer-1944-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@721ccb71{/solr,null,UNAVAILABLE}
   [junit4]   2> 119032 INFO  (jetty-closer-1944-thread-3) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 119032 INFO  (TEST-TestMiniSolrCloudClusterSSL.testSslAndNoClientAuth-seed#[84543A2E87CE124D]) [    ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 119033 ERROR (TEST-TestMiniSolrCloudClusterSSL.testSslAndNoClientAuth-seed#[84543A2E87CE124D]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 119033 WARN  (ZkTestServer Run Thread) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	9	/solr/aliases.json
   [junit4]   2> 	4	/solr/configs/org.apache.solr.cloud.TestMiniSolrCloudClusterSSL
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 	2	/solr/collections/first_collection/terms/shard1
   [junit4]   2> 	2	/solr/collections/first_collection/terms/shard3
   [junit4]   2> 	2	/solr/collections/first_collection/terms/shard2
   [junit4]   2> 	2	/solr/collections/second_collection/terms/shard1
   [junit4]   2> 	2	/solr/collections/second_collection/terms/shard2
   [junit4]   2> 	2	/solr/collections/second_collection/terms/shard3
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	22	/solr/collections/first_collection/state.json
   [junit4]   2> 	15	/solr/collections/second_collection/state.json
   [junit4]   2> 	9	/solr/clusterstate.json
   [junit4]   2> 	9	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/autoscaling.json
   [junit4]   2> 	2	/solr/overseer_elect/election/72162381807222794-127.0.0.1:42215_solr-n_0000000001
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	9	/solr/collections
   [junit4]   2> 	7	/solr/live_nodes
   [junit4]   2> 	2	/solr/overseer/queue
   [junit4]   2> 	2	/solr/autoscaling/events/.scheduled_maintenance
   [junit4]   2> 	2	/solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 	2	/solr/overseer/collection-queue-work
   [junit4]   2> 	2	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> 119033 INFO  (TEST-TestMiniSolrCloudClusterSSL.testSslAndNoClientAuth-seed#[84543A2E87CE124D]) [    ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:38191
   [junit4]   2> 119033 INFO  (TEST-TestMiniSolrCloudClusterSSL.testSslAndNoClientAuth-seed#[84543A2E87CE124D]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 38191
   [junit4]   2> 119034 INFO  (TEST-TestMiniSolrCloudClusterSSL.testSslAndNoClientAuth-seed#[84543A2E87CE124D]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testSslAndNoClientAuth
   [junit4] OK      4.57s J0 | TestMiniSolrCloudClusterSSL.testSslAndNoClientAuth
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudClusterSSL_84543A2E87CE124D-002
   [junit4]   2> Dec 09, 2018 5:49:35 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 10 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Lucene70, sim=RandomSimilarity(queryNorm=false): {}, locale=vai-Vaii-LR, timezone=Etc/Zulu
   [junit4]   2> NOTE: Linux 4.15.0-39-generic amd64/Oracle Corporation 11 (64-bit)/cpus=8,threads=1,free=307437648,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [TestSolrConfigHandlerCloud, TestSolrConfigHandlerCloud, TestMiniSolrCloudClusterSSL, TestMiniSolrCloudClusterSSL]
   [junit4] Completed [15/15 (7!)] on J0 in 27.53s, 6 tests, 2 errors <<< FAILURES!

[...truncated 20 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1572: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1099: There were test failures: 15 suites, 40 tests, 10 errors [seed: 84543A2E87CE124D]

Total time: 2 minutes 2 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   0/5 failed: org.apache.solr.handler.TestSolrConfigHandlerCloud
[repro]   2/5 failed: org.apache.solr.handler.component.DistributedMLTComponentTest
[repro]   5/5 failed: org.apache.solr.cloud.TestMiniSolrCloudClusterSSL
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=d9cd9f78b1182125a7fb02d724608d5f355df785, workspace=/var/lib/jenkins/workspace/Lucene-Solr-7.x-Linux
[WARNINGS] Computing warning deltas based on reference build #3194
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS-EA] Lucene-Solr-7.x-Linux (64bit/jdk-12-ea+12) - Build # 3194 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/3194/
Java: 64bit/jdk-12-ea+12 -XX:-UseCompressedOops -XX:+UseSerialGC

8 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.LeaderFailureAfterFreshStartTest

Error Message:
47 threads leaked from SUITE scope at org.apache.solr.cloud.LeaderFailureAfterFreshStartTest:     1) Thread[id=9596, name=SolrRrdBackendFactory-3383-thread-1, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    2) Thread[id=9620, name=updateExecutor-3394-thread-1, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@12-ea/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    3) Thread[id=9545, name=coreContainerWorkExecutor-3360-thread-1, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@12-ea/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    4) Thread[id=9528, name=qtp1819498084-9528, state=RUNNABLE, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)         at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f859e815458.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    5) Thread[id=9507, name=qtp2110689941-9507, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    6) Thread[id=9506, name=qtp2110689941-9506-acceptor-0@5a88a55b-ServerConnector@428795ff{SSL,[ssl, http/1.1]}{127.0.0.1:36347}, state=RUNNABLE, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:525)         at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:277)         at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:385)         at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:648)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    7) Thread[id=9598, name=Thread-1399, state=WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/java.lang.Object.wait(Native Method)         at java.base@12-ea/java.lang.Object.wait(Object.java:328)         at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1892)    8) Thread[id=9505, name=qtp2110689941-9505, state=RUNNABLE, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)         at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f859e815458.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)    9) Thread[id=9599, name=coreContainerWorkExecutor-3374-thread-1, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@12-ea/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   10) Thread[id=9529, name=qtp1819498084-9529, state=RUNNABLE, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)         at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f859e815458.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   11) Thread[id=9510, name=Scheduler-1856181668, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   12) Thread[id=9533, name=qtp1819498084-9533, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   13) Thread[id=9502, name=qtp2110689941-9502, state=RUNNABLE, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)         at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f859e815458.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   14) Thread[id=9558, name=qtp209297070-9558, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   15) Thread[id=9554, name=qtp209297070-9554, state=RUNNABLE, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)         at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f859e815458.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   16) Thread[id=9550, name=qtp209297070-9550, state=RUNNABLE, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)         at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f859e815458.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   17) Thread[id=9503, name=qtp2110689941-9503, state=RUNNABLE, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)         at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f859e815458.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   18) Thread[id=9621, name=recoveryExecutor-3395-thread-1, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@12-ea/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   19) Thread[id=9543, name=MetricsHistoryHandler-3366-thread-1, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   20) Thread[id=9560, name=Scheduler-1311885733, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   21) Thread[id=9551, name=qtp209297070-9551, state=RUNNABLE, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)         at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f859e815458.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   22) Thread[id=9578, name=coreContainerWorkExecutor-3368-thread-1, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@12-ea/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   23) Thread[id=9645, name=qtp1819498084-9645, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   24) Thread[id=9552, name=qtp209297070-9552, state=RUNNABLE, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)         at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f859e815458.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   25) Thread[id=9532, name=qtp1819498084-9532, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   26) Thread[id=9504, name=qtp2110689941-9504, state=RUNNABLE, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)         at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f859e815458.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   27) Thread[id=9597, name=MetricsHistoryHandler-3384-thread-1, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   28) Thread[id=9555, name=qtp209297070-9555-acceptor-0@2b214a75-ServerConnector@426e10a0{SSL,[ssl, http/1.1]}{127.0.0.1:45761}, state=RUNNABLE, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:525)         at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:277)         at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:385)         at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:648)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   29) Thread[id=9576, name=MetricsHistoryHandler-3377-thread-1, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   30) Thread[id=9607, name=Scheduler-1022597294, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   31) Thread[id=9646, name=qtp1819498084-9646, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   32) Thread[id=9509, name=qtp2110689941-9509, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   33) Thread[id=9534, name=qtp1819498084-9534, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   34) Thread[id=9575, name=SolrRrdBackendFactory-3376-thread-1, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   35) Thread[id=9508, name=qtp2110689941-9508, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   36) Thread[id=9556, name=qtp209297070-9556, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   37) Thread[id=9557, name=qtp209297070-9557, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   38) Thread[id=9535, name=Scheduler-737060343, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   39) Thread[id=9626, name=updateExecutor-3378-thread-1, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@12-ea/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   40) Thread[id=9544, name=Thread-1389, state=WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/java.lang.Object.wait(Native Method)         at java.base@12-ea/java.lang.Object.wait(Object.java:328)         at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1892)   41) Thread[id=9608, name=Scheduler-2069232652, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   42) Thread[id=9527, name=qtp1819498084-9527, state=RUNNABLE, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)         at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f859e815458.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   43) Thread[id=9609, name=Scheduler-760110175, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   44) Thread[id=9530, name=qtp1819498084-9530, state=RUNNABLE, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)         at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f859e815458.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   45) Thread[id=9531, name=qtp1819498084-9531-acceptor-0@5580ee33-ServerConnector@26f72b97{SSL,[ssl, http/1.1]}{127.0.0.1:46021}, state=RUNNABLE, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:525)         at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:277)         at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:385)         at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:648)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)   46) Thread[id=9577, name=Thread-1398, state=WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/java.lang.Object.wait(Native Method)         at java.base@12-ea/java.lang.Object.wait(Object.java:328)         at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1892)   47) Thread[id=9542, name=SolrRrdBackendFactory-3365-thread-1, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]         at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@12-ea/java.lang.Thread.run(Thread.java:835)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 47 threads leaked from SUITE scope at org.apache.solr.cloud.LeaderFailureAfterFreshStartTest: 
   1) Thread[id=9596, name=SolrRrdBackendFactory-3383-thread-1, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   2) Thread[id=9620, name=updateExecutor-3394-thread-1, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@12-ea/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   3) Thread[id=9545, name=coreContainerWorkExecutor-3360-thread-1, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@12-ea/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   4) Thread[id=9528, name=qtp1819498084-9528, state=RUNNABLE, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f859e815458.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   5) Thread[id=9507, name=qtp2110689941-9507, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   6) Thread[id=9506, name=qtp2110689941-9506-acceptor-0@5a88a55b-ServerConnector@428795ff{SSL,[ssl, http/1.1]}{127.0.0.1:36347}, state=RUNNABLE, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
        at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:525)
        at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:277)
        at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:385)
        at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:648)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   7) Thread[id=9598, name=Thread-1399, state=WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/java.lang.Object.wait(Native Method)
        at java.base@12-ea/java.lang.Object.wait(Object.java:328)
        at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1892)
   8) Thread[id=9505, name=qtp2110689941-9505, state=RUNNABLE, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f859e815458.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
   9) Thread[id=9599, name=coreContainerWorkExecutor-3374-thread-1, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@12-ea/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  10) Thread[id=9529, name=qtp1819498084-9529, state=RUNNABLE, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f859e815458.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  11) Thread[id=9510, name=Scheduler-1856181668, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  12) Thread[id=9533, name=qtp1819498084-9533, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  13) Thread[id=9502, name=qtp2110689941-9502, state=RUNNABLE, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f859e815458.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  14) Thread[id=9558, name=qtp209297070-9558, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  15) Thread[id=9554, name=qtp209297070-9554, state=RUNNABLE, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f859e815458.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  16) Thread[id=9550, name=qtp209297070-9550, state=RUNNABLE, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f859e815458.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  17) Thread[id=9503, name=qtp2110689941-9503, state=RUNNABLE, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f859e815458.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  18) Thread[id=9621, name=recoveryExecutor-3395-thread-1, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@12-ea/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  19) Thread[id=9543, name=MetricsHistoryHandler-3366-thread-1, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  20) Thread[id=9560, name=Scheduler-1311885733, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  21) Thread[id=9551, name=qtp209297070-9551, state=RUNNABLE, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f859e815458.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  22) Thread[id=9578, name=coreContainerWorkExecutor-3368-thread-1, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@12-ea/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@12-ea/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  23) Thread[id=9645, name=qtp1819498084-9645, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  24) Thread[id=9552, name=qtp209297070-9552, state=RUNNABLE, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f859e815458.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  25) Thread[id=9532, name=qtp1819498084-9532, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  26) Thread[id=9504, name=qtp2110689941-9504, state=RUNNABLE, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@12-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@12-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:423)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:360)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$166/0x00007f859e815458.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  27) Thread[id=9597, name=MetricsHistoryHandler-3384-thread-1, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  28) Thread[id=9555, name=qtp209297070-9555-acceptor-0@2b214a75-ServerConnector@426e10a0{SSL,[ssl, http/1.1]}{127.0.0.1:45761}, state=RUNNABLE, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
        at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:525)
        at java.base@12-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:277)
        at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:385)
        at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:648)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  29) Thread[id=9576, name=MetricsHistoryHandler-3377-thread-1, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  30) Thread[id=9607, name=Scheduler-1022597294, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  31) Thread[id=9646, name=qtp1819498084-9646, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  32) Thread[id=9509, name=qtp2110689941-9509, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  33) Thread[id=9534, name=qtp1819498084-9534, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  34) Thread[id=9575, name=SolrRrdBackendFactory-3376-thread-1, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@12-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@12-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  35) Thread[id=9508, name=qtp2110689941-9508, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  36) Thread[id=9556, name=qtp209297070-9556, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:656)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:46)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:720)
        at java.base@12-ea/java.lang.Thread.run(Thread.java:835)
  37) Thread[id=9557, name=qtp209297070-9557, state=TIMED_WAITING, group=TGRP-LeaderFailureAfterFreshStartTest]
        at java.base@12-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@12-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@12-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(Que

[...truncated too long message...]

nit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:484)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:414)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1110)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:884)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:817)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
   [junit4]    > 	at org.apache.solr.cloud.SplitShardTest.doTest(SplitShardTest.java:67)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:835)
   [junit4]   2> 78329 INFO  (jetty-closer-287-thread-1) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=884676768
   [junit4]   2> 78329 INFO  (jetty-closer-287-thread-1) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:33881_solr
   [junit4]   2> 78330 INFO  (jetty-closer-287-thread-1) [    ] o.a.s.c.CoreContainer Publish this node as DOWN...
   [junit4]   2> 78330 INFO  (jetty-closer-287-thread-1) [    ] o.a.s.c.ZkController Publish node=127.0.0.1:33881_solr as DOWN
   [junit4]   2> 78331 INFO  (jetty-closer-287-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 78331 INFO  (jetty-closer-287-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@31b8844: rootName = solr_33881, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@193e7371
   [junit4]   2> 78335 INFO  (jetty-closer-287-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 78335 INFO  (jetty-closer-287-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@184241bf: rootName = solr_33881, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@417ef2b7
   [junit4]   2> 78337 INFO  (jetty-closer-287-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 78337 INFO  (jetty-closer-287-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4af6bbe0: rootName = solr_33881, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6df80ca3
   [junit4]   2> 78337 INFO  (jetty-closer-287-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 78338 INFO  (closeThreadPool-321-thread-2) [    ] o.a.s.c.Overseer Overseer (id=72161216109477893-127.0.0.1:33881_solr-n_0000000000) closing
   [junit4]   2> 78338 INFO  (OverseerStateUpdate-72161216109477893-127.0.0.1:33881_solr-n_0000000000) [n:127.0.0.1:33881_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:33881_solr
   [junit4]   2> 78339 INFO  (OverseerAutoScalingTriggerThread-72161216109477893-127.0.0.1:33881_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 78340 INFO  (jetty-closer-287-thread-1) [    ] o.a.s.c.Overseer Overseer (id=72161216109477893-127.0.0.1:33881_solr-n_0000000000) closing
   [junit4]   2> 78340 INFO  (closeThreadPool-321-thread-1) [    ] o.a.s.c.Overseer Overseer (id=72161216109477893-127.0.0.1:33881_solr-n_0000000000) closing
   [junit4]   2> 78340 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1005e3e64c40006, likely client has closed socket
   [junit4]   2> 78343 INFO  (jetty-closer-287-thread-1) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@6df7d002{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 78344 INFO  (jetty-closer-287-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6b6b6a74{/solr,null,UNAVAILABLE}
   [junit4]   2> 78344 INFO  (jetty-closer-287-thread-1) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 78344 INFO  (SUITE-SplitShardTest-seed#[906B6B8851335A63]-worker) [    ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 78345 ERROR (SUITE-SplitShardTest-seed#[906B6B8851335A63]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 78345 INFO  (SUITE-SplitShardTest-seed#[906B6B8851335A63]-worker) [    ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:34473
   [junit4]   2> 78345 INFO  (SUITE-SplitShardTest-seed#[906B6B8851335A63]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 34473
   [junit4]   2> 78345 WARN  (ZkTestServer Run Thread) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/aliases.json
   [junit4]   2> 	3	/solr/collections/splitshardtest-collection/terms/shard1
   [junit4]   2> 	3	/solr/collections/splitshardtest-collection/terms/shard2
   [junit4]   2> 	3	/solr/collections/splitshardtest-collection/terms/shard1_0
   [junit4]   2> 	3	/solr/collections/splitshardtest-collection/terms/shard1_1
   [junit4]   2> 	3	/solr/collections/splitshardtest-collection/terms/shard1_2
   [junit4]   2> 	3	/solr/collections/splitshardtest-collection/terms/shard1_3
   [junit4]   2> 	3	/solr/collections/splitshardtest-collection/terms/shard1_4
   [junit4]   2> 	2	/solr/collections/splitshardtest-collection/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	57	/solr/collections/splitshardtest-collection/state.json
   [junit4]   2> 	5	/solr/clusterstate.json
   [junit4]   2> 	5	/solr/clusterprops.json
   [junit4]   2> 	3	/solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/collections
   [junit4]   2> 	5	/solr/live_nodes
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.SplitShardTest_906B6B8851335A63-001
   [junit4]   2> Dec 09, 2018 12:53:14 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 6 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1884, maxMBSortInHeap=7.792367374980335, sim=RandomSimilarity(queryNorm=true): {}, locale=en-001, timezone=America/Virgin
   [junit4]   2> NOTE: Linux 4.15.0-39-generic amd64/Oracle Corporation 12-ea (64-bit)/cpus=8,threads=1,free=92050136,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [LeaderFailureAfterFreshStartTest, LeaderFailureAfterFreshStartTest, SplitShardTest]
   [junit4] Completed [10/10 (4!)] on J1 in 10.89s, 2 tests, 1 error <<< FAILURES!

[...truncated 14 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1572: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/common-build.xml:1099: There were test failures: 10 suites, 15 tests, 4 errors [seed: 906B6B8851335A63]

Total time: 1 minute 20 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.LeaderFailureAfterFreshStartTest
[repro]   4/5 failed: org.apache.solr.cloud.SplitShardTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=d9cd9f78b1182125a7fb02d724608d5f355df785, workspace=/var/lib/jenkins/workspace/Lucene-Solr-7.x-Linux
[WARNINGS] Computing warning deltas based on reference build #3193
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk1.8.0_172) - Build # 3193 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/3193/
Java: 64bit/jdk1.8.0_172 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest

Error Message:
expected:<0> but was:<1>

Stack Trace:
java.lang.AssertionError: expected:<0> but was:<1>
	at __randomizedtesting.SeedInfo.seed([2B70920B53386798:861026004E07CFED]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest(DeleteReplicaTest.java:127)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 14176 lines...]
   [junit4] Suite: org.apache.solr.cloud.DeleteReplicaTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest_2B70920B53386798-001/init-core-data-001
   [junit4]   2> 791840 INFO  (SUITE-DeleteReplicaTest-seed#[2B70920B53386798]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 791840 INFO  (SUITE-DeleteReplicaTest-seed#[2B70920B53386798]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 791840 INFO  (SUITE-DeleteReplicaTest-seed#[2B70920B53386798]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 791841 INFO  (TEST-DeleteReplicaTest.deleteReplicaFromClusterState-seed#[2B70920B53386798]) [    ] o.a.s.SolrTestCaseJ4 ###Starting deleteReplicaFromClusterState
   [junit4]   2> 791841 INFO  (TEST-DeleteReplicaTest.deleteReplicaFromClusterState-seed#[2B70920B53386798]) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest_2B70920B53386798-001/tempDir-001
   [junit4]   2> 791841 INFO  (TEST-DeleteReplicaTest.deleteReplicaFromClusterState-seed#[2B70920B53386798]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 791842 INFO  (ZkTestServer Run Thread) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 791842 INFO  (ZkTestServer Run Thread) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 791843 ERROR (ZkTestServer Run Thread) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 791942 INFO  (TEST-DeleteReplicaTest.deleteReplicaFromClusterState-seed#[2B70920B53386798]) [    ] o.a.s.c.ZkTestServer start zk server on port:42555
   [junit4]   2> 791942 INFO  (TEST-DeleteReplicaTest.deleteReplicaFromClusterState-seed#[2B70920B53386798]) [    ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:42555
   [junit4]   2> 791942 INFO  (TEST-DeleteReplicaTest.deleteReplicaFromClusterState-seed#[2B70920B53386798]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 42555
   [junit4]   2> 791944 INFO  (zkConnectionManagerCallback-6078-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 791945 INFO  (zkConnectionManagerCallback-6080-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 791946 INFO  (zkConnectionManagerCallback-6082-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 791948 WARN  (jetty-launcher-6075-thread-2) [    ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 791948 WARN  (jetty-launcher-6075-thread-1) [    ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 791948 INFO  (jetty-launcher-6075-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 791948 INFO  (jetty-launcher-6075-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 791948 WARN  (jetty-launcher-6075-thread-3) [    ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 791948 INFO  (jetty-launcher-6075-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 791948 INFO  (jetty-launcher-6075-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 791948 INFO  (jetty-launcher-6075-thread-1) [    ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_172-b11
   [junit4]   2> 791948 INFO  (jetty-launcher-6075-thread-2) [    ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_172-b11
   [junit4]   2> 791948 WARN  (jetty-launcher-6075-thread-4) [    ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 791948 INFO  (jetty-launcher-6075-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 791948 INFO  (jetty-launcher-6075-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 791949 INFO  (jetty-launcher-6075-thread-3) [    ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_172-b11
   [junit4]   2> 791949 INFO  (jetty-launcher-6075-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 791949 INFO  (jetty-launcher-6075-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 791949 INFO  (jetty-launcher-6075-thread-4) [    ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_172-b11
   [junit4]   2> 791950 INFO  (jetty-launcher-6075-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 791950 INFO  (jetty-launcher-6075-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 791950 INFO  (jetty-launcher-6075-thread-2) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 791950 INFO  (jetty-launcher-6075-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 791950 INFO  (jetty-launcher-6075-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 791950 INFO  (jetty-launcher-6075-thread-1) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 791950 INFO  (jetty-launcher-6075-thread-3) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 791950 INFO  (jetty-launcher-6075-thread-3) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 791950 INFO  (jetty-launcher-6075-thread-3) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 791950 INFO  (jetty-launcher-6075-thread-4) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 791950 INFO  (jetty-launcher-6075-thread-4) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 791950 INFO  (jetty-launcher-6075-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4c5e3c1b{/solr,null,AVAILABLE}
   [junit4]   2> 791950 INFO  (jetty-launcher-6075-thread-4) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 791950 INFO  (jetty-launcher-6075-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7a86596b{/solr,null,AVAILABLE}
   [junit4]   2> 791950 INFO  (jetty-launcher-6075-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7a0b3c4e{/solr,null,AVAILABLE}
   [junit4]   2> 791950 INFO  (jetty-launcher-6075-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@85e1d20{/solr,null,AVAILABLE}
   [junit4]   2> 791953 INFO  (jetty-launcher-6075-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1f50ca93{HTTP/1.1,[http/1.1]}{127.0.0.1:40433}
   [junit4]   2> 791953 INFO  (jetty-launcher-6075-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@771725b1{HTTP/1.1,[http/1.1]}{127.0.0.1:35643}
   [junit4]   2> 791953 INFO  (jetty-launcher-6075-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@674dd933{HTTP/1.1,[http/1.1]}{127.0.0.1:38253}
   [junit4]   2> 791953 INFO  (jetty-launcher-6075-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@107440c2{HTTP/1.1,[http/1.1]}{127.0.0.1:42929}
   [junit4]   2> 791953 INFO  (jetty-launcher-6075-thread-3) [    ] o.e.j.s.Server Started @792001ms
   [junit4]   2> 791953 INFO  (jetty-launcher-6075-thread-2) [    ] o.e.j.s.Server Started @792001ms
   [junit4]   2> 791953 INFO  (jetty-launcher-6075-thread-4) [    ] o.e.j.s.Server Started @792001ms
   [junit4]   2> 791953 INFO  (jetty-launcher-6075-thread-1) [    ] o.e.j.s.Server Started @792001ms
   [junit4]   2> 791953 INFO  (jetty-launcher-6075-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35643}
   [junit4]   2> 791953 INFO  (jetty-launcher-6075-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40433}
   [junit4]   2> 791954 INFO  (jetty-launcher-6075-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38253}
   [junit4]   2> 791953 INFO  (jetty-launcher-6075-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42929}
   [junit4]   2> 791954 ERROR (jetty-launcher-6075-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 791954 ERROR (jetty-launcher-6075-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 791954 INFO  (jetty-launcher-6075-thread-3) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 791954 INFO  (jetty-launcher-6075-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 791954 ERROR (jetty-launcher-6075-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 791954 ERROR (jetty-launcher-6075-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 791954 INFO  (jetty-launcher-6075-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.7.0
   [junit4]   2> 791954 INFO  (jetty-launcher-6075-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.7.0
   [junit4]   2> 791954 INFO  (jetty-launcher-6075-thread-4) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 791954 INFO  (jetty-launcher-6075-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 791954 INFO  (jetty-launcher-6075-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 791954 INFO  (jetty-launcher-6075-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.7.0
   [junit4]   2> 791954 INFO  (jetty-launcher-6075-thread-2) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 791954 INFO  (jetty-launcher-6075-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 791954 INFO  (jetty-launcher-6075-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 791954 INFO  (jetty-launcher-6075-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 791954 INFO  (jetty-launcher-6075-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 791954 INFO  (jetty-launcher-6075-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-12-08T19:21:43.155Z
   [junit4]   2> 791954 INFO  (jetty-launcher-6075-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-12-08T19:21:43.155Z
   [junit4]   2> 791954 INFO  (jetty-launcher-6075-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.7.0
   [junit4]   2> 791954 INFO  (jetty-launcher-6075-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-12-08T19:21:43.155Z
   [junit4]   2> 791954 INFO  (jetty-launcher-6075-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 791954 INFO  (jetty-launcher-6075-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 791954 INFO  (jetty-launcher-6075-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-12-08T19:21:43.155Z
   [junit4]   2> 791958 INFO  (zkConnectionManagerCallback-6090-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 791959 INFO  (jetty-launcher-6075-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 791962 INFO  (zkConnectionManagerCallback-6086-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 791963 INFO  (zkConnectionManagerCallback-6087-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 791963 INFO  (jetty-launcher-6075-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 791963 INFO  (jetty-launcher-6075-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 791966 INFO  (zkConnectionManagerCallback-6088-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 791966 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1005d0f08d40005, likely client has closed socket
   [junit4]   2> 791966 INFO  (jetty-launcher-6075-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 792070 INFO  (jetty-launcher-6075-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42555/solr
   [junit4]   2> 792070 INFO  (zkConnectionManagerCallback-6094-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 792071 INFO  (zkConnectionManagerCallback-6096-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 792110 INFO  (jetty-launcher-6075-thread-4) [n:127.0.0.1:42929_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42929_solr
   [junit4]   2> 792110 INFO  (jetty-launcher-6075-thread-4) [n:127.0.0.1:42929_solr    ] o.a.s.c.Overseer Overseer (id=72159913191931912-127.0.0.1:42929_solr-n_0000000000) starting
   [junit4]   2> 792113 INFO  (zkConnectionManagerCallback-6103-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 792114 INFO  (jetty-launcher-6075-thread-4) [n:127.0.0.1:42929_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42555/solr ready
   [junit4]   2> 792114 INFO  (OverseerStateUpdate-72159913191931912-127.0.0.1:42929_solr-n_0000000000) [n:127.0.0.1:42929_solr    ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:42929_solr
   [junit4]   2> 792126 INFO  (jetty-launcher-6075-thread-4) [n:127.0.0.1:42929_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42929_solr
   [junit4]   2> 792138 INFO  (zkCallback-6095-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 792143 INFO  (OverseerAutoScalingTriggerThread-72159913191931912-127.0.0.1:42929_solr-n_0000000000) [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: []
   [junit4]   2> 792150 INFO  (zkCallback-6102-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 792151 INFO  (ScheduledTrigger-6983-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1 and last live nodes: 0
   [junit4]   2> 792167 INFO  (jetty-launcher-6075-thread-4) [n:127.0.0.1:42929_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 792168 INFO  (jetty-launcher-6075-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42555/solr
   [junit4]   2> 792169 INFO  (zkConnectionManagerCallback-6108-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 792170 INFO  (zkConnectionManagerCallback-6110-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 792171 INFO  (jetty-launcher-6075-thread-3) [n:127.0.0.1:38253_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 792173 INFO  (jetty-launcher-6075-thread-3) [n:127.0.0.1:38253_solr    ] o.a.s.c.ZkController Publish node=127.0.0.1:38253_solr as DOWN
   [junit4]   2> 792173 INFO  (jetty-launcher-6075-thread-3) [n:127.0.0.1:38253_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 792173 INFO  (jetty-launcher-6075-thread-3) [n:127.0.0.1:38253_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38253_solr
   [junit4]   2> 792173 DEBUG (OverseerStateUpdate-72159913191931912-127.0.0.1:42929_solr-n_0000000000) [n:127.0.0.1:42929_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:38253_solr"} current state version: 0
   [junit4]   2> 792174 INFO  (zkCallback-6095-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 792174 INFO  (zkCallback-6102-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 792175 INFO  (zkCallback-6109-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 792184 INFO  (zkConnectionManagerCallback-6117-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 792185 INFO  (jetty-launcher-6075-thread-3) [n:127.0.0.1:38253_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 792185 INFO  (jetty-launcher-6075-thread-3) [n:127.0.0.1:38253_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42555/solr ready
   [junit4]   2> 792186 INFO  (jetty-launcher-6075-thread-3) [n:127.0.0.1:38253_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 792188 INFO  (jetty-launcher-6075-thread-4) [n:127.0.0.1:42929_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42929.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5864fcea
   [junit4]   2> 792195 INFO  (jetty-launcher-6075-thread-4) [n:127.0.0.1:42929_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42929.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5864fcea
   [junit4]   2> 792195 INFO  (jetty-launcher-6075-thread-4) [n:127.0.0.1:42929_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42929.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5864fcea
   [junit4]   2> 792196 INFO  (jetty-launcher-6075-thread-4) [n:127.0.0.1:42929_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest_2B70920B53386798-001/tempDir-001/node4/.
   [junit4]   2> 792200 INFO  (jetty-launcher-6075-thread-3) [n:127.0.0.1:38253_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38253.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5864fcea
   [junit4]   2> 792206 INFO  (jetty-launcher-6075-thread-3) [n:127.0.0.1:38253_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38253.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5864fcea
   [junit4]   2> 792206 INFO  (jetty-launcher-6075-thread-3) [n:127.0.0.1:38253_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38253.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5864fcea
   [junit4]   2> 792207 INFO  (jetty-launcher-6075-thread-3) [n:127.0.0.1:38253_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest_2B70920B53386798-001/tempDir-001/node3/.
   [junit4]   2> 792246 INFO  (jetty-launcher-6075-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42555/solr
   [junit4]   2> 792247 INFO  (zkConnectionManagerCallback-6122-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 792248 INFO  (zkConnectionManagerCallback-6124-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 792250 INFO  (jetty-launcher-6075-thread-2) [n:127.0.0.1:35643_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 792251 INFO  (jetty-launcher-6075-thread-2) [n:127.0.0.1:35643_solr    ] o.a.s.c.ZkController Publish node=127.0.0.1:35643_solr as DOWN
   [junit4]   2> 792251 INFO  (jetty-launcher-6075-thread-2) [n:127.0.0.1:35643_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 792251 INFO  (jetty-launcher-6075-thread-2) [n:127.0.0.1:35643_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35643_solr
   [junit4]   2> 792251 DEBUG (OverseerStateUpdate-72159913191931912-127.0.0.1:42929_solr-n_0000000000) [n:127.0.0.1:42929_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:35643_solr"} current state version: 0
   [junit4]   2> 792251 INFO  (zkCallback-6109-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 792252 INFO  (zkCallback-6095-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 792252 INFO  (zkCallback-6123-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 792252 INFO  (zkCallback-6102-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 792252 INFO  (zkCallback-6116-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 792262 INFO  (zkConnectionManagerCallback-6131-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 792263 INFO  (jetty-launcher-6075-thread-2) [n:127.0.0.1:35643_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 792263 INFO  (jetty-launcher-6075-thread-2) [n:127.0.0.1:35643_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42555/solr ready
   [junit4]   2> 792264 INFO  (jetty-launcher-6075-thread-2) [n:127.0.0.1:35643_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 792277 INFO  (jetty-launcher-6075-thread-2) [n:127.0.0.1:35643_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35643.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5864fcea
   [junit4]   2> 792285 INFO  (jetty-launcher-6075-thread-2) [n:127.0.0.1:35643_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35643.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5864fcea
   [junit4]   2> 792285 INFO  (jetty-launcher-6075-thread-2) [n:127.0.0.1:35643_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35643.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5864fcea
   [junit4]   2> 792286 INFO  (jetty-launcher-6075-thread-2) [n:127.0.0.1:35643_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest_2B70920B53386798-001/tempDir-001/node2/.
   [junit4]   2> 792291 INFO  (jetty-launcher-6075-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42555/solr
   [junit4]   2> 792292 INFO  (zkConnectionManagerCallback-6136-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 792300 INFO  (zkConnectionManagerCallback-6138-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 792302 INFO  (jetty-launcher-6075-thread-1) [n:127.0.0.1:40433_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 792304 INFO  (jetty-launcher-6075-thread-1) [n:127.0.0.1:40433_solr    ] o.a.s.c.ZkController Publish node=127.0.0.1:40433_solr as DOWN
   [junit4]   2> 792304 INFO  (jetty-launcher-6075-thread-1) [n:127.0.0.1:40433_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 792304 INFO  (jetty-launcher-6075-thread-1) [n:127.0.0.1:40433_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40433_solr
   [junit4]   2> 792304 DEBUG (OverseerStateUpdate-72159913191931912-127.0.0.1:42929_solr-n_0000000000) [n:127.0.0.1:42929_solr    ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:40433_solr"} current state version: 0
   [junit4]   2> 792304 INFO  (zkCallback-6095-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 792304 INFO  (zkCallback-6123-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 792304 INFO  (zkCallback-6116-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 792304 INFO  (zkCallback-6109-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 792304 INFO  (zkCallback-6102-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 792305 INFO  (zkCallback-6130-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 792305 INFO  (zkCallback-6137-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 792317 INFO  (zkConnectionManagerCallback-6145-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 792318 INFO  (jetty-launcher-6075-thread-1) [n:127.0.0.1:40433_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 792318 INFO  (jetty-launcher-6075-thread-1) [n:127.0.0.1:40433_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42555/solr ready
   [junit4]   2> 792318 INFO  (jetty-launcher-6075-thread-1) [n:127.0.0.1:40433_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 792328 INFO  (jetty-launcher-6075-thread-1) [n:127.0.0.1:40433_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40433.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5864fcea
   [junit4]   2> 792333 INFO  (jetty-launcher-6075-thread-1) [n:127.0.0.1:40433_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40433.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5864fcea
   [junit4]   2> 792333 INFO  (jetty-launcher-6075-thread-1) [n:127.0.0.1:40433_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40433.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5864fcea
   [junit4]   2> 792335 INFO  (jetty-launcher-6075-thread-1) [n:127.0.0.1:40433_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest_2B70920B53386798-001/tempDir-001/node1/.
   [junit4]   2> 792362 INFO  (zkConnectionManagerCallback-6151-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 792363 INFO  (TEST-DeleteReplicaTest.deleteReplicaFromClusterState-seed#[2B70920B53386798]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 792364 INFO  (TEST-DeleteReplicaTest.deleteReplicaFromClusterState-seed#[2B70920B53386798]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42555/solr ready
   [junit4]   2> 792366 INFO  (qtp1264414549-17728) [n:127.0.0.1:42929_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterprop with params val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 792367 INFO  (qtp1264414549-17728) [n:127.0.0.1:42929_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 792367 INFO  (qtp1264414549-17731) [n:127.0.0.1:42929_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf&name=deleteFromClusterState_false&nrtReplicas=3&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 792368 INFO  (OverseerThreadFactory-6985-thread-1-processing-n:127.0.0.1:42929_solr) [n:127.0.0.1:42929_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection deleteFromClusterState_false
   [junit4]   2> 792369 DEBUG (OverseerStateUpdate-72159913191931912-127.0.0.1:42929_solr-n_0000000000) [n:127.0.0.1:42929_solr    ] o.a.s.c.Overseer processMessage: queueSize: 4, message = {
   [junit4]   2>   "name":"deleteFromClusterState_false",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "collection.configName":"conf",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "nrtReplicas":"3",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "replicationFactor":"3",
   [junit4]   2>   "operation":"create"} current state version: 0
   [junit4]   2> 792472 INFO  (qtp1264414549-17728) [n:127.0.0.1:42929_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 792472 INFO  (qtp1264414549-17725) [n:127.0.0.1:42929_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 792473 INFO  (qtp1264414549-17728) [n:127.0.0.1:42929_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 792473 INFO  (qtp1264414549-17725) [n:127.0.0.1:42929_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 792474 INFO  (qtp1264414549-17728) [n:127.0.0.1:42929_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 792475 INFO  (qtp1413727991-17720) [n:127.0.0.1:35643_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 792475 INFO  (qtp1413727991-17723) [n:127.0.0.1:35643_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 792476 INFO  (qtp1413727991-17711) [n:127.0.0.1:35643_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 792476 INFO  (qtp1413727991-17720) [n:127.0.0.1:35643_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 792477 INFO  (qtp1413727991-17723) [n:127.0.0.1:35643_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 792478 INFO  (qtp919359014-17726) [n:127.0.0.1:38253_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 792478 INFO  (qtp919359014-17730) [n:127.0.0.1:38253_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 792479 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 792479 INFO  (qtp919359014-17726) [n:127.0.0.1:38253_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 792480 INFO  (qtp919359014-17730) [n:127.0.0.1:38253_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 792481 INFO  (qtp1100419365-17721) [n:127.0.0.1:40433_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 792481 INFO  (qtp1100419365-17727) [n:127.0.0.1:40433_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 792482 INFO  (qtp1100419365-17717) [n:127.0.0.1:40433_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 792482 INFO  (qtp1100419365-17721) [n:127.0.0.1:40433_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 792483 INFO  (qtp1100419365-17727) [n:127.0.0.1:40433_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
   [junit4]   2> 792486 DEBUG (OverseerStateUpdate-72159913191931912-127.0.0.1:42929_solr-n_0000000000) [n:127.0.0.1:42929_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"deleteFromClusterState_false",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"deleteFromClusterState_false_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:40433/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 792486 INFO  (OverseerStateUpdate-72159913191931912-127.0.0.1:42929_solr-n_0000000000) [n:127.0.0.1:42929_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"deleteFromClusterState_false",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"deleteFromClusterState_false_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:40433/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 792486 DEBUG (OverseerStateUpdate-72159913191931912-127.0.0.1:42929_solr-n_0000000000) [n:127.0.0.1:42929_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"deleteFromClusterState_false",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"deleteFromClusterState_false_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:38253/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 792486 INFO  (OverseerStateUpdate-72159913191931912-127.0.0.1:42929_solr-n_0000000000) [n:127.0.0.1:42929_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"deleteFromClusterState_false",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"deleteFromClusterState_false_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:38253/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 792487 DEBUG (OverseerStateUpdate-72159913191931912-127.0.0.1:42929_solr-n_0000000000) [n:127.0.0.1:42929_solr    ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"deleteFromClusterState_false",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"deleteFromClusterState_false_shard1_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:35643/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} current state version: 0
   [junit4]   2> 792487 INFO  (OverseerStateUpdate-72159913191931912-127.0.0.1:42929_solr-n_0000000000) [n:127.0.0.1:42929_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"deleteFromClusterState_false",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"deleteFromClusterState_false_shard1_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:35643/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 792689 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr    x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=deleteFromClusterState_false_shard1_replica_n2&action=CREATE&numShards=1&collection=deleteFromClusterState_false&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 792689 INFO  (qtp1100419365-17717) [n:127.0.0.1:40433_solr    x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=deleteFromClusterState_false_shard1_replica_n1&action=CREATE&numShards=1&collection=deleteFromClusterState_false&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 792689 INFO  (qtp1413727991-17711) [n:127.0.0.1:35643_solr    x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf&newCollection=true&name=deleteFromClusterState_false_shard1_replica_n4&action=CREATE&numShards=1&collection=deleteFromClusterState_false&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 792691 DEBUG (OverseerStateUpdate-72159913191931912-127.0.0.1:42929_solr-n_0000000000) [n:127.0.0.1:42929_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "core":"deleteFromClusterState_false_shard1_replica_n4",
   [junit4]   2>   "core_node_name":"core_node6",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:35643/solr",
   [junit4]   2>   "node_name":"127.0.0.1:35643_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"deleteFromClusterState_false",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "force_set_state":"false",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 792691 DEBUG (OverseerStateUpdate-72159913191931912-127.0.0.1:42929_solr-n_0000000000) [n:127.0.0.1:42929_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "core":"deleteFromClusterState_false_shard1_replica_n2",
   [junit4]   2>   "core_node_name":"core_node5",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:38253/solr",
   [junit4]   2>   "node_name":"127.0.0.1:38253_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"deleteFromClusterState_false",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "force_set_state":"false",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 792692 DEBUG (OverseerStateUpdate-72159913191931912-127.0.0.1:42929_solr-n_0000000000) [n:127.0.0.1:42929_solr    ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
   [junit4]   2>   "core":"deleteFromClusterState_false_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node3",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:40433/solr",
   [junit4]   2>   "node_name":"127.0.0.1:40433_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"deleteFromClusterState_false",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "force_set_state":"false",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 793152 INFO  (ScheduledTrigger-6983-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4 and last live nodes: 1
   [junit4]   2> 793698 INFO  (qtp1413727991-17711) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.7.0
   [junit4]   2> 793698 INFO  (qtp1100419365-17717) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.7.0
   [junit4]   2> 793698 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.7.0
   [junit4]   2> 793708 INFO  (qtp1413727991-17711) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.s.IndexSchema [deleteFromClusterState_false_shard1_replica_n4] Schema name=minimal
   [junit4]   2> 793708 INFO  (qtp1100419365-17717) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.s.IndexSchema [deleteFromClusterState_false_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 793708 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.s.IndexSchema [deleteFromClusterState_false_shard1_replica_n2] Schema name=minimal
   [junit4]   2> 793710 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 793710 INFO  (qtp1100419365-17717) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 793710 INFO  (qtp1413727991-17711) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 793710 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'deleteFromClusterState_false_shard1_replica_n2' using configuration from collection deleteFromClusterState_false, trusted=true
   [junit4]   2> 793710 INFO  (qtp1100419365-17717) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'deleteFromClusterState_false_shard1_replica_n1' using configuration from collection deleteFromClusterState_false, trusted=true
   [junit4]   2> 793710 INFO  (qtp1413727991-17711) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'deleteFromClusterState_false_shard1_replica_n4' using configuration from collection deleteFromClusterState_false, trusted=true
   [junit4]   2> 793711 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38253.solr.core.deleteFromClusterState_false.shard1.replica_n2' (registry 'solr.core.deleteFromClusterState_false.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5864fcea
   [junit4]   2> 793711 INFO  (qtp1100419365-17717) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40433.solr.core.deleteFromClusterState_false.shard1.replica_n1' (registry 'solr.core.deleteFromClusterState_false.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5864fcea
   [junit4]   2> 793711 INFO  (qtp1413727991-17711) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35643.solr.core.deleteFromClusterState_false.shard1.replica_n4' (registry 'solr.core.deleteFromClusterState_false.shard1.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5864fcea
   [junit4]   2> 793711 INFO  (qtp1100419365-17717) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.c.SolrCore [[deleteFromClusterState_false_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest_2B70920B53386798-001/tempDir-001/node1/deleteFromClusterState_false_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest_2B70920B53386798-001/tempDir-001/node1/./deleteFromClusterState_false_shard1_replica_n1/data/]
   [junit4]   2> 793711 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.c.SolrCore [[deleteFromClusterState_false_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest_2B70920B53386798-001/tempDir-001/node3/deleteFromClusterState_false_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest_2B70920B53386798-001/tempDir-001/node3/./deleteFromClusterState_false_shard1_replica_n2/data/]
   [junit4]   2> 793711 INFO  (qtp1413727991-17711) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.c.SolrCore [[deleteFromClusterState_false_shard1_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest_2B70920B53386798-001/tempDir-001/node2/deleteFromClusterState_false_shard1_replica_n4], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest_2B70920B53386798-001/tempDir-001/node2/./deleteFromClusterState_false_shard1_replica_n4/data/]
   [junit4]   2> 793740 INFO  (qtp1100419365-17717) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 793740 INFO  (qtp1413727991-17711) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 793740 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 793740 INFO  (qtp1100419365-17717) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 793740 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 793740 INFO  (qtp1413727991-17711) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 793742 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 793742 INFO  (qtp1100419365-17717) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 793742 INFO  (qtp1413727991-17711) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 793742 INFO  (qtp1100419365-17717) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 793742 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 793742 INFO  (qtp1413727991-17711) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 793743 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@32b7d77a[deleteFromClusterState_false_shard1_replica_n2] main]
   [junit4]   2> 793743 INFO  (qtp1100419365-17717) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@648e97e7[deleteFromClusterState_false_shard1_replica_n1] main]
   [junit4]   2> 793743 INFO  (qtp1413727991-17711) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@308414a4[deleteFromClusterState_false_shard1_replica_n4] main]
   [junit4]   2> 793744 INFO  (qtp1413727991-17711) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 793744 INFO  (qtp1100419365-17717) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 793744 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 793744 INFO  (qtp1413727991-17711) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 793744 INFO  (qtp1100419365-17717) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 793744 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 793745 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 793745 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1619312671400656896
   [junit4]   2> 793745 INFO  (qtp1100419365-17717) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 793745 INFO  (qtp1413727991-17711) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 793745 INFO  (qtp1413727991-17711) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1619312671400656896
   [junit4]   2> 793745 INFO  (qtp1100419365-17717) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1619312671400656896
   [junit4]   2> 793747 INFO  (searcherExecutor-7011-thread-1-processing-n:127.0.0.1:38253_solr x:deleteFromClusterState_false_shard1_replica_n2 c:deleteFromClusterState_false s:shard1 r:core_node5) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.c.SolrCore [deleteFromClusterState_false_shard1_replica_n2] Registered new searcher Searcher@32b7d77a[deleteFromClusterState_false_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 793747 INFO  (searcherExecutor-7012-thread-1-processing-n:127.0.0.1:40433_solr x:deleteFromClusterState_false_shard1_replica_n1 c:deleteFromClusterState_false s:shard1 r:core_node3) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.c.SolrCore [deleteFromClusterState_false_shard1_replica_n1] Registered new searcher Searcher@648e97e7[deleteFromClusterState_false_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 793748 INFO  (searcherExecutor-7013-thread-1-processing-n:127.0.0.1:35643_solr x:deleteFromClusterState_false_shard1_replica_n4 c:deleteFromClusterState_false s:shard1 r:core_node6) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.c.SolrCore [deleteFromClusterState_false_shard1_replica_n4] Registered new searcher Searcher@308414a4[deleteFromClusterState_false_shard1_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 793748 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/deleteFromClusterState_false/terms/shard1 to Terms{values={core_node5=0}, version=0}
   [junit4]   2> 793748 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/deleteFromClusterState_false/leaders/shard1
   [junit4]   2> 793748 INFO  (qtp1100419365-17717) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/deleteFromClusterState_false/terms/shard1 to Terms{values={core_node3=0, core_node5=0}, version=1}
   [junit4]   2> 793748 INFO  (qtp1100419365-17717) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/deleteFromClusterState_false/leaders/shard1
   [junit4]   2> 793748 INFO  (qtp1413727991-17711) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.c.ZkShardTerms Failed to save terms, version is not a match, retrying
   [junit4]   2> 793749 INFO  (qtp1413727991-17711) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.c.ZkShardTerms Successful update of terms at /collections/deleteFromClusterState_false/terms/shard1 to Terms{values={core_node6=0, core_node3=0, core_node5=0}, version=2}
   [junit4]   2> 793749 INFO  (qtp1413727991-17711) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/deleteFromClusterState_false/leaders/shard1
   [junit4]   2> 793749 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 793749 DEBUG (OverseerStateUpdate-72159913191931912-127.0.0.1:42929_solr-n_0000000000) [n:127.0.0.1:42929_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"deleteFromClusterState_false"} current state version: 0
   [junit4]   2> 793749 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 793749 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:38253/solr/deleteFromClusterState_false_shard1_replica_n2/
   [junit4]   2> 793750 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=deleteFromClusterState_false_shard1_replica_n2 url=http://127.0.0.1:38253/solr START replicas=[http://127.0.0.1:40433/solr/deleteFromClusterState_false_shard1_replica_n1/, http://127.0.0.1:35643/solr/deleteFromClusterState_false_shard1_replica_n4/] nUpdates=100
   [junit4]   2> 793750 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=deleteFromClusterState_false_shard1_replica_n2 url=http://127.0.0.1:38253/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 793751 INFO  (qtp1100419365-17727) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.c.S.Request [deleteFromClusterState_false_shard1_replica_n1]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 793751 INFO  (qtp1413727991-17723) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.c.S.Request [deleteFromClusterState_false_shard1_replica_n4]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 793751 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 793751 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 793751 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 793752 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/deleteFromClusterState_false/leaders/shard1/leader after winning as /collections/deleteFromClusterState_false/leader_elect/shard1/election/72159913191931915-core_node5-n_0000000000
   [junit4]   2> 793752 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:38253/solr/deleteFromClusterState_false_shard1_replica_n2/ shard1
   [junit4]   2> 793753 DEBUG (OverseerStateUpdate-72159913191931912-127.0.0.1:42929_solr-n_0000000000) [n:127.0.0.1:42929_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"deleteFromClusterState_false",
   [junit4]   2>   "base_url":"http://127.0.0.1:38253/solr",
   [junit4]   2>   "core":"deleteFromClusterState_false_shard1_replica_n2",
   [junit4]   2>   "state":"active"} current state version: 0
   [junit4]   2> 793854 INFO  (zkCallback-6109-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteFromClusterState_false/state.json] for collection [deleteFromClusterState_false] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 793854 INFO  (zkCallback-6109-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteFromClusterState_false/state.json] for collection [deleteFromClusterState_false] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 793854 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 793855 DEBUG (OverseerStateUpdate-72159913191931912-127.0.0.1:42929_solr-n_0000000000) [n:127.0.0.1:42929_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"deleteFromClusterState_false_shard1_replica_n2",
   [junit4]   2>   "core_node_name":"core_node5",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:38253/solr",
   [junit4]   2>   "node_name":"127.0.0.1:38253_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"deleteFromClusterState_false",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "force_set_state":"false",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 793855 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=deleteFromClusterState_false_shard1_replica_n2&action=CREATE&numShards=1&collection=deleteFromClusterState_false&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1166
   [junit4]   2> 793956 INFO  (zkCallback-6109-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteFromClusterState_false/state.json] for collection [deleteFromClusterState_false] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 793956 INFO  (zkCallback-6109-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteFromClusterState_false/state.json] for collection [deleteFromClusterState_false] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 793956 INFO  (zkCallback-6109-thread-3) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteFromClusterState_false/state.json] for collection [deleteFromClusterState_false] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 794153 INFO  (ScheduledTrigger-6983-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 794752 DEBUG (OverseerStateUpdate-72159913191931912-127.0.0.1:42929_solr-n_0000000000) [n:127.0.0.1:42929_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "core":"deleteFromClusterState_false_shard1_replica_n4",
   [junit4]   2>   "core_node_name":"core_node6",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:35643/solr",
   [junit4]   2>   "node_name":"127.0.0.1:35643_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"deleteFromClusterState_false",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "force_set_state":"false",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 794752 DEBUG (OverseerStateUpdate-72159913191931912-127.0.0.1:42929_solr-n_0000000000) [n:127.0.0.1:42929_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "core":"deleteFromClusterState_false_shard1_replica_n1",
   [junit4]   2>   "core_node_name":"core_node3",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:40433/solr",
   [junit4]   2>   "node_name":"127.0.0.1:40433_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"deleteFromClusterState_false",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "force_set_state":"false",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 794789 INFO  (qtp1100419365-17717) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=deleteFromClusterState_false_shard1_replica_n1&action=CREATE&numShards=1&collection=deleteFromClusterState_false&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2099
   [junit4]   2> 794789 INFO  (qtp1413727991-17711) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf&newCollection=true&name=deleteFromClusterState_false_shard1_replica_n4&action=CREATE&numShards=1&collection=deleteFromClusterState_false&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2099
   [junit4]   2> 794790 INFO  (qtp1264414549-17731) [n:127.0.0.1:42929_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
   [junit4]   2> 794853 INFO  (zkCallback-6123-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteFromClusterState_false/state.json] for collection [deleteFromClusterState_false] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 794853 INFO  (zkCallback-6137-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteFromClusterState_false/state.json] for collection [deleteFromClusterState_false] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 794853 INFO  (zkCallback-6109-thread-3) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteFromClusterState_false/state.json] for collection [deleteFromClusterState_false] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 794853 INFO  (zkCallback-6095-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteFromClusterState_false/state.json] for collection [deleteFromClusterState_false] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 794853 INFO  (zkCallback-6123-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteFromClusterState_false/state.json] for collection [deleteFromClusterState_false] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 794853 INFO  (zkCallback-6109-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteFromClusterState_false/state.json] for collection [deleteFromClusterState_false] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 794853 INFO  (zkCallback-6109-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteFromClusterState_false/state.json] for collection [deleteFromClusterState_false] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 794853 INFO  (zkCallback-6137-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deleteFromClusterState_false/state.json] for collection [deleteFromClusterState_false] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 794854 INFO  (qtp1264414549-17731) [n:127.0.0.1:42929_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf&name=deleteFromClusterState_false&nrtReplicas=3&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=2486
   [junit4]   2> 794856 INFO  (qtp919359014-17730) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/deleteFromClusterState_false/terms/shard1 to Terms{values={core_node6=1, core_node3=1, core_node5=1}, version=3}
   [junit4]   2> 794857 INFO  (qtp1100419365-17727) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [deleteFromClusterState_false_shard1_replica_n1]  webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:38253/solr/deleteFromClusterState_false_shard1_replica_n2/&wt=javabin&version=2}{add=[1 (1619312672564576256)]} 0 0
   [junit4]   2> 794857 INFO  (qtp1413727991-17723) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.u.p.LogUpdateProcessorFactory [deleteFromClusterState_false_shard1_replica_n4]  webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:38253/solr/deleteFromClusterState_false_shard1_replica_n2/&wt=javabin&version=2}{add=[1 (1619312672564576256)]} 0 0
   [junit4]   2> 794857 INFO  (qtp919359014-17730) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [deleteFromClusterState_false_shard1_replica_n2]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[1 (1619312672564576256)]} 0 2
   [junit4]   2> 794858 INFO  (qtp1100419365-17717) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [deleteFromClusterState_false_shard1_replica_n1]  webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:38253/solr/deleteFromClusterState_false_shard1_replica_n2/&wt=javabin&version=2}{add=[2 (1619312672567721984)]} 0 0
   [junit4]   2> 794859 INFO  (qtp1413727991-17711) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.u.p.LogUpdateProcessorFactory [deleteFromClusterState_false_shard1_replica_n4]  webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:38253/solr/deleteFromClusterState_false_shard1_replica_n2/&wt=javabin&version=2}{add=[2 (1619312672567721984)]} 0 0
   [junit4]   2> 794859 INFO  (qtp919359014-17724) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [deleteFromClusterState_false_shard1_replica_n2]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[2 (1619312672567721984)]} 0 1
   [junit4]   2> 794859 INFO  (qtp919359014-17726) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1619312672568770560,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 794859 INFO  (qtp919359014-17726) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@269d9ae5 commitCommandVersion:1619312672568770560
   [junit4]   2> 794860 INFO  (qtp1100419365-17721) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1619312672569819136,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 794860 INFO  (qtp1413727991-17720) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1619312672569819136,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 794860 INFO  (qtp1100419365-17721) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@4aba1ad0 commitCommandVersion:1619312672569819136
   [junit4]   2> 794860 INFO  (qtp1413727991-17720) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@67a52160 commitCommandVersion:1619312672569819136
   [junit4]   2> 794862 INFO  (qtp1100419365-17721) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1dc8fc84[deleteFromClusterState_false_shard1_replica_n1] main]
   [junit4]   2> 794862 INFO  (qtp1413727991-17720) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@1cd711f4[deleteFromClusterState_false_shard1_replica_n4] main]
   [junit4]   2> 794862 INFO  (qtp919359014-17726) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@45d478cf[deleteFromClusterState_false_shard1_replica_n2] main]
   [junit4]   2> 794862 INFO  (qtp1100419365-17721) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 794862 INFO  (qtp919359014-17726) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 794862 INFO  (qtp1413727991-17720) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 794863 INFO  (searcherExecutor-7012-thread-1-processing-n:127.0.0.1:40433_solr x:deleteFromClusterState_false_shard1_replica_n1 c:deleteFromClusterState_false s:shard1 r:core_node3) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.c.SolrCore [deleteFromClusterState_false_shard1_replica_n1] Registered new searcher Searcher@1dc8fc84[deleteFromClusterState_false_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.7.0):C2:[diagnostics={os=Linux, java.vendor=Oracle Corporation, java.version=1.8.0_172, java.vm.version=25.172-b11, lucene.version=7.7.0, os.arch=amd64, java.runtime.version=1.8.0_172-b11, source=flush, os.version=4.15.0-39-generic, timestamp=1544296906061}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}])))}
   [junit4]   2> 794864 INFO  (qtp1100419365-17721) [n:127.0.0.1:40433_solr c:deleteFromClusterState_false s:shard1 r:core_node3 x:deleteFromClusterState_false_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [deleteFromClusterState_false_shard1_replica_n1]  webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:38253/solr/deleteFromClusterState_false_shard1_replica_n2/&commit_end_point=replicas&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 3
   [junit4]   2> 794864 INFO  (searcherExecutor-7011-thread-1-processing-n:127.0.0.1:38253_solr x:deleteFromClusterState_false_shard1_replica_n2 c:deleteFromClusterState_false s:shard1 r:core_node5) [n:127.0.0.1:38253_solr c:deleteFromClusterState_false s:shard1 r:core_node5 x:deleteFromClusterState_false_shard1_replica_n2] o.a.s.c.SolrCore [deleteFromClusterState_false_shard1_replica_n2] Registered new searcher Searcher@45d478cf[deleteFromClusterState_false_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.7.0):C2:[diagnostics={os=Linux, java.vendor=Oracle Corporation, java.version=1.8.0_172, java.vm.version=25.172-b11, lucene.version=7.7.0, os.arch=amd64, java.runtime.version=1.8.0_172-b11, source=flush, os.version=4.15.0-39-generic, timestamp=1544296906061}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}])))}
   [junit4]   2> 794864 INFO  (searcherExecutor-7013-thread-1-processing-n:127.0.0.1:35643_solr x:deleteFromClusterState_false_shard1_replica_n4 c:deleteFromClusterState_false s:shard1 r:core_node6) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.c.SolrCore [deleteFromClusterState_false_shard1_replica_n4] Registered new searcher Searcher@1cd711f4[deleteFromClusterState_false_shard1_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.7.0):C2:[diagnostics={os=Linux, java.vendor=Oracle Corporation, java.version=1.8.0_172, java.vm.version=25.172-b11, lucene.version=7.7.0, os.arch=amd64, java.runtime.version=1.8.0_172-b11, source=flush, os.version=4.15.0-39-generic, timestamp=1544296906061}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}])))}
   [junit4]   2> 794864 INFO  (qtp1413727991-17720) [n:127.0.0.1:35643_solr c:deleteFromClusterState_false s:shard1 r:core_node6 x:deleteFromClusterState_false_shard1_replica_n4] o.a.s.u.p.LogUpdateProcessorFactory [deleteFromClusterState_false_shard1_replica_n4]  we

[...truncated too long message...]

sion:

ivy-fail:

resolve-groovy:
[ivy:cachepath] :: resolving dependencies :: org.codehaus.groovy#groovy-all-caller;working
[ivy:cachepath] 	confs: [default]
[ivy:cachepath] 	found org.codehaus.groovy#groovy-all;2.4.15 in public
[ivy:cachepath] :: resolution report :: resolve 12ms :: artifacts dl 0ms
	---------------------------------------------------------------------
	|                  |            modules            ||   artifacts   |
	|       conf       | number| search|dwnlded|evicted|| number|dwnlded|
	---------------------------------------------------------------------
	|      default     |   1   |   0   |   0   |   0   ||   1   |   0   |
	---------------------------------------------------------------------

-init-totals:

-test:
    [mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test
[junit4:pickseed] Seed property 'tests.seed' already defined: 2B70920B53386798
    [mkdir] Created dir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/temp
   [junit4] <JUnit4> says jolly good day! Master seed: 2B70920B53386798
   [junit4] Executing 5 suites with 3 JVMs.
   [junit4] 
   [junit4] Started J0 PID(4569@serv1.sd-datasolutions.de).
   [junit4] Started J1 PID(4570@serv1.sd-datasolutions.de).
   [junit4] Started J2 PID(4576@serv1.sd-datasolutions.de).
   [junit4] Suite: org.apache.solr.cloud.DeleteReplicaTest
   [junit4] OK      9.69s J2 | DeleteReplicaTest.deleteReplicaFromClusterState
   [junit4] OK      3.71s J2 | DeleteReplicaTest.deleteLiveReplicaTest
   [junit4] OK      6.03s J2 | DeleteReplicaTest.deleteReplicaFromClusterStateLegacy
   [junit4] OK      3.33s J2 | DeleteReplicaTest.deleteReplicaByCountForAllShards
   [junit4] OK      8.83s J2 | DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica
   [junit4] OK      5.26s J2 | DeleteReplicaTest.deleteReplicaOnIndexing
   [junit4] OK      5.76s J2 | DeleteReplicaTest.deleteReplicaAndVerifyDirectoryCleanup
   [junit4] OK      3.29s J2 | DeleteReplicaTest.deleteReplicaByCount
   [junit4] OK      11.0s J2 | DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplicaLegacy
   [junit4] Completed [1/5] on J2 in 59.37s, 9 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.DeleteReplicaTest
   [junit4] OK      9.98s J1 | DeleteReplicaTest.deleteReplicaFromClusterState
   [junit4] OK      6.11s J1 | DeleteReplicaTest.deleteLiveReplicaTest
   [junit4] OK      6.04s J1 | DeleteReplicaTest.deleteReplicaFromClusterStateLegacy
   [junit4] OK      3.35s J1 | DeleteReplicaTest.deleteReplicaByCountForAllShards
   [junit4] OK      10.4s J1 | DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica
   [junit4] OK      5.41s J1 | DeleteReplicaTest.deleteReplicaOnIndexing
   [junit4] OK      5.82s J1 | DeleteReplicaTest.deleteReplicaAndVerifyDirectoryCleanup
   [junit4] OK      3.32s J1 | DeleteReplicaTest.deleteReplicaByCount
   [junit4] OK      8.70s J1 | DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplicaLegacy
   [junit4] Completed [2/5] on J1 in 61.43s, 9 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.DeleteReplicaTest
   [junit4] OK      12.2s J0 | DeleteReplicaTest.deleteReplicaFromClusterState
   [junit4] OK      6.52s J0 | DeleteReplicaTest.deleteLiveReplicaTest
   [junit4] OK      5.97s J0 | DeleteReplicaTest.deleteReplicaFromClusterStateLegacy
   [junit4] OK      3.18s J0 | DeleteReplicaTest.deleteReplicaByCountForAllShards
   [junit4] OK      8.90s J0 | DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica
   [junit4] OK      5.38s J0 | DeleteReplicaTest.deleteReplicaOnIndexing
   [junit4] OK      5.58s J0 | DeleteReplicaTest.deleteReplicaAndVerifyDirectoryCleanup
   [junit4] OK      3.43s J0 | DeleteReplicaTest.deleteReplicaByCount
   [junit4] OK      11.4s J0 | DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplicaLegacy
   [junit4] Completed [3/5] on J0 in 64.27s, 9 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.DeleteReplicaTest
   [junit4] OK      3.62s J1 | DeleteReplicaTest.deleteReplicaFromClusterState
   [junit4] OK      5.45s J1 | DeleteReplicaTest.deleteLiveReplicaTest
   [junit4] OK      3.32s J1 | DeleteReplicaTest.deleteReplicaFromClusterStateLegacy
   [junit4] OK      3.40s J1 | DeleteReplicaTest.deleteReplicaByCountForAllShards
   [junit4] OK      10.5s J1 | DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica
   [junit4] OK      5.06s J1 | DeleteReplicaTest.deleteReplicaOnIndexing
   [junit4] OK      5.51s J1 | DeleteReplicaTest.deleteReplicaAndVerifyDirectoryCleanup
   [junit4] OK      3.38s J1 | DeleteReplicaTest.deleteReplicaByCount
   [junit4] OK      9.05s J1 | DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplicaLegacy
   [junit4] Completed [4/5] on J1 in 49.80s, 9 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.DeleteReplicaTest
   [junit4] OK      6.01s J2 | DeleteReplicaTest.deleteReplicaFromClusterState
   [junit4] OK      5.47s J2 | DeleteReplicaTest.deleteLiveReplicaTest
   [junit4] OK      3.34s J2 | DeleteReplicaTest.deleteReplicaFromClusterStateLegacy
   [junit4] OK      3.38s J2 | DeleteReplicaTest.deleteReplicaByCountForAllShards
   [junit4] OK      9.82s J2 | DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica
   [junit4] OK      4.75s J2 | DeleteReplicaTest.deleteReplicaOnIndexing
   [junit4] OK      5.65s J2 | DeleteReplicaTest.deleteReplicaAndVerifyDirectoryCleanup
   [junit4] OK      3.40s J2 | DeleteReplicaTest.deleteReplicaByCount
   [junit4] OK      11.3s J2 | DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplicaLegacy
   [junit4] Completed [5/5] on J2 in 53.43s, 9 tests
   [junit4] 
   [junit4] JVM J0:     0.43 ..    65.58 =    65.15s
   [junit4] JVM J1:     0.43 ..   112.55 =   112.12s
   [junit4] JVM J2:     0.43 ..   114.32 =   113.89s
   [junit4] Execution time total: 1 minute 54 seconds
   [junit4] Tests summary: 5 suites, 45 tests
   [junit4] Could not remove temporary path: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1 (java.nio.file.DirectoryNotEmptyException: Remaining files: [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp])
   [junit4] Could not remove temporary path: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0 (java.nio.file.DirectoryNotEmptyException: Remaining files: [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp])
   [junit4] Could not remove temporary path: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2 (java.nio.file.DirectoryNotEmptyException: Remaining files: [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp])
     [echo] 5 slowest tests:
[junit4:tophints] 116.53s | org.apache.solr.update.SoftAutoCommitTest
[junit4:tophints] 101.05s | org.apache.solr.cloud.api.collections.ShardSplitTest
[junit4:tophints]  88.98s | org.apache.solr.search.TestRangeQuery
[junit4:tophints]  80.82s | org.apache.solr.cloud.LIRRollingUpdatesTest
[junit4:tophints]  64.60s | org.apache.solr.cloud.autoscaling.TriggerIntegrationTest

-check-totals:

test-nocompile:

BUILD SUCCESSFUL
Total time: 1 minute 56 seconds
[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.DeleteReplicaTest
[repro] Exiting with code 0
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
java.lang.InterruptedException: no matches found within 10000
	at hudson.FilePath$ValidateAntFileMask.hasMatch(FilePath.java:2845)
	at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2724)
	at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2705)
	at hudson.FilePath.act(FilePath.java:1076)
	at hudson.FilePath.act(FilePath.java:1059)
	at hudson.FilePath.validateAntFileMask(FilePath.java:2703)
	at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
	at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
	at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
	at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
	at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
	at hudson.model.Build$BuildExecution.post2(Build.java:186)
	at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
	at hudson.model.Run.execute(Run.java:1835)
	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
	at hudson.model.ResourceController.execute(ResourceController.java:97)
	at hudson.model.Executor.run(Executor.java:429)
No artifacts found that match the file pattern "**/*.events,heapdumps/**,**/*_pid*.log". Configuration error?
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=d9cd9f78b1182125a7fb02d724608d5f355df785, workspace=/var/lib/jenkins/workspace/Lucene-Solr-7.x-Linux
[WARNINGS] Computing warning deltas based on reference build #3192
Recording test results
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2