You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2019/11/22 15:37:55 UTC

[JENKINS] Lucene-Solr-SOLR-13661-Linux (64bit/jdk-11.0.4) - Build # 172 - Failure!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-SOLR-13661-Linux/172/
Java: 64bit/jdk-11.0.4 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

3 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.ltr.TestLTROnSolrCloud

Error Message:
42 threads leaked from SUITE scope at org.apache.solr.ltr.TestLTROnSolrCloud:     1) Thread[id=259, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)    2) Thread[id=338, name=qtp1983222544-338, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/java.lang.Thread.sleep(Native Method)         at app//org.apache.solr.cloud.ZkController.waitForShardId(ZkController.java:1742)         at app//org.apache.solr.cloud.ZkController.doGetShardIdAndNodeNameProcess(ZkController.java:1689)         at app//org.apache.solr.cloud.ZkController.preRegister(ZkController.java:1804)         at app//org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1255)         at app//org.apache.solr.core.CoreContainer.create(CoreContainer.java:1173)         at app//org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:93)         at app//org.apache.solr.handler.admin.CoreAdminOperation$$Lambda$270/0x00007f42f7de0840.execute(Unknown Source)         at app//org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:362)         at app//org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)         at app//org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)         at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:198)         at app//org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:843)         at app//org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:809)         at app//org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:562)         at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:424)         at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:351)         at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)         at app//org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:167)         at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)         at app//org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)         at app//org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)         at app//org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1711)         at app//org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)         at app//org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1347)         at app//org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)         at app//org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)         at app//org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1678)         at app//org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)         at app//org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1249)         at app//org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)         at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)         at app//org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)         at app//org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:703)         at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)         at app//org.eclipse.jetty.server.Server.handle(Server.java:505)         at app//org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)         at app//org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)         at app//org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)         at app//org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)         at app//org.eclipse.jetty.io.ssl.SslConnection$1.run(SslConnection.java:144)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)    3) Thread[id=271, name=NIOWorkerThread-7, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)    4) Thread[id=270, name=NIOWorkerThread-6, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)    5) Thread[id=279, name=NIOWorkerThread-10, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)    6) Thread[id=262, name=NIOWorkerThread-1, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)    7) Thread[id=266, name=NIOWorkerThread-3, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)    8) Thread[id=288, name=qtp1983222544-288, state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)         at java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:464)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:401)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$156/0x00007f43641ea458.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)    9) Thread[id=260, name=SyncThread:0, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at app//org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:109)   10) Thread[id=290, name=qtp1983222544-290, state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)         at java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:464)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:401)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$156/0x00007f43641ea458.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)   11) Thread[id=296, name=Session-HouseKeeper-6262607, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)   12) Thread[id=291, name=qtp1983222544-291, state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)         at java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:464)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:401)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$156/0x00007f43641ea458.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)   13) Thread[id=293, name=qtp1983222544-293, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/java.lang.Thread.sleep(Native Method)         at app//org.apache.solr.cloud.ZkController.waitForShardId(ZkController.java:1742)         at app//org.apache.solr.cloud.ZkController.doGetShardIdAndNodeNameProcess(ZkController.java:1689)         at app//org.apache.solr.cloud.ZkController.preRegister(ZkController.java:1804)         at app//org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1255)         at app//org.apache.solr.core.CoreContainer.create(CoreContainer.java:1173)         at app//org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:93)         at app//org.apache.solr.handler.admin.CoreAdminOperation$$Lambda$270/0x00007f42f7de0840.execute(Unknown Source)         at app//org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:362)         at app//org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)         at app//org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)         at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:198)         at app//org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:843)         at app//org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:809)         at app//org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:562)         at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:424)         at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:351)         at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)         at app//org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:167)         at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)         at app//org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)         at app//org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)         at app//org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1711)         at app//org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)         at app//org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1347)         at app//org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)         at app//org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)         at app//org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1678)         at app//org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)         at app//org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1249)         at app//org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)         at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)         at app//org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)         at app//org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:703)         at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)         at app//org.eclipse.jetty.server.Server.handle(Server.java:505)         at app//org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)         at app//org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)         at app//org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)         at app//org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)         at app//org.eclipse.jetty.io.ssl.SslConnection$1.run(SslConnection.java:144)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)   14) Thread[id=294, name=qtp1983222544-294, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/java.lang.Thread.sleep(Native Method)         at app//org.apache.solr.cloud.ZkController.waitForShardId(ZkController.java:1742)         at app//org.apache.solr.cloud.ZkController.doGetShardIdAndNodeNameProcess(ZkController.java:1689)         at app//org.apache.solr.cloud.ZkController.preRegister(ZkController.java:1804)         at app//org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1255)         at app//org.apache.solr.core.CoreContainer.create(CoreContainer.java:1173)         at app//org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:93)         at app//org.apache.solr.handler.admin.CoreAdminOperation$$Lambda$270/0x00007f42f7de0840.execute(Unknown Source)         at app//org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:362)         at app//org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)         at app//org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)         at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:198)         at app//org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:843)         at app//org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:809)         at app//org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:562)         at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:424)         at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:351)         at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)         at app//org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:167)         at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)         at app//org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)         at app//org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)         at app//org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1711)         at app//org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)         at app//org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1347)         at app//org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)         at app//org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)         at app//org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1678)         at app//org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)         at app//org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1249)         at app//org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)         at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)         at app//org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)         at app//org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:703)         at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)         at app//org.eclipse.jetty.server.Server.handle(Server.java:505)         at app//org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)         at app//org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)         at app//org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)         at app//org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)         at app//org.eclipse.jetty.io.ssl.SslConnection$1.run(SslConnection.java:144)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)   15) Thread[id=343, name=qtp1983222544-343, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)   16) Thread[id=329, name=Connector-Scheduler-7ccdf860, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)   17) Thread[id=336, name=qtp1983222544-336, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/java.lang.Thread.sleep(Native Method)         at app//org.apache.solr.cloud.ZkController.waitForShardId(ZkController.java:1742)         at app//org.apache.solr.cloud.ZkController.doGetShardIdAndNodeNameProcess(ZkController.java:1689)         at app//org.apache.solr.cloud.ZkController.preRegister(ZkController.java:1804)         at app//org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1255)         at app//org.apache.solr.core.CoreContainer.create(CoreContainer.java:1173)         at app//org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:93)         at app//org.apache.solr.handler.admin.CoreAdminOperation$$Lambda$270/0x00007f42f7de0840.execute(Unknown Source)         at app//org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:362)         at app//org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)         at app//org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)         at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:198)         at app//org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:843)         at app//org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:809)         at app//org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:562)         at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:424)         at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:351)         at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)         at app//org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:167)         at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)         at app//org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)         at app//org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)         at app//org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1711)         at app//org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)         at app//org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1347)         at app//org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)         at app//org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)         at app//org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1678)         at app//org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)         at app//org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1249)         at app//org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)         at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)         at app//org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)         at app//org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:703)         at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)         at app//org.eclipse.jetty.server.Server.handle(Server.java:505)         at app//org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)         at app//org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)         at app//org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)         at app//org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)         at app//org.eclipse.jetty.io.ssl.SslConnection$1.run(SslConnection.java:144)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)   18) Thread[id=286, name=NIOWorkerThread-16, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)   19) Thread[id=295, name=qtp1983222544-295, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2211)         at app//org.apache.solr.cloud.OverseerTaskQueue$LatchWatcher.await(OverseerTaskQueue.java:178)         at app//org.apache.solr.cloud.OverseerTaskQueue.offer(OverseerTaskQueue.java:232)         at app//org.apache.solr.handler.admin.CollectionsHandler.sendToOCPQueue(CollectionsHandler.java:369)         at app//org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:279)         at app//org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:253)         at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:198)         at app//org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:843)         at app//org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:809)         at app//org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:562)         at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:424)         at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:351)         at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)         at app//org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:167)         at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)         at app//org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)         at app//org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)         at app//org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1711)         at app//org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)         at app//org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1347)         at app//org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)         at app//org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)         at app//org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1678)         at app//org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)         at app//org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1249)         at app//org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)         at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)         at app//org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)         at app//org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:753)         at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)         at app//org.eclipse.jetty.server.Server.handle(Server.java:505)         at app//org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)         at app//org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)         at app//org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)         at app//org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)         at app//org.eclipse.jetty.io.ssl.SslConnection$1.run(SslConnection.java:144)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)   20) Thread[id=275, name=NIOWorkerThread-9, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)   21) Thread[id=292, name=qtp1983222544-292-acceptor-0@59255094-ServerConnector@7ccdf860{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:42937}, state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at java.base@11.0.4/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:533)         at java.base@11.0.4/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:285)         at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:385)         at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:648)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)   22) Thread[id=261, name=ProcessThread(sid:0 cport:43507):, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at app//org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:134)   23) Thread[id=256, name=NIOServerCxnFactory.SelectorThread-0, state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)         at java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.apache.zookeeper.server.NIOServerCnxnFactory$SelectorThread.select(NIOServerCnxnFactory.java:426)         at app//org.apache.zookeeper.server.NIOServerCnxnFactory$SelectorThread.run(NIOServerCnxnFactory.java:391)   24) Thread[id=283, name=NIOWorkerThread-13, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)   25) Thread[id=282, name=NIOWorkerThread-12, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)   26) Thread[id=257, name=NIOServerCxnFactory.SelectorThread-1, state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)         at java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.apache.zookeeper.server.NIOServerCnxnFactory$SelectorThread.select(NIOServerCnxnFactory.java:426)         at app//org.apache.zookeeper.server.NIOServerCnxnFactory$SelectorThread.run(NIOServerCnxnFactory.java:391)   27) Thread[id=280, name=NIOWorkerThread-11, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)   28) Thread[id=342, name=SolrRrdBackendFactory-139-thread-2, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)         at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)   29) Thread[id=265, name=NIOWorkerThread-2, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)   30) Thread[id=314, name=SolrRrdBackendFactory-139-thread-1, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)   31) Thread[id=269, name=NIOWorkerThread-5, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)   32) Thread[id=337, name=qtp1983222544-337, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)   33) Thread[id=274, name=NIOWorkerThread-8, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)   34) Thread[id=320, name=Thread-81, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/java.lang.Object.wait(Native Method)         at java.base@11.0.4/java.lang.Object.wait(Object.java:328)         at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:2049)   35) Thread[id=284, name=NIOWorkerThread-14, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)   36) Thread[id=254, name=ZkTestServer Run Thread, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/java.lang.Object.wait(Native Method)         at java.base@11.0.4/java.lang.Thread.join(Thread.java:1305)         at java.base@11.0.4/java.lang.Thread.join(Thread.java:1379)         at app//org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:950)         at app//org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:343)         at app//org.apache.solr.cloud.ZkTestServer$2.run(ZkTestServer.java:566)   37) Thread[id=285, name=NIOWorkerThread-15, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)   38) Thread[id=315, name=MetricsHistoryHandler-140-thread-1, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)         at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)   39) Thread[id=289, name=qtp1983222544-289, state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)         at java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:464)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:401)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)         at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)         at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$156/0x00007f43641ea458.run(Unknown Source)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)   40) Thread[id=258, name=NIOServerCxnFactory.AcceptThread:0.0.0.0/0.0.0.0:0, state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)         at java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)         at java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)         at java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)         at app//org.apache.zookeeper.server.NIOServerCnxnFactory$AcceptThread.select(NIOServerCnxnFactory.java:229)         at app//org.apache.zookeeper.server.NIOServerCnxnFactory$AcceptThread.run(NIOServerCnxnFactory.java:205)   41) Thread[id=255, name=ConnnectionExpirer, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.server.NIOServerCnxnFactory$ConnectionExpirerThread.run(NIOServerCnxnFactory.java:574)   42) Thread[id=268, name=NIOWorkerThread-4, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)         at java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)         at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)         at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 42 threads leaked from SUITE scope at org.apache.solr.ltr.TestLTROnSolrCloud: 
   1) Thread[id=259, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]
        at java.base@11.0.4/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
   2) Thread[id=338, name=qtp1983222544-338, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]
        at java.base@11.0.4/java.lang.Thread.sleep(Native Method)
        at app//org.apache.solr.cloud.ZkController.waitForShardId(ZkController.java:1742)
        at app//org.apache.solr.cloud.ZkController.doGetShardIdAndNodeNameProcess(ZkController.java:1689)
        at app//org.apache.solr.cloud.ZkController.preRegister(ZkController.java:1804)
        at app//org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1255)
        at app//org.apache.solr.core.CoreContainer.create(CoreContainer.java:1173)
        at app//org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:93)
        at app//org.apache.solr.handler.admin.CoreAdminOperation$$Lambda$270/0x00007f42f7de0840.execute(Unknown Source)
        at app//org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:362)
        at app//org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)
        at app//org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)
        at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:198)
        at app//org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:843)
        at app//org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:809)
        at app//org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:562)
        at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:424)
        at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:351)
        at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at app//org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:167)
        at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at app//org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at app//org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at app//org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1711)
        at app//org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at app//org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1347)
        at app//org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at app//org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at app//org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1678)
        at app//org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at app//org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1249)
        at app//org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at app//org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)
        at app//org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:703)
        at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at app//org.eclipse.jetty.server.Server.handle(Server.java:505)
        at app//org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at app//org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at app//org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at app//org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at app//org.eclipse.jetty.io.ssl.SslConnection$1.run(SslConnection.java:144)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)
        at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
   3) Thread[id=271, name=NIOWorkerThread-7, state=WAITING, group=TGRP-TestLTROnSolrCloud]
        at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
   4) Thread[id=270, name=NIOWorkerThread-6, state=WAITING, group=TGRP-TestLTROnSolrCloud]
        at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
   5) Thread[id=279, name=NIOWorkerThread-10, state=WAITING, group=TGRP-TestLTROnSolrCloud]
        at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
   6) Thread[id=262, name=NIOWorkerThread-1, state=WAITING, group=TGRP-TestLTROnSolrCloud]
        at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
   7) Thread[id=266, name=NIOWorkerThread-3, state=WAITING, group=TGRP-TestLTROnSolrCloud]
        at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
   8) Thread[id=288, name=qtp1983222544-288, state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]
        at java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:464)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:401)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$156/0x00007f43641ea458.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)
        at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
   9) Thread[id=260, name=SyncThread:0, state=WAITING, group=TGRP-TestLTROnSolrCloud]
        at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at app//org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:109)
  10) Thread[id=290, name=qtp1983222544-290, state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]
        at java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:464)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:401)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$156/0x00007f43641ea458.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)
        at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
  11) Thread[id=296, name=Session-HouseKeeper-6262607, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]
        at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
  12) Thread[id=291, name=qtp1983222544-291, state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]
        at java.base@11.0.4/sun.nio.ch.EPoll.wait(Native Method)
        at java.base@11.0.4/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
        at java.base@11.0.4/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
        at java.base@11.0.4/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:464)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:401)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:357)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:181)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
        at app//org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:132)
        at app//org.eclipse.jetty.io.ManagedSelector$$Lambda$156/0x00007f43641ea458.run(Unknown Source)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)
        at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
  13) Thread[id=293, name=qtp1983222544-293, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]
        at java.base@11.0.4/java.lang.Thread.sleep(Native Method)
        at app//org.apache.solr.cloud.ZkController.waitForShardId(ZkController.java:1742)
        at app//org.apache.solr.cloud.ZkController.doGetShardIdAndNodeNameProcess(ZkController.java:1689)
        at app//org.apache.solr.cloud.ZkController.preRegister(ZkController.java:1804)
        at app//org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1255)
        at app//org.apache.solr.core.CoreContainer.create(CoreContainer.java:1173)
        at app//org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:93)
        at app//org.apache.solr.handler.admin.CoreAdminOperation$$Lambda$270/0x00007f42f7de0840.execute(Unknown Source)
        at app//org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:362)
        at app//org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)
        at app//org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)
        at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:198)
        at app//org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:843)
        at app//org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:809)
        at app//org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:562)
        at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:424)
        at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:351)
        at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at app//org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:167)
        at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at app//org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at app//org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at app//org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1711)
        at app//org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at app//org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1347)
        at app//org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at app//org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at app//org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1678)
        at app//org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at app//org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1249)
        at app//org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at app//org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)
        at app//org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:703)
        at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at app//org.eclipse.jetty.server.Server.handle(Server.java:505)
        at app//org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at app//org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at app//org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at app//org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at app//org.eclipse.jetty.io.ssl.SslConnection$1.run(SslConnection.java:144)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)
        at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
  14) Thread[id=294, name=qtp1983222544-294, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]
        at java.base@11.0.4/java.lang.Thread.sleep(Native Method)
        at app//org.apache.solr.cloud.ZkController.waitForShardId(ZkController.java:1742)
        at app//org.apache.solr.cloud.ZkController.doGetShardIdAndNodeNameProcess(ZkController.java:1689)
        at app//org.apache.solr.cloud.ZkController.preRegister(ZkController.java:1804)
        at app//org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1255)
        at app//org.apache.solr.core.CoreContainer.create(CoreContainer.java:1173)
        at app//org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:93)
        at app//org.apache.solr.handler.admin.CoreAdminOperation$$Lambda$270/0x00007f42f7de0840.execute(Unknown Source)
        at app//org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:362)
        at app//org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)
        at app//org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)
        at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:198)
        at app//org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:843)
        at app//org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:809)
        at app//org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:562)
        at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:424)
        at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:351)
        at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at app//org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:167)
        at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at app//org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at app//org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at app//org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1711)
        at app//org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at app//org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1347)
        at app//org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at app//org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at app//org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1678)
        at app//org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at app//org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1249)
        at app//org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at app//org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)
        at app//org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:703)
        at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at app//org.eclipse.jetty.server.Server.handle(Server.java:505)
        at app//org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at app//org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at app//org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at app//org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at app//org.eclipse.jetty.io.ssl.SslConnection$1.run(SslConnection.java:144)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)
        at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
  15) Thread[id=343, name=qtp1983222544-343, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]
        at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:850)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:889)
        at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
  16) Thread[id=329, name=Connector-Scheduler-7ccdf860, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]
        at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
        at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@11.0.4/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
  17) Thread[id=336, name=qtp1983222544-336, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]
        at java.base@11.0.4/java.lang.Thread.sleep(Native Method)
        at app//org.apache.solr.cloud.ZkController.waitForShardId(ZkController.java:1742)
        at app//org.apache.solr.cloud.ZkController.doGetShardIdAndNodeNameProcess(ZkController.java:1689)
        at app//org.apache.solr.cloud.ZkController.preRegister(ZkController.java:1804)
        at app//org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1255)
        at app//org.apache.solr.core.CoreContainer.create(CoreContainer.java:1173)
        at app//org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:93)
        at app//org.apache.solr.handler.admin.CoreAdminOperation$$Lambda$270/0x00007f42f7de0840.execute(Unknown Source)
        at app//org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:362)
        at app//org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)
        at app//org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)
        at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:198)
        at app//org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:843)
        at app//org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:809)
        at app//org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:562)
        at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:424)
        at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:351)
        at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at app//org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:167)
        at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at app//org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at app//org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at app//org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1711)
        at app//org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at app//org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1347)
        at app//org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at app//org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at app//org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1678)
        at app//org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at app//org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1249)
        at app//org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at app//org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)
        at app//org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:703)
        at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at app//org.eclipse.jetty.server.Server.handle(Server.java:505)
        at app//org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at app//org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at app//org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at app//org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at app//org.eclipse.jetty.io.ssl.SslConnection$1.run(SslConnection.java:144)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)
        at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
  18) Thread[id=286, name=NIOWorkerThread-16, state=WAITING, group=TGRP-TestLTROnSolrCloud]
        at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
  19) Thread[id=295, name=qtp1983222544-295, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]
        at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11.0.4/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2211)
        at app//org.apache.solr.cloud.OverseerTaskQueue$LatchWatcher.await(OverseerTaskQueue.java:178)
        at app//org.apache.solr.cloud.OverseerTaskQueue.offer(OverseerTaskQueue.java:232)
        at app//org.apache.solr.handler.admin.CollectionsHandler.sendToOCPQueue(CollectionsHandler.java:369)
        at app//org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:279)
        at app//org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:253)
        at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:198)
        at app//org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:843)
        at app//org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:809)
        at app//org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:562)
        at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:424)
        at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:351)
        at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at app//org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:167)
        at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at app//org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at app//org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at app//org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1711)
        at app//org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at app//org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1347)
        at app//org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at app//org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at app//org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1678)
        at app//org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at app//org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1249)
        at app//org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at app//org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)
        at app//org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:753)
        at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at app//org.eclipse.jetty.server.Server.handle(Server.java:505)
        at app//org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at app//org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at app//org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at app//org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at app//org.eclipse.jetty.io.ssl.SslConnection$1.run(SslConnection.java:144)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917)
        at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
  20) Thread[id=275, name=NIOWorkerThread-9, state=WAITING, group=TGRP-TestLTROnSolrCloud]
        at java.base@11.0.4/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@11.0.4/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@11.0.4/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
        at java.base@11.0.4/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
        at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
        at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
        at java.base@11.0.4/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base@11.0.4/java.lang.Thread.run(Thread.java:834)
  21) Thread[id=292, name=qtp1983222544-292-acceptor-0@59255094-ServerConnector@7ccdf860{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:42937}, state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]
        at java.base@11.0.4/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Meth

[...truncated too long message...]

-lint] 	new PluginBag.RuntimeLib(req.getCore()).init(new PluginInfo(info.tag, op.getDataMap()));
 [ecj-lint] 	^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: '<unassigned Closeable value>' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 15. WARNING in /home/jenkins/workspace/Lucene-Solr-SOLR-13661-Linux/solr/core/src/java/org/apache/solr/handler/admin/SegmentsInfoRequestHandler.java (at line 243)
 [ecj-lint] 	leafReader = ((FilterLeafReader)leafReader).getDelegate();
 [ecj-lint] 	^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: 'leafReader' is not closed at this location
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 16. WARNING in /home/jenkins/workspace/Lucene-Solr-SOLR-13661-Linux/solr/core/src/java/org/apache/solr/handler/component/HttpShardHandler.java (at line 149)
 [ecj-lint] 	return new JavaBinCodec(null, stringCache).setReadStringAsCharSeq(true);
 [ecj-lint] 	       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: '<unassigned Closeable value>' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 17. WARNING in /home/jenkins/workspace/Lucene-Solr-SOLR-13661-Linux/solr/core/src/java/org/apache/solr/handler/component/HttpShardHandlerFactory.java (at line 415)
 [ecj-lint] 	ZkController zkController = core == null ? null : core.getCoreContainer().getZkController();
 [ecj-lint] 	             ^^^^^^^^^^^^
 [ecj-lint] Resource leak: 'zkController' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 18. WARNING in /home/jenkins/workspace/Lucene-Solr-SOLR-13661-Linux/solr/core/src/java/org/apache/solr/handler/component/RealTimeGetComponent.java (at line 1118)
 [ecj-lint] 	PeerSyncWithLeader peerSync = new PeerSyncWithLeader(rb.req.getCore(), syncWithLeader, nVersions);
 [ecj-lint] 	                   ^^^^^^^^
 [ecj-lint] Resource leak: 'peerSync' is never closed
 [ecj-lint] ----------
 [ecj-lint] 19. WARNING in /home/jenkins/workspace/Lucene-Solr-SOLR-13661-Linux/solr/core/src/java/org/apache/solr/handler/component/RealTimeGetComponent.java (at line 1140)
 [ecj-lint] 	PeerSync peerSync = new PeerSync(rb.req.getCore(), replicas, nVersions, cantReachIsSuccess);
 [ecj-lint] 	         ^^^^^^^^
 [ecj-lint] Resource leak: 'peerSync' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 20. WARNING in /home/jenkins/workspace/Lucene-Solr-SOLR-13661-Linux/solr/core/src/java/org/apache/solr/handler/loader/JavabinLoader.java (at line 137)
 [ecj-lint] 	new JavaBinCodec() {
 [ecj-lint]       SolrParams params;
 [ecj-lint]       AddUpdateCommand addCmd = null;
 [ecj-lint] 
 [ecj-lint]       @Override
 [ecj-lint]       public List<Object> readIterator(DataInputInputStream fis) throws IOException {
 [ecj-lint]         while (true) {
 [ecj-lint]           Object o = readVal(fis);
 [ecj-lint]           if (o == END_OBJ) break;
 [ecj-lint]           if (o instanceof NamedList) {
 [ecj-lint]             params = ((NamedList) o).toSolrParams();
 [ecj-lint]           } else {
 [ecj-lint]             try {
 [ecj-lint]               if (o instanceof byte[]) {
 [ecj-lint]                 if (params != null) req.setParams(params);
 [ecj-lint]                 byte[] buf = (byte[]) o;
 [ecj-lint]                 contentStreamLoader.load(req, rsp, new ContentStreamBase.ByteArrayStream(buf, null), processor);
 [ecj-lint]               } else {
 [ecj-lint]                 throw new RuntimeException("unsupported type ");
 [ecj-lint]               }
 [ecj-lint]             } catch (Exception e) {
 [ecj-lint]               throw new RuntimeException(e);
 [ecj-lint]             } finally {
 [ecj-lint]               params = null;
 [ecj-lint]               req.setParams(old);
 [ecj-lint]             }
 [ecj-lint]           }
 [ecj-lint]         }
 [ecj-lint]         return Collections.emptyList();
 [ecj-lint]       }
 [ecj-lint] 
 [ecj-lint]     }.unmarshal(in);
 [ecj-lint] 	^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: '<unassigned Closeable value>' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 21. INFO in /home/jenkins/workspace/Lucene-Solr-SOLR-13661-Linux/solr/core/src/java/org/apache/solr/logging/log4j2/Log4j2Watcher.java (at line 187)
 [ecj-lint] 	if (logger == root || root.equals(logger) || isRootLogger(name) || "".equals(name)) {
 [ecj-lint] 	                                  ^^^^^^
 [ecj-lint] Unlikely argument type for equals(): Map.Entry<String,LoggerConfig> seems to be unrelated to Logger
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 22. ERROR in /home/jenkins/workspace/Lucene-Solr-SOLR-13661-Linux/solr/core/src/java/org/apache/solr/search/CacheConfig.java (at line 35)
 [ecj-lint] 	import org.apache.solr.pkg.PackageLoader;
 [ecj-lint] 	       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] The import org.apache.solr.pkg.PackageLoader is never used
 [ecj-lint] ----------
 [ecj-lint] 23. ERROR in /home/jenkins/workspace/Lucene-Solr-SOLR-13661-Linux/solr/core/src/java/org/apache/solr/search/CacheConfig.java (at line 36)
 [ecj-lint] 	import org.apache.solr.pkg.PackagePluginHolder;
 [ecj-lint] 	       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] The import org.apache.solr.pkg.PackagePluginHolder is never used
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 24. WARNING in /home/jenkins/workspace/Lucene-Solr-SOLR-13661-Linux/solr/core/src/java/org/apache/solr/update/SolrIndexSplitter.java (at line 258)
 [ecj-lint] 	HardlinkCopyDirectoryWrapper hardLinkedDir = new HardlinkCopyDirectoryWrapper(splitDir);
 [ecj-lint] 	                             ^^^^^^^^^^^^^
 [ecj-lint] Resource leak: 'hardLinkedDir' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 25. WARNING in /home/jenkins/workspace/Lucene-Solr-SOLR-13661-Linux/solr/core/src/java/org/apache/solr/util/FileUtils.java (at line 52)
 [ecj-lint] 	try (FileChannel in = new FileInputStream(src).getChannel();
 [ecj-lint] 	                      ^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: '<unassigned Closeable value>' is never closed
 [ecj-lint] ----------
 [ecj-lint] 26. WARNING in /home/jenkins/workspace/Lucene-Solr-SOLR-13661-Linux/solr/core/src/java/org/apache/solr/util/FileUtils.java (at line 53)
 [ecj-lint] 	FileChannel out = new FileOutputStream(destination).getChannel()) {
 [ecj-lint] 	                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: '<unassigned Closeable value>' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 27. WARNING in /home/jenkins/workspace/Lucene-Solr-SOLR-13661-Linux/solr/core/src/java/org/apache/solr/util/SolrCLI.java (at line 1142)
 [ecj-lint] 	SnapshotCloudManager snapshotCloudManager = new SnapshotCloudManager(simCloudManager, config);
 [ecj-lint] 	                     ^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: 'snapshotCloudManager' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 28. WARNING in /home/jenkins/workspace/Lucene-Solr-SOLR-13661-Linux/solr/core/src/java/org/apache/solr/util/TestInjection.java (at line 265)
 [ecj-lint] 	timers.remove(this);
 [ecj-lint] 	              ^^^^
 [ecj-lint] Unlikely argument type new TimerTask(){} for remove(Object) on a Collection<Timer>
 [ecj-lint] ----------
 [ecj-lint] 28 problems (2 errors, 25 warnings, 1 info)

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-SOLR-13661-Linux/build.xml:634: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-SOLR-13661-Linux/build.xml:101: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-SOLR-13661-Linux/solr/build.xml:645: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-SOLR-13661-Linux/lucene/common-build.xml:2027: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-SOLR-13661-Linux/lucene/common-build.xml:2066: Compile failed; see the compiler error output for details.

Total time: 96 minutes 22 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2