You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2020/10/30 22:34:21 UTC

[JENKINS-Experimental-GC] Lucene-Solr-cloud2refimpl-MacOSX (64bit/jdk-14.0.1) - Build # 62 - Still Failing!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-cloud2refimpl-MacOSX/62/
Java: 64bit/jdk-14.0.1 -XX:+UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseShenandoahGC

9 tests failed.
FAILED:  org.apache.solr.cloud.api.collections.CollectionsAPIAsyncDistributedZkTest.classMethod

Error Message:
java.lang.AssertionError: ObjectTracker found 10 object(s) that were not released!!! [SolrCore, ParWorkExecutor, CommitTracker, DirectUpdateHandler2, SolrIndexSearcher, NRTCachingDirectory, NRTCachingDirectory, SolrIndexWriter, NRTCachingDirectory, CommitTracker]
org.apache.solr.core.SolrCore@4ea5a93b
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.core.SolrCore
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1134)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

org.apache.solr.common.ParWorkExecutor@54829bc4[Running, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 3]
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.common.ParWorkExecutor
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:970)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

disabled
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.update.CommitTracker
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.update.CommitTracker.<init>(CommitTracker.java:105)
	at org.apache.solr.update.DirectUpdateHandler2.<init>(DirectUpdateHandler2.java:130)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1061)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

org.apache.solr.update.DirectUpdateHandler2@6c0f29a8
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.update.DirectUpdateHandler2
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.update.DirectUpdateHandler2.<init>(DirectUpdateHandler2.java:144)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1061)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

Searcher@238dcf18[testasynccollectioncreation_shard1_0_replica_n0] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.search.SolrIndexSearcher
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.search.SolrIndexSearcher.<init>(SolrIndexSearcher.java:324)
	at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2223)
	at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:2398)
	at org.apache.solr.core.SolrCore.initSearcher(SolrCore.java:1192)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1067)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

NRTCachingDirectory(MMapDirectory@/Users/jenkins/workspace/Lucene-Solr-cloud2refimpl-MacOSX/solr/core/build/tmp/tests-tmp/solr.cloud.api.collections.CollectionsAPIAsyncDistributedZkTest_B05B926CCAE9A566-001/tempDir-001/node2/testasynccollectioncreation_shard1_0_replica_n0/data lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@13754700; maxCacheMB=48.0 maxMergeSizeMB=4.0)
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.NRTCachingDirectory
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:427)
	at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:408)
	at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:800)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1036)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

NRTCachingDirectory(MMapDirectory@/Users/jenkins/workspace/Lucene-Solr-cloud2refimpl-MacOSX/solr/core/build/tmp/tests-tmp/solr.cloud.api.collections.CollectionsAPIAsyncDistributedZkTest_B05B926CCAE9A566-001/tempDir-001/node2/testasynccollectioncreation_shard1_0_replica_n0/data/snapshot_metadata lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1a701c5; maxCacheMB=48.0 maxMergeSizeMB=4.0)
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.NRTCachingDirectory
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:427)
	at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:559)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1032)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

org.apache.solr.update.SolrIndexWriter@5690bdfc
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.update.SolrIndexWriter
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.update.SolrIndexWriter.<init>(SolrIndexWriter.java:232)
	at org.apache.solr.update.SolrIndexWriter.buildIndexWriter(SolrIndexWriter.java:120)
	at org.apache.solr.update.DefaultSolrCoreState.createMainIndexWriter(DefaultSolrCoreState.java:288)
	at org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:147)
	at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2215)
	at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:2398)
	at org.apache.solr.core.SolrCore.initSearcher(SolrCore.java:1192)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1067)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

NRTCachingDirectory(MMapDirectory@/Users/jenkins/workspace/Lucene-Solr-cloud2refimpl-MacOSX/solr/core/build/tmp/tests-tmp/solr.cloud.api.collections.CollectionsAPIAsyncDistributedZkTest_B05B926CCAE9A566-001/tempDir-001/node2/testasynccollectioncreation_shard1_0_replica_n0/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@21cf42d0; maxCacheMB=48.0 maxMergeSizeMB=4.0)
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.NRTCachingDirectory
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:427)
	at org.apache.solr.update.SolrIndexWriter.getDir(SolrIndexWriter.java:238)
	at org.apache.solr.update.SolrIndexWriter.buildIndexWriter(SolrIndexWriter.java:119)
	at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:831)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1036)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

disabled
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.update.CommitTracker
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.update.CommitTracker.<init>(CommitTracker.java:105)
	at org.apache.solr.update.DirectUpdateHandler2.<init>(DirectUpdateHandler2.java:134)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1061)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

 expected null, but was:<ObjectTracker found 10 object(s) that were not released!!! [SolrCore, ParWorkExecutor, CommitTracker, DirectUpdateHandler2, SolrIndexSearcher, NRTCachingDirectory, NRTCachingDirectory, SolrIndexWriter, NRTCachingDirectory, CommitTracker]
org.apache.solr.core.SolrCore@4ea5a93b
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.core.SolrCore
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1134)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

org.apache.solr.common.ParWorkExecutor@54829bc4[Running, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 3]
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.common.ParWorkExecutor
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:970)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

disabled
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.update.CommitTracker
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.update.CommitTracker.<init>(CommitTracker.java:105)
	at org.apache.solr.update.DirectUpdateHandler2.<init>(DirectUpdateHandler2.java:130)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1061)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

org.apache.solr.update.DirectUpdateHandler2@6c0f29a8
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.update.DirectUpdateHandler2
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.update.DirectUpdateHandler2.<init>(DirectUpdateHandler2.java:144)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1061)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

Searcher@238dcf18[testasynccollectioncreation_shard1_0_replica_n0] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.search.SolrIndexSearcher
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.search.SolrIndexSearcher.<init>(SolrIndexSearcher.java:324)
	at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2223)
	at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:2398)
	at org.apache.solr.core.SolrCore.initSearcher(SolrCore.java:1192)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1067)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

NRTCachingDirectory(MMapDirectory@/Users/jenkins/workspace/Lucene-Solr-cloud2refimpl-MacOSX/solr/core/build/tmp/tests-tmp/solr.cloud.api.collections.CollectionsAPIAsyncDistributedZkTest_B05B926CCAE9A566-001/tempDir-001/node2/testasynccollectioncreation_shard1_0_replica_n0/data lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@13754700; maxCacheMB=48.0 maxMergeSizeMB=4.0)
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.NRTCachingDirectory
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:427)
	at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:408)
	at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:800)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1036)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

NRTCachingDirectory(MMapDirectory@/Users/jenkins/workspace/Lucene-Solr-cloud2refimpl-MacOSX/solr/core/build/tmp/tests-tmp/solr.cloud.api.collections.CollectionsAPIAsyncDistributedZkTest_B05B926CCAE9A566-001/tempDir-001/node2/testasynccollectioncreation_shard1_0_replica_n0/data/snapshot_metadata lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1a701c5; maxCacheMB=48.0 maxMergeSizeMB=4.0)
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.NRTCachingDirectory
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:427)
	at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:559)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1032)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

org.apache.solr.update.SolrIndexWriter@5690bdfc
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.update.SolrIndexWriter
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.update.SolrIndexWriter.<init>(SolrIndexWriter.java:232)
	at org.apache.solr.update.SolrIndexWriter.buildIndexWriter(SolrIndexWriter.java:120)
	at org.apache.solr.update.DefaultSolrCoreState.createMainIndexWriter(DefaultSolrCoreState.java:288)
	at org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:147)
	at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2215)
	at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:2398)
	at org.apache.solr.core.SolrCore.initSearcher(SolrCore.java:1192)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1067)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

NRTCachingDirectory(MMapDirectory@/Users/jenkins/workspace/Lucene-Solr-cloud2refimpl-MacOSX/solr/core/build/tmp/tests-tmp/solr.cloud.api.collections.CollectionsAPIAsyncDistributedZkTest_B05B926CCAE9A566-001/tempDir-001/node2/testasynccollectioncreation_shard1_0_replica_n0/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@21cf42d0; maxCacheMB=48.0 maxMergeSizeMB=4.0)
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.NRTCachingDirectory
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:427)
	at org.apache.solr.update.SolrIndexWriter.getDir(SolrIndexWriter.java:238)
	at org.apache.solr.update.SolrIndexWriter.buildIndexWriter(SolrIndexWriter.java:119)
	at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:831)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1036)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

disabled
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.update.CommitTracker
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.update.CommitTracker.<init>(CommitTracker.java:105)
	at org.apache.solr.update.DirectUpdateHandler2.<init>(DirectUpdateHandler2.java:134)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1061)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

>

Stack Trace:
java.lang.AssertionError: ObjectTracker found 10 object(s) that were not released!!! [SolrCore, ParWorkExecutor, CommitTracker, DirectUpdateHandler2, SolrIndexSearcher, NRTCachingDirectory, NRTCachingDirectory, SolrIndexWriter, NRTCachingDirectory, CommitTracker]
org.apache.solr.core.SolrCore@4ea5a93b
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.core.SolrCore
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1134)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

org.apache.solr.common.ParWorkExecutor@54829bc4[Running, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 3]
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.common.ParWorkExecutor
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:970)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

disabled
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.update.CommitTracker
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.update.CommitTracker.<init>(CommitTracker.java:105)
	at org.apache.solr.update.DirectUpdateHandler2.<init>(DirectUpdateHandler2.java:130)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1061)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

org.apache.solr.update.DirectUpdateHandler2@6c0f29a8
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.update.DirectUpdateHandler2
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.update.DirectUpdateHandler2.<init>(DirectUpdateHandler2.java:144)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1061)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

Searcher@238dcf18[testasynccollectioncreation_shard1_0_replica_n0] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.search.SolrIndexSearcher
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.search.SolrIndexSearcher.<init>(SolrIndexSearcher.java:324)
	at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2223)
	at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:2398)
	at org.apache.solr.core.SolrCore.initSearcher(SolrCore.java:1192)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1067)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

NRTCachingDirectory(MMapDirectory@/Users/jenkins/workspace/Lucene-Solr-cloud2refimpl-MacOSX/solr/core/build/tmp/tests-tmp/solr.cloud.api.collections.CollectionsAPIAsyncDistributedZkTest_B05B926CCAE9A566-001/tempDir-001/node2/testasynccollectioncreation_shard1_0_replica_n0/data lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@13754700; maxCacheMB=48.0 maxMergeSizeMB=4.0)
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.NRTCachingDirectory
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:427)
	at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:408)
	at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:800)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1036)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

NRTCachingDirectory(MMapDirectory@/Users/jenkins/workspace/Lucene-Solr-cloud2refimpl-MacOSX/solr/core/build/tmp/tests-tmp/solr.cloud.api.collections.CollectionsAPIAsyncDistributedZkTest_B05B926CCAE9A566-001/tempDir-001/node2/testasynccollectioncreation_shard1_0_replica_n0/data/snapshot_metadata lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1a701c5; maxCacheMB=48.0 maxMergeSizeMB=4.0)
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.NRTCachingDirectory
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:427)
	at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:559)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1032)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

org.apache.solr.update.SolrIndexWriter@5690bdfc
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.update.SolrIndexWriter
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.update.SolrIndexWriter.<init>(SolrIndexWriter.java:232)
	at org.apache.solr.update.SolrIndexWriter.buildIndexWriter(SolrIndexWriter.java:120)
	at org.apache.solr.update.DefaultSolrCoreState.createMainIndexWriter(DefaultSolrCoreState.java:288)
	at org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:147)
	at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2215)
	at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:2398)
	at org.apache.solr.core.SolrCore.initSearcher(SolrCore.java:1192)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1067)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

NRTCachingDirectory(MMapDirectory@/Users/jenkins/workspace/Lucene-Solr-cloud2refimpl-MacOSX/solr/core/build/tmp/tests-tmp/solr.cloud.api.collections.CollectionsAPIAsyncDistributedZkTest_B05B926CCAE9A566-001/tempDir-001/node2/testasynccollectioncreation_shard1_0_replica_n0/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@21cf42d0; maxCacheMB=48.0 maxMergeSizeMB=4.0)
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.NRTCachingDirectory
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:427)
	at org.apache.solr.update.SolrIndexWriter.getDir(SolrIndexWriter.java:238)
	at org.apache.solr.update.SolrIndexWriter.buildIndexWriter(SolrIndexWriter.java:119)
	at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:831)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1036)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

disabled
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.update.CommitTracker
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.update.CommitTracker.<init>(CommitTracker.java:105)
	at org.apache.solr.update.DirectUpdateHandler2.<init>(DirectUpdateHandler2.java:134)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1061)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

 expected null, but was:<ObjectTracker found 10 object(s) that were not released!!! [SolrCore, ParWorkExecutor, CommitTracker, DirectUpdateHandler2, SolrIndexSearcher, NRTCachingDirectory, NRTCachingDirectory, SolrIndexWriter, NRTCachingDirectory, CommitTracker]
org.apache.solr.core.SolrCore@4ea5a93b
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.core.SolrCore
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1134)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

org.apache.solr.common.ParWorkExecutor@54829bc4[Running, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 3]
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.common.ParWorkExecutor
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:970)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

disabled
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.update.CommitTracker
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.update.CommitTracker.<init>(CommitTracker.java:105)
	at org.apache.solr.update.DirectUpdateHandler2.<init>(DirectUpdateHandler2.java:130)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1061)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

org.apache.solr.update.DirectUpdateHandler2@6c0f29a8
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.update.DirectUpdateHandler2
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.update.DirectUpdateHandler2.<init>(DirectUpdateHandler2.java:144)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1061)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

Searcher@238dcf18[testasynccollectioncreation_shard1_0_replica_n0] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.search.SolrIndexSearcher
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.search.SolrIndexSearcher.<init>(SolrIndexSearcher.java:324)
	at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2223)
	at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:2398)
	at org.apache.solr.core.SolrCore.initSearcher(SolrCore.java:1192)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1067)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

NRTCachingDirectory(MMapDirectory@/Users/jenkins/workspace/Lucene-Solr-cloud2refimpl-MacOSX/solr/core/build/tmp/tests-tmp/solr.cloud.api.collections.CollectionsAPIAsyncDistributedZkTest_B05B926CCAE9A566-001/tempDir-001/node2/testasynccollectioncreation_shard1_0_replica_n0/data lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@13754700; maxCacheMB=48.0 maxMergeSizeMB=4.0)
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.NRTCachingDirectory
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:427)
	at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:408)
	at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:800)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1036)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

NRTCachingDirectory(MMapDirectory@/Users/jenkins/workspace/Lucene-Solr-cloud2refimpl-MacOSX/solr/core/build/tmp/tests-tmp/solr.cloud.api.collections.CollectionsAPIAsyncDistributedZkTest_B05B926CCAE9A566-001/tempDir-001/node2/testasynccollectioncreation_shard1_0_replica_n0/data/snapshot_metadata lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1a701c5; maxCacheMB=48.0 maxMergeSizeMB=4.0)
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.NRTCachingDirectory
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:427)
	at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:559)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1032)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

org.apache.solr.update.SolrIndexWriter@5690bdfc
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.update.SolrIndexWriter
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.update.SolrIndexWriter.<init>(SolrIndexWriter.java:232)
	at org.apache.solr.update.SolrIndexWriter.buildIndexWriter(SolrIndexWriter.java:120)
	at org.apache.solr.update.DefaultSolrCoreState.createMainIndexWriter(DefaultSolrCoreState.java:288)
	at org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:147)
	at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2215)
	at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:2398)
	at org.apache.solr.core.SolrCore.initSearcher(SolrCore.java:1192)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1067)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

NRTCachingDirectory(MMapDirectory@/Users/jenkins/workspace/Lucene-Solr-cloud2refimpl-MacOSX/solr/core/build/tmp/tests-tmp/solr.cloud.api.collections.CollectionsAPIAsyncDistributedZkTest_B05B926CCAE9A566-001/tempDir-001/node2/testasynccollectioncreation_shard1_0_replica_n0/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@21cf42d0; maxCacheMB=48.0 maxMergeSizeMB=4.0)
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.NRTCachingDirectory
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:427)
	at org.apache.solr.update.SolrIndexWriter.getDir(SolrIndexWriter.java:238)
	at org.apache.solr.update.SolrIndexWriter.buildIndexWriter(SolrIndexWriter.java:119)
	at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:831)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1036)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

disabled
StackTrace:
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.update.CommitTracker
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:56)
	at org.apache.solr.update.CommitTracker.<init>(CommitTracker.java:105)
	at org.apache.solr.update.DirectUpdateHandler2.<init>(DirectUpdateHandler2.java:134)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1061)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:952)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1360)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1266)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:101)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:371)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:401)
	at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.PerThreadExecService.runIt(PerThreadExecService.java:187)
	at org.apache.solr.common.PerThreadExecService.lambda$execute$1(PerThreadExecService.java:176)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:230)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
	at org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

>
	at __randomizedtesting.SeedInfo.seed([B05B926CCAE9A566]:0)
	at org.junit.Assert.fail(Assert.java:88)
	at org.junit.Assert.failNotNull(Assert.java:755)
	at org.junit.Assert.assertNull(Assert.java:737)
	at org.apache.solr.SolrTestCase.afterSolrTestCase(SolrTestCase.java:489)
	at jdk.internal.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:905)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
	at java.base/java.lang.Thread.run(Thread.java:832)


FAILED:  org.apache.solr.cloud.api.collections.CollectionsAPIAsyncDistributedZkTest.classMethod

Error Message:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.api.collections.CollectionsAPIAsyncDistributedZkTest: 
   1) Thread[id=19609, name=searcherExecutor18525, state=WAITING, group=TGRP-CollectionsAPIAsyncDistributedZkTest]
        at java.base@14.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@14.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341)
        at java.base@14.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block(AbstractQueuedSynchronizer.java:505)
        at java.base@14.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3137)
        at java.base@14.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1614)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.take(BlockingArrayQueue.java:342)
        at java.base@14.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1056)
        at java.base@14.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1116)
        at java.base@14.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
        at app//org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.api.collections.CollectionsAPIAsyncDistributedZkTest: 
   1) Thread[id=19609, name=searcherExecutor18525, state=WAITING, group=TGRP-CollectionsAPIAsyncDistributedZkTest]
        at java.base@14.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@14.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341)
        at java.base@14.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block(AbstractQueuedSynchronizer.java:505)
        at java.base@14.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3137)
        at java.base@14.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1614)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.take(BlockingArrayQueue.java:342)
        at java.base@14.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1056)
        at java.base@14.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1116)
        at java.base@14.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
        at app//org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)
	at __randomizedtesting.SeedInfo.seed([B05B926CCAE9A566]:0)


FAILED:  org.apache.solr.cloud.api.collections.CollectionsAPIAsyncDistributedZkTest.classMethod

Error Message:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=19609, name=searcherExecutor18525, state=WAITING, group=TGRP-CollectionsAPIAsyncDistributedZkTest]
        at java.base@14.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@14.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341)
        at java.base@14.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block(AbstractQueuedSynchronizer.java:505)
        at java.base@14.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3137)
        at java.base@14.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1614)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.take(BlockingArrayQueue.java:342)
        at java.base@14.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1056)
        at java.base@14.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1116)
        at java.base@14.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
        at app//org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=19609, name=searcherExecutor18525, state=WAITING, group=TGRP-CollectionsAPIAsyncDistributedZkTest]
        at java.base@14.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@14.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341)
        at java.base@14.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block(AbstractQueuedSynchronizer.java:505)
        at java.base@14.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3137)
        at java.base@14.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1614)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.take(BlockingArrayQueue.java:342)
        at java.base@14.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1056)
        at java.base@14.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1116)
        at java.base@14.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
        at app//org.apache.solr.common.ParWorkExecutor$ParWorkThreadFactory$1.run(ParWorkExecutor.java:98)
	at __randomizedtesting.SeedInfo.seed([B05B926CCAE9A566]:0)


FAILED:  org.apache.lucene.codecs.uniformsplit.TestUniformSplitPostingFormat.testCheckIntegrityReadsAllBytes

Error Message:
java.lang.AssertionError

Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([B05B926CCAE9A566:CD9983B06B1771CF]:0)
	at org.junit.Assert.fail(Assert.java:86)
	at org.junit.Assert.assertTrue(Assert.java:41)
	at org.junit.Assert.assertTrue(Assert.java:52)
	at org.apache.lucene.codecs.uniformsplit.TestUniformSplitPostingFormat.checkEncodingCalled(TestUniformSplitPostingFormat.java:63)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:1000)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java

[...truncated too long message...]

adle' line: 324

* What went wrong:
Execution failed for task ':solr:test-framework:validateSourcePatterns'.
> Found 7 violations in source files (nocommit).

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

47: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':solr:contrib:analytics:ecjLintTest'.
> Process 'command '/Users/jenkins/tools/java/64bit/jdk-14.0.1/bin/java'' finished with non-zero exit value 255

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

48: Task failed with an exception.
-----------
* Where:
Script '/Users/jenkins/workspace/Lucene-Solr-cloud2refimpl-MacOSX/gradle/validation/validate-source-patterns.gradle' line: 324

* What went wrong:
Execution failed for task ':solr:contrib:analytics:validateSourcePatterns'.
> Found 10 violations in source files (nocommit).

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

49: Task failed with an exception.
-----------
* Where:
Script '/Users/jenkins/workspace/Lucene-Solr-cloud2refimpl-MacOSX/gradle/validation/validate-source-patterns.gradle' line: 324

* What went wrong:
Execution failed for task ':solr:contrib:clustering:validateSourcePatterns'.
> Found 3 violations in source files (nocommit).

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

50: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':solr:contrib:dataimporthandler:ecjLintMain'.
> Process 'command '/Users/jenkins/tools/java/64bit/jdk-14.0.1/bin/java'' finished with non-zero exit value 255

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

51: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':solr:contrib:dataimporthandler:ecjLintTest'.
> Process 'command '/Users/jenkins/tools/java/64bit/jdk-14.0.1/bin/java'' finished with non-zero exit value 255

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

52: Task failed with an exception.
-----------
* Where:
Script '/Users/jenkins/workspace/Lucene-Solr-cloud2refimpl-MacOSX/gradle/validation/validate-source-patterns.gradle' line: 324

* What went wrong:
Execution failed for task ':solr:contrib:dataimporthandler:validateSourcePatterns'.
> Found 1 violations in source files (nocommit).

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

53: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':solr:contrib:dataimporthandler-extras:ecjLintMain'.
> Process 'command '/Users/jenkins/tools/java/64bit/jdk-14.0.1/bin/java'' finished with non-zero exit value 255

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

54: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':solr:contrib:extraction:ecjLintMain'.
> Process 'command '/Users/jenkins/tools/java/64bit/jdk-14.0.1/bin/java'' finished with non-zero exit value 255

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

55: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':solr:contrib:extraction:ecjLintTest'.
> Process 'command '/Users/jenkins/tools/java/64bit/jdk-14.0.1/bin/java'' finished with non-zero exit value 255

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

56: Task failed with an exception.
-----------
* Where:
Script '/Users/jenkins/workspace/Lucene-Solr-cloud2refimpl-MacOSX/gradle/validation/validate-source-patterns.gradle' line: 324

* What went wrong:
Execution failed for task ':solr:contrib:jaegertracer-configurator:validateSourcePatterns'.
> Found 1 violations in source files (nocommit).

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

57: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':solr:contrib:ltr:ecjLintMain'.
> Process 'command '/Users/jenkins/tools/java/64bit/jdk-14.0.1/bin/java'' finished with non-zero exit value 255

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

58: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':solr:contrib:ltr:ecjLintTest'.
> Process 'command '/Users/jenkins/tools/java/64bit/jdk-14.0.1/bin/java'' finished with non-zero exit value 255

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

59: Task failed with an exception.
-----------
* Where:
Script '/Users/jenkins/workspace/Lucene-Solr-cloud2refimpl-MacOSX/gradle/validation/validate-source-patterns.gradle' line: 324

* What went wrong:
Execution failed for task ':solr:contrib:ltr:validateSourcePatterns'.
> Found 4 violations in source files (nocommit).

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

60: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':solr:contrib:prometheus-exporter:ecjLintMain'.
> Process 'command '/Users/jenkins/tools/java/64bit/jdk-14.0.1/bin/java'' finished with non-zero exit value 255

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

61: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':solr:contrib:prometheus-exporter:ecjLintTest'.
> Process 'command '/Users/jenkins/tools/java/64bit/jdk-14.0.1/bin/java'' finished with non-zero exit value 255

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

62: Task failed with an exception.
-----------
* Where:
Script '/Users/jenkins/workspace/Lucene-Solr-cloud2refimpl-MacOSX/gradle/validation/validate-source-patterns.gradle' line: 324

* What went wrong:
Execution failed for task ':solr:contrib:prometheus-exporter:validateSourcePatterns'.
> Found 2 violations in source files (nocommit).

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

63: Task failed with an exception.
-----------
* Where:
Script '/Users/jenkins/workspace/Lucene-Solr-cloud2refimpl-MacOSX/gradle/validation/validate-source-patterns.gradle' line: 324

* What went wrong:
Execution failed for task ':solr:contrib:velocity:validateSourcePatterns'.
> Found 1 violations in source files (nocommit).

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.4.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 24m 49s
792 actionable tasks: 792 executed
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Archiving artifacts
[Java] Skipping execution of recorder since overall result is 'FAILURE'
Recording test results
[Checks API] No suitable checks publisher found.
[Checks API] No suitable checks publisher found.
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any