You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2020/07/16 14:42:11 UTC

[JENKINS] Lucene-Solr-8.x-MacOSX (64bit/jdk-14.0.1) - Build # 1264 - Still Unstable!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-MacOSX/1264/
Java: 64bit/jdk-14.0.1 -XX:-UseCompressedOops -XX:+UseParallelGC

2 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestCustomStream

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.core.TestCustomStream:     1) Thread[id=4558, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestCustomStream]         at java.base@14.0.1/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:157)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.core.TestCustomStream: 
   1) Thread[id=4558, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestCustomStream]
        at java.base@14.0.1/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:157)
	at __randomizedtesting.SeedInfo.seed([7391701CBC9EB08C]:0)


FAILED:  org.apache.solr.handler.TestBlobHandler.doBlobHandlerTest

Error Message:
Error from server at http://127.0.0.1:55831: Underlying core creation failed while creating collection: .system

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:55831: Underlying core creation failed while creating collection: .system
	at __randomizedtesting.SeedInfo.seed([7391701CBC9EB08C:9350524E0772C67E]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:681)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:266)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:214)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:231)
	at org.apache.solr.handler.TestBlobHandler.doBlobHandlerTest(TestBlobHandler.java:63)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1090)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1061)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:832)




Build Log:
[...truncated 14079 lines...]
   [junit4] Suite: org.apache.solr.core.TestCustomStream
   [junit4]   2> 394046 INFO  (SUITE-TestCustomStream-seed#[7391701CBC9EB08C]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 394047 INFO  (SUITE-TestCustomStream-seed#[7391701CBC9EB08C]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestCustomStream_7391701CBC9EB08C-001/data-dir-56-001
   [junit4]   2> 394048 WARN  (SUITE-TestCustomStream-seed#[7391701CBC9EB08C]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=79 numCloses=79
   [junit4]   2> 394048 INFO  (SUITE-TestCustomStream-seed#[7391701CBC9EB08C]-worker) [     ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 394049 INFO  (SUITE-TestCustomStream-seed#[7391701CBC9EB08C]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
   [junit4]   2> 394049 INFO  (SUITE-TestCustomStream-seed#[7391701CBC9EB08C]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 394049 INFO  (SUITE-TestCustomStream-seed#[7391701CBC9EB08C]-worker) [     ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 394053 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 394053 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
   [junit4]   2> 394053 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 394056 WARN  (ZkTestServer Run Thread) [     ] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0.
   [junit4]   2> 394154 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.ZkTestServer start zk server on port: 55753
   [junit4]   2> 394154 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:55753
   [junit4]   2> 394154 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:55753
   [junit4]   2> 394154 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 55753
   [junit4]   2> 394160 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 394167 INFO  (zkConnectionManagerCallback-3598-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 394167 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 394173 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 394178 INFO  (zkConnectionManagerCallback-3600-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 394178 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 394182 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 394266 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 394276 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 394289 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 394295 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 394299 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 394302 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 394305 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 394309 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 394312 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 394314 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 394317 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
   [junit4]   2> 394661 WARN  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
   [junit4]   2> 394661 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 394661 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 394661 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14.0.1+7
   [junit4]   2> 394675 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 394675 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 394675 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 394676 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@8913c6e{/,null,AVAILABLE}
   [junit4]   2> 394679 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.e.j.s.AbstractConnector Started ServerConnector@7bca8f5c{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:?????}
   [junit4]   2> 394679 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.e.j.s.Server Started @??????ms
   [junit4]   2> 394679 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestCustomStream_7391701CBC9EB08C-001/tempDir-001/control/data, hostPort=55758, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestCustomStream_7391701CBC9EB08C-001/control-001/cores}
   [junit4]   2> 394679 ERROR (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 394679 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 394679 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.7.0
   [junit4]   2> 394679 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 394679 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr
   [junit4]   2> 394679 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2020-07-16T14:01:16.713912Z
   [junit4]   2> 394682 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 394686 INFO  (zkConnectionManagerCallback-3602-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 394686 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 394689 WARN  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]-SendThread(127.0.0.1:55753)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100ce9a6e280002.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x100ce9a6e280002, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100ce9a6e280002, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:348) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1262) [zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 394794 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 394794 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestCustomStream_7391701CBC9EB08C-001/control-001/solr.xml
   [junit4]   2> 394800 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 394800 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 394801 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6f243b2b, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 394869 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
   [junit4]   2> 394871 WARN  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@495ba97e[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 394871 WARN  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@495ba97e[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 394875 WARN  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@6497b0f[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 394875 WARN  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@6497b0f[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 394876 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55753/solr
   [junit4]   2> 394877 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 394880 INFO  (zkConnectionManagerCallback-3612-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 394880 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 394883 WARN  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]-SendThread(127.0.0.1:55753)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100ce9a6e280003.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x100ce9a6e280003, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100ce9a6e280003, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:348) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1262) [zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 394990 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [n:127.0.0.1:55758_     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 394995 INFO  (zkConnectionManagerCallback-3614-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 394995 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [n:127.0.0.1:55758_     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 395233 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [n:127.0.0.1:55758_     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:55758_
   [junit4]   2> 395234 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [n:127.0.0.1:55758_     ] o.a.s.c.Overseer Overseer (id=72284756706328580-127.0.0.1:55758_-n_0000000000) starting
   [junit4]   2> 395252 INFO  (OverseerStateUpdate-72284756706328580-127.0.0.1:55758_-n_0000000000) [n:127.0.0.1:55758_     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:55758_
   [junit4]   2> 395252 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [n:127.0.0.1:55758_     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55758_
   [junit4]   2> 395256 INFO  (OverseerStateUpdate-72284756706328580-127.0.0.1:55758_-n_0000000000) [n:127.0.0.1:55758_     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 395264 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [n:127.0.0.1:55758_     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 395265 WARN  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [n:127.0.0.1:55758_     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 395301 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [n:127.0.0.1:55758_     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 395336 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [n:127.0.0.1:55758_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f243b2b
   [junit4]   2> 395344 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [n:127.0.0.1:55758_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f243b2b
   [junit4]   2> 395344 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [n:127.0.0.1:55758_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f243b2b
   [junit4]   2> 395345 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [n:127.0.0.1:55758_     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestCustomStream_7391701CBC9EB08C-001/control-001/cores
   [junit4]   2> 395381 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 395396 INFO  (zkConnectionManagerCallback-3631-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 395397 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 395410 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 395419 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:55753/solr ready
   [junit4]   2> 395425 INFO  (qtp2081332809-4585) [n:127.0.0.1:55758_     ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:55758_&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 395455 INFO  (OverseerThreadFactory-3621-thread-1-processing-n:127.0.0.1:55758_) [n:127.0.0.1:55758_     ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 395599 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 395599 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
   [junit4]   2> 395616 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_    x:control_collection_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 396656 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.7.0
   [junit4]   2> 396672 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from configset conf1, trusted=true
   [junit4]   2> 396679 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 396759 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 396826 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f243b2b
   [junit4]   2> 396826 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestCustomStream_7391701CBC9EB08C-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestCustomStream_7391701CBC9EB08C-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 396829 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=41, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 396831 WARN  (qtp2081332809-4587) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 396899 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 396899 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 396901 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 396901 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 396902 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=24, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.33572225407478595]
   [junit4]   2> 396905 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 396908 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 396908 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 396908 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1672382333784686592
   [junit4]   2> 396912 INFO  (searcherExecutor-3633-thread-1-processing-n:127.0.0.1:55758_ x:control_collection_shard1_replica_n1 c:control_collection s:shard1) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [control_collection_shard1_replica_n1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 396926 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, version=0}
   [junit4]   2> 396928 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/control_collection/leaders/shard1
   [junit4]   2> 396944 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 396944 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 396944 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:55758/control_collection_shard1_replica_n1/
   [junit4]   2> 396945 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 396946 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy http://127.0.0.1:55758/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 396946 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/72284756706328580-core_node2-n_0000000000
   [junit4]   2> 396952 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:55758/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 397065 INFO  (zkCallback-3613-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 397065 INFO  (zkCallback-3613-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 397069 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 397081 INFO  (qtp2081332809-4587) [n:127.0.0.1:55758_     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1465
   [junit4]   2> 397096 INFO  (qtp2081332809-4585) [n:127.0.0.1:55758_     ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
   [junit4]   2> 397181 INFO  (zkCallback-3613-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 397181 INFO  (zkCallback-3613-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 397181 INFO  (zkCallback-3613-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 397189 INFO  (qtp2081332809-4585) [n:127.0.0.1:55758_     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:55758_&wt=javabin&version=2} status=0 QTime=1764
   [junit4]   2> 397189 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.AbstractFullDistribZkTestBase Waiting to see 1 active replicas in collection: control_collection
   [junit4]   2> 397198 WARN  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]-SendThread(127.0.0.1:55753)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100ce9a6e280005.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x100ce9a6e280005, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100ce9a6e280005, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:348) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1262) [zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 397308 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 397315 INFO  (zkConnectionManagerCallback-3642-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 397315 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 397320 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 397326 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:55753/solr ready
   [junit4]   2> 397326 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 397330 INFO  (qtp2081332809-4585) [n:127.0.0.1:55758_     ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 397343 INFO  (OverseerThreadFactory-3621-thread-2-processing-n:127.0.0.1:55758_) [n:127.0.0.1:55758_     ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 397345 INFO  (OverseerCollectionConfigSetProcessor-72284756706328580-127.0.0.1:55758_-n_0000000000) [n:127.0.0.1:55758_     ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
   [junit4]   2> 397576 WARN  (OverseerThreadFactory-3621-thread-2-processing-n:127.0.0.1:55758_) [n:127.0.0.1:55758_     ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 397580 INFO  (qtp2081332809-4585) [n:127.0.0.1:55758_     ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
   [junit4]   2> 397585 INFO  (qtp2081332809-4585) [n:127.0.0.1:55758_     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=255
   [junit4]   2> 397588 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.SolrCloudTestCase active slice count: 2 expected: 2
   [junit4]   2> 397588 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
   [junit4]   2> 397589 INFO  (watches-3639-thread-1) [     ] o.a.s.c.SolrCloudTestCase active slice count: 2 expected: 2
   [junit4]   2> 397589 INFO  (watches-3639-thread-1) [     ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
   [junit4]   2> 397590 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.SolrCloudTestCase active slice count: 2 expected: 2
   [junit4]   2> 397590 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
   [junit4]   2> 397591 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.SolrCloudTestCase active slice count: 2 expected: 2
   [junit4]   2> 397591 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
   [junit4]   2> 397591 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.AbstractFullDistribZkTestBase Creating jetty instances pullReplicaCount=0 numOtherReplicas=4
   [junit4]   2> 397972 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestCustomStream_7391701CBC9EB08C-001/shard-1-001 of type NRT for shard2
   [junit4]   2> 397973 WARN  (closeThreadPool-3643-thread-1) [     ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
   [junit4]   2> 397974 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 397974 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 397974 INFO  (closeThreadPool-3643-thread-1) [     ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14.0.1+7
   [junit4]   2> 397977 INFO  (closeThreadPool-3643-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 397977 INFO  (closeThreadPool-3643-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 397977 INFO  (closeThreadPool-3643-thread-1) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 397977 INFO  (closeThreadPool-3643-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@79f8453c{/,null,AVAILABLE}
   [junit4]   2> 397978 INFO  (closeThreadPool-3643-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@4ddf840{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:?????}
   [junit4]   2> 397978 INFO  (closeThreadPool-3643-thread-1) [     ] o.e.j.s.Server Started @??????ms
   [junit4]   2> 397978 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestCustomStream_7391701CBC9EB08C-001/tempDir-001/jetty1, hostPort=55804, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestCustomStream_7391701CBC9EB08C-001/shard-1-001/cores}
   [junit4]   2> 397979 ERROR (closeThreadPool-3643-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 397979 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 397979 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.7.0
   [junit4]   2> 397979 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 397979 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr
   [junit4]   2> 397979 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2020-07-16T14:01:20.013375Z
   [junit4]   2> 397980 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 397986 INFO  (zkConnectionManagerCallback-3645-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 397986 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 397989 WARN  (closeThreadPool-3643-thread-1-SendThread(127.0.0.1:55753)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100ce9a6e280007.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x100ce9a6e280007, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100ce9a6e280007, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:348) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1262) [zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 398096 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 398096 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestCustomStream_7391701CBC9EB08C-001/shard-1-001/solr.xml
   [junit4]   2> 398099 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 398100 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 398106 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6f243b2b, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 398298 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
   [junit4]   2> 398300 WARN  (closeThreadPool-3643-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5cdb95b6[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 398300 WARN  (closeThreadPool-3643-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5cdb95b6[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 398305 WARN  (closeThreadPool-3643-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@2a4165ca[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 398305 WARN  (closeThreadPool-3643-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@2a4165ca[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 398307 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55753/solr
   [junit4]   2> 398309 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 398317 INFO  (zkConnectionManagerCallback-3655-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 398317 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 398320 WARN  (closeThreadPool-3643-thread-1-SendThread(127.0.0.1:55753)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100ce9a6e280008.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x100ce9a6e280008, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100ce9a6e280008, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:348) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1262) [zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 398369 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestCustomStream_7391701CBC9EB08C-001/shard-2-001 of type NRT for shard1
   [junit4]   2> 398370 WARN  (closeThreadPool-3643-thread-2) [     ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
   [junit4]   2> 398370 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 398370 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 398370 INFO  (closeThreadPool-3643-thread-2) [     ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14.0.1+7
   [junit4]   2> 398372 INFO  (closeThreadPool-3643-thread-2) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 398372 INFO  (closeThreadPool-3643-thread-2) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 398372 INFO  (closeThreadPool-3643-thread-2) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 398373 INFO  (closeThreadPool-3643-thread-2) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@191813ff{/,null,AVAILABLE}
   [junit4]   2> 398374 INFO  (closeThreadPool-3643-thread-2) [     ] o.e.j.s.AbstractConnector Started ServerConnector@14b543ba{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:?????}
   [junit4]   2> 398374 INFO  (closeThreadPool-3643-thread-2) [     ] o.e.j.s.Server Started @??????ms
   [junit4]   2> 398374 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestCustomStream_7391701CBC9EB08C-001/tempDir-001/jetty2, hostPort=55808, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestCustomStream_7391701CBC9EB08C-001/shard-2-001/cores}
   [junit4]   2> 398374 ERROR (closeThreadPool-3643-thread-2) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 398374 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 398374 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.7.0
   [junit4]   2> 398374 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 398374 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr
   [junit4]   2> 398374 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2020-07-16T14:01:20.408835Z
   [junit4]   2> 398375 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 398379 INFO  (zkConnectionManagerCallback-3657-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 398379 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 398427 INFO  (closeThreadPool-3643-thread-1) [n:127.0.0.1:55804_     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 398431 INFO  (zkConnectionManagerCallback-3659-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 398431 INFO  (closeThreadPool-3643-thread-1) [n:127.0.0.1:55804_     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 398484 INFO  (closeThreadPool-3643-thread-1) [n:127.0.0.1:55804_     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 398518 INFO  (closeThreadPool-3643-thread-1) [n:127.0.0.1:55804_     ] o.a.s.c.ZkController Publish node=127.0.0.1:55804_ as DOWN
   [junit4]   2> 398522 INFO  (closeThreadPool-3643-thread-1) [n:127.0.0.1:55804_     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 398523 INFO  (closeThreadPool-3643-thread-1) [n:127.0.0.1:55804_     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55804_
   [junit4]   2> 398528 INFO  (zkCallback-3613-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 398530 INFO  (zkCallback-3641-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 398530 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 398530 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestCustomStream_7391701CBC9EB08C-001/shard-2-001/solr.xml
   [junit4]   2> 398531 INFO  (zkCallback-3658-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 398533 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 398533 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 398534 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6f243b2b, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 398535 INFO  (closeThreadPool-3643-thread-1) [n:127.0.0.1:55804_     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 398536 WARN  (closeThreadPool-3643-thread-1) [n:127.0.0.1:55804_     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 398558 INFO  (closeThreadPool-3643-thread-1) [n:127.0.0.1:55804_     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 398579 INFO  (closeThreadPool-3643-thread-1) [n:127.0.0.1:55804_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f243b2b
   [junit4]   2> 398590 INFO  (closeThreadPool-3643-thread-1) [n:127.0.0.1:55804_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f243b2b
   [junit4]   2> 398590 INFO  (closeThreadPool-3643-thread-1) [n:127.0.0.1:55804_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f243b2b
   [junit4]   2> 398593 INFO  (closeThreadPool-3643-thread-1) [n:127.0.0.1:55804_     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestCustomStream_7391701CBC9EB08C-001/shard-1-001/cores
   [junit4]   2> 398606 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:55804_
   [junit4]   2> 398613 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
   [junit4]   2> 398615 WARN  (closeThreadPool-3643-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@51c926f5[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 398615 WARN  (closeThreadPool-3643-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@51c926f5[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 398619 WARN  (closeThreadPool-3643-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@668589f4[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 398619 WARN  (closeThreadPool-3643-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@668589f4[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 398620 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55753/solr
   [junit4]   2> 398621 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 398627 INFO  (zkConnectionManagerCallback-3677-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 398627 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 398630 WARN  (closeThreadPool-3643-thread-2-SendThread(127.0.0.1:55753)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100ce9a6e28000b.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x100ce9a6e28000b, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100ce9a6e28000b, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:348) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1262) [zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 398732 INFO  (closeThreadPool-3643-thread-2) [n:127.0.0.1:55808_     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 398739 INFO  (zkConnectionManagerCallback-3679-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 398740 INFO  (closeThreadPool-3643-thread-2) [n:127.0.0.1:55808_     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 398780 INFO  (closeThreadPool-3643-thread-2) [n:127.0.0.1:55808_     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 398838 INFO  (closeThreadPool-3643-thread-2) [n:127.0.0.1:55808_     ] o.a.s.c.ZkController Publish node=127.0.0.1:55808_ as DOWN
   [junit4]   2> 398846 INFO  (closeThreadPool-3643-thread-2) [n:127.0.0.1:55808_     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 398846 INFO  (closeThreadPool-3643-thread-2) [n:127.0.0.1:55808_     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55808_
   [junit4]   2> 398856 INFO  (zkCallback-3678-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 398856 INFO  (zkCallback-3641-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 398856 INFO  (zkCallback-3658-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 398857 INFO  (zkCallback-3613-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 398868 INFO  (closeThreadPool-3643-thread-2) [n:127.0.0.1:55808_     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 398869 WARN  (closeThreadPool-3643-thread-2) [n:127.0.0.1:55808_     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 398893 INFO  (closeThreadPool-3643-thread-2) [n:127.0.0.1:55808_     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 398935 INFO  (closeThreadPool-3643-thread-2) [n:127.0.0.1:55808_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f243b2b
   [junit4]   2> 398950 INFO  (closeThreadPool-3643-thread-2) [n:127.0.0.1:55808_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f243b2b
   [junit4]   2> 398950 INFO  (closeThreadPool-3643-thread-2) [n:127.0.0.1:55808_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f243b2b
   [junit4]   2> 398954 INFO  (closeThreadPool-3643-thread-2) [n:127.0.0.1:55808_     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestCustomStream_7391701CBC9EB08C-001/shard-2-001/cores
   [junit4]   2> 399049 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:55808_
   [junit4]   2> 399200 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestCustomStream_7391701CBC9EB08C-001/shard-3-001 of type NRT for shard2
   [junit4]   2> 399202 WARN  (closeThreadPool-3643-thread-2) [     ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
   [junit4]   2> 399202 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 399202 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 399202 INFO  (closeThreadPool-3643-thread-2) [     ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14.0.1+7
   [junit4]   2> 399214 INFO  (closeThreadPool-3643-thread-2) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 399214 INFO  (closeThreadPool-3643-thread-2) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 399215 INFO  (closeThreadPool-3643-thread-2) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 399216 INFO  (closeThreadPool-3643-thread-2) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@304f3fcb{/,null,AVAILABLE}
   [junit4]   2> 399235 INFO  (closeThreadPool-3643-thread-2) [     ] o.e.j.s.AbstractConnector Started ServerConnector@457be222{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:?????}
   [junit4]   2> 399235 INFO  (closeThreadPool-3643-thread-2) [     ] o.e.j.s.Server Started @??????ms
   [junit4]   2> 399235 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestCustomStream_7391701CBC9EB08C-001/tempDir-001/jetty3, hostPort=55813, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestCustomStream_7391701CBC9EB08C-001/shard-3-001/cores}
   [junit4]   2> 399236 ERROR (closeThreadPool-3643-thread-2) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 399236 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 399236 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.7.0
   [junit4]   2> 399236 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 399236 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr
   [junit4]   2> 399236 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2020-07-16T14:01:21.270520Z
   [junit4]   2> 399239 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 399249 INFO  (zkConnectionManagerCallback-3689-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 399252 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 399262 WARN  (closeThreadPool-3643-thread-2-SendThread(127.0.0.1:55753)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100ce9a6e28000d.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x100ce9a6e28000d, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100ce9a6e28000d, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:348) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1262) [zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 399367 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 399368 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestCustomStream_7391701CBC9EB08C-001/shard-3-001/solr.xml
   [junit4]   2> 399373 INFO  (OverseerCollectionConfigSetProcessor-72284756706328580-127.0.0.1:55758_-n_0000000000) [n:127.0.0.1:55758_     ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
   [junit4]   2> 399375 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 399375 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 399376 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6f243b2b, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 399613 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
   [junit4]   2> 399615 WARN  (closeThreadPool-3643-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@51453b1e[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 399615 WARN  (closeThreadPool-3643-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@51453b1e[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 399637 WARN  (closeThreadPool-3643-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5bd417ac[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 399637 WARN  (closeThreadPool-3643-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5bd417ac[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 399637 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55753/solr
   [junit4]   2> 399642 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 399646 INFO  (zkConnectionManagerCallback-3699-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 399646 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 399662 INFO  (TEST-TestCustomStream.testDynamicLoadingCustomStream-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 4 in directory /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestCustomStream_7391701CBC9EB08C-001/shard-4-001 of type NRT for shard1
   [junit4]   2> 399662 WARN  (closeThreadPool-3643-thread-1) [     ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
   [junit4]   2> 399662 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 399662 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 399662 INFO  (closeThreadPool-3643-thread-1) [     ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14.0.1+7
   [junit4]   2> 399664 INFO  (closeThreadPool-3643-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 399664 INFO  (closeThreadPool-3643-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 399664 INFO  (closeThreadPool-3643-thread-1) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 399665 INFO  (closeThreadPool-3643-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@b3892f2{/,null,AVAILABLE}
   [junit4]   2> 399666 INFO  (closeThreadPool-3643-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@73d0780b{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:?????}
   [junit4]   2> 399666 INFO  (closeThreadPool-3643-thread-1) [     ] o.e.j.s.Server Started @??????ms
   [junit4]   2> 399666 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestCustomStream_7391701CBC9EB08C-001/tempDir-001/jetty4, hostPort=55816, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestCustomStream_7391701CBC9EB08C-001/shard-4-001/cores}
   [junit4]   2> 399667 ERROR (closeThreadPool-3643-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 399667 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 399667 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.7.0
   [junit4]   2> 399667 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 399667 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr
   [junit4]   2> 399667 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2020-07-16T14:01:21.701160Z
   [junit4]   2> 399668 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 399674 INFO  (zkConnectionManagerCallback-3701-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 399674 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 399676 WARN  (closeThreadPool-3643-thread-1-SendThread(127.0.0.1:55753)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100ce9a6e28000f.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x100ce9a6e28000f, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100ce9a6e28000f, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:348) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1262) [zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 399756 INFO  (closeThreadPool-3643-thread-2) [n:127.0.0.1:55813_     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 399760 INFO  (zkConnectionManagerCallback-3703-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 399760 INFO  (closeThreadPool-3643-thread-2) [n:127.0.0.1:55813_     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 399789 INFO  (closeThreadPool-3643-thread-2) [n:127.0.0.1:55813_     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 399816 INFO  (closeThreadPool-3643-thread-2) [n:127.0.0.1:55813_     ] o.a.s.c.ZkController Publish node=127.0.0.1:55813_ as DOWN
   [junit4]   2> 399821 INFO  (closeThreadPool-3643-thread-2) [n:127.0.0.1:55813_     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 399821 INFO  (closeThreadPool-3643-thread-2) [n:127.0.0.1:55813_     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55813_
   [junit4]   2> 399826 INFO  (zkCallback-3658-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 399827 INFO  (zkCallback-3678-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 399827 INFO  (zkCallback-3613-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 399827 INFO  (zkCallback-3641-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 399828 INFO  (zkCallback-3702-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 399836 INFO  (closeThreadPool-3643-thread-2) [n:127.0.0.1:55813_     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 399836 WARN  (closeThreadPool-3643-thread-2) [n:127.0.0.1:55813_     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 399854 INFO  (closeThreadPool-3643-thread-2) [n:127.0.0.1:55813_     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 399858 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 399858 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestCustomStream_7391701CBC9EB08C-001/shard-4-001/solr.xml
   [junit4]   2> 399860 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 399860 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 399861 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6f243b2b, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 399879 INFO  (closeThreadPool-3643-thread-2) [n:127.0.0.1:55813_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f243b2b
   [junit4]   2> 399887 INFO  (closeThreadPool-3643-thread-2) [n:127.0.0.1:55813_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f243b2b
   [junit4]   2> 399887 INFO  (closeThreadPool-3643-thread-2) [n:127.0.0.1:55813_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f243b2b
   [junit4]   2> 399888 INFO  (closeThreadPool-3643-thread-2) [n:127.0.0.1:55813_     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestCustomStream_7391701CBC9EB08C-001/shard-3-001/cores
   [junit4]   2> 399900 INFO  (closeThreadPool-3643-thread-2) [     ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:55813_
   [junit4]   2> 400027 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
   [junit4]   2> 400032 WARN  (closeThreadPool-3643-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@7ff2904a[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 400032 WARN  (closeThreadPool-3643-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@7ff2904a[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 400040 WARN  (closeThreadPool-3643-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3aa0c28d[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 400040 WARN  (closeThreadPool-3643-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3aa0c28d[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 400043 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55753/solr
   [junit4]   2> 400046 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 400050 INFO  (zkConnectionManagerCallback-3721-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 400051 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 400060 WARN  (closeThreadPool-3643-thread-1-SendThread(127.0.0.1:55753)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100ce9a6e280011.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x100ce9a6e280011, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100ce9a6e280011, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:348) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1262) [zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 400168 INFO  (closeThreadPool-3643-thread-1) [n:127.0.0.1:55816_     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 400172 INFO  (zkConnectionManagerCallback-3723-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 400172 INFO  (closeThreadPool-3643-thread-1) [n:127.0.0.1:55816_     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 400225 INFO  (closeThreadPool-3643-thread-1) [n:127.0.0.1:55816_     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 400257 INFO  (closeThreadPool-3643-thread-1) [n:127.0.0.1:55816_     ] o.a.s.c.ZkController Publish node=127.0.0.1:55816_ as DOWN
   [junit4]   2> 400262 INFO  (closeThreadPool-3643-thread-1) [n:127.0.0.1:55816_     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 400262 INFO  (closeThreadPool-3643-thread-1) [n:127.0.0.1:55816_     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55816_
   [junit4]   2> 400271 INFO  (zkCallback-3658-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 400271 INFO  (zkCallback-3702-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 400271 INFO  (zkCallback-3678-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 400271 INFO  (zkCallback-3641-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 400272 INFO  (zkCallback-3613-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 400272 INFO  (zkCallback-3722-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 400284 INFO  (closeThreadPool-3643-thread-1) [n:127.0.0.1:55816_     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 400285 WARN  (closeThreadPool-3643-thread-1) [n:127.0.0.1:55816_     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 400323 INFO  (closeThreadPool-3643-thread-1) [n:127.0.0.1:55816_     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 400358 INFO  (closeThreadPool-3643-thread-1) [n:127.0.0.1:55816_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f243b2b
   [junit4]   2> 400365 INFO  (closeThreadPool-3643-thread-1) [n:127.0.0.1:55816_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f243b2b
   [junit4]   2> 400365 INFO  (closeThreadPool-3643-thread-1) [n:127.0.0.1:55816_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f243b2b
   [junit4]   2> 400366 INFO  (closeThreadPool-3643-thread-1) [n:127.0.0.1:55816_     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestCustomStream_7391701CBC9EB08C-001/shard-4-001/cores
   [junit4]   2> 400383 INFO  (closeThreadPool-3643-thread-1) [     ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:55816_
   [junit4]   2> 400388 INFO  (qtp208133280

[...truncated too long message...]

] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 425019 INFO  (closeThreadPool-4095-thread-1) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@261906b3{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
   [junit4]   2> 425020 INFO  (closeThreadPool-4095-thread-1) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@c9ac7e5{/,null,UNAVAILABLE}
   [junit4]   2> 425021 INFO  (closeThreadPool-4095-thread-1) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 425119 INFO  (closeThreadPool-4095-thread-3) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@661b6570{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
   [junit4]   2> 425119 INFO  (closeThreadPool-4095-thread-3) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@216fc7ba{/,null,UNAVAILABLE}
   [junit4]   2> 425119 INFO  (closeThreadPool-4095-thread-3) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 425121 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 425121 WARN  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[7391701CBC9EB08C]-SendThread(127.0.0.1:55769)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100ce9a76880000.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x100ce9a76880000, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100ce9a76880000, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:348) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1262) [zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 425226 WARN  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[7391701CBC9EB08C]-SendThread(127.0.0.1:55769)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100ce9a76880001.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x100ce9a76880001, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100ce9a76880001, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:348) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1262) [zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 425332 WARN  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	7	/solr/aliases.json
   [junit4]   2> 	5	/solr/packages.json
   [junit4]   2> 	5	/solr/security.json
   [junit4]   2> 	5	/solr/configs/conf1
   [junit4]   2> 	5	/solr/collections/collection1/terms/shard1
   [junit4]   2> 	5	/solr/collections/collection1/terms/shard2
   [junit4]   2> 	4	/solr/collections/collection1/collectionprops.json
   [junit4]   2> 	2	/solr/collections/.system/terms/shard1
   [junit4]   2> 	2	/solr/collections/control_collection/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	71	/solr/collections/collection1/state.json
   [junit4]   2> 	12	/solr/collections/control_collection/state.json
   [junit4]   2> 	7	/solr/clusterprops.json
   [junit4]   2> 	7	/solr/clusterstate.json
   [junit4]   2> 	2	/solr/overseer_elect/election/72284756846837772-127.0.0.1:55838_-n_0000000002
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	44	/solr/overseer/queue
   [junit4]   2> 	34	/solr/live_nodes
   [junit4]   2> 	23	/solr/collections
   [junit4]   2> 	19	/solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> 425337 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:55769
   [junit4]   2> 425337 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:55769
   [junit4]   2> 425337 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[7391701CBC9EB08C]) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 55769
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestBlobHandler -Dtests.method=doBlobHandlerTest -Dtests.seed=7391701CBC9EB08C -Dtests.slow=true -Dtests.locale=hu -Dtests.timezone=America/Mexico_City -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   29.1s J1 | TestBlobHandler.doBlobHandlerTest <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:55831: Underlying core creation failed while creating collection: .system
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([7391701CBC9EB08C:9350524E0772C67E]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:681)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:266)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:214)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:231)
   [junit4]    > 	at org.apache.solr.handler.TestBlobHandler.doBlobHandlerTest(TestBlobHandler.java:63)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1090)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1061)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:832)
   [junit4]   2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestBlobHandler_7391701CBC9EB08C-001
   [junit4]   2> Jul 16, 2020 2:01:47 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene86): {}, docValues:{}, maxPointsInLeafNode=1386, maxMBSortInHeap=6.881977182033886, sim=Asserting(RandomSimilarity(queryNorm=true): {}), locale=hu, timezone=America/Mexico_City
   [junit4]   2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 14.0.1 (64-bit)/cpus=6,threads=1,free=222483152,total=467140608
   [junit4]   2> NOTE: All tests run in this JVM: [TestHttpShardHandlerFactory, TestSweetSpotSimilarityFactory, MaxScoreCollectorTest, NoCacheHeaderTest, TestDynamicFieldResource, ZookeeperReadAPITest, SolrCoreMetricManagerTest, TestLeaderElectionZkExpiry, DistanceUnitsTest, TestFunctionQuery, TestRecoveryHdfs, SolrTestCaseJ4Test, ZkCLITest, TestPullReplica, TestStressThreadBackup, MissingSegmentRecoveryTest, TestSolrXml, CollectionsAPISolrJTest, TransactionLogTest, SoftAutoCommitTest, TestBlobHandler]
   [junit4] Completed [209/915 (2!)] on J1 in 29.75s, 1 test, 1 error <<< FAILURES!

[...truncated 47253 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-MacOSX/1264/consoleText

[repro] Revision: 9b0dfa19e201043fd85a122ecafca10816c705a3

[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseParallelGC"
[repro] Repro line:  ant test  -Dtestcase=TestCustomStream -Dtests.seed=7391701CBC9EB08C -Dtests.slow=true -Dtests.locale=ne-IN -Dtests.timezone=Europe/Ulyanovsk -Dtests.asserts=true -Dtests.file.encoding=US-ASCII

[repro] Repro line:  ant test  -Dtestcase=TestBlobHandler -Dtests.method=doBlobHandlerTest -Dtests.seed=7391701CBC9EB08C -Dtests.slow=true -Dtests.locale=hu -Dtests.timezone=America/Mexico_City -Dtests.asserts=true -Dtests.file.encoding=US-ASCII

[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       TestBlobHandler
[repro]       TestCustomStream
[repro] ant compile-test

[...truncated 3472 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=10 -Dtests.class="*.TestBlobHandler|*.TestCustomStream" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseParallelGC" -Dtests.seed=7391701CBC9EB08C -Dtests.slow=true -Dtests.locale=hu -Dtests.timezone=America/Mexico_City -Dtests.asserts=true -Dtests.file.encoding=US-ASCII

[...truncated 101 lines...]
[repro] Failures w/original seeds:
[repro]   0/5 failed: org.apache.solr.core.TestCustomStream
[repro]   0/5 failed: org.apache.solr.handler.TestBlobHandler
[repro] Exiting with code 0

[...truncated 91 lines...]

[JENKINS] Lucene-Solr-8.x-MacOSX (64bit/jdk1.8.0) - Build # 1267 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-MacOSX/1267/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseSerialGC

1 tests failed.
FAILED:  org.apache.solr.cloud.DocValuesNotIndexedTest.testGroupingDVOnlySortLast

Error Message:
Unexpected number of elements in the group for 'intGSL' size: '8' GroupValue: 'null' rsp: {responseHeader={zkConnected=true,status=0,QTime=924,params={q=*:*,group.sort=id asc,_stateVer_=dv_coll:5,group.limit=100,rows=100,wt=javabin,version=2,group.field=intGSL,group=true}},grouped={intGSL={matches=44,groups=[{groupValue=null,doclist={numFound=8,numFoundExact=true,start=0,maxScore=1.0,docs=[SolrDocument{id=10000, _version_=1672438980650467328, _root_=10000}, SolrDocument{id=10005, _version_=1672438980796219392, _root_=10005}, SolrDocument{id=10010, _version_=1672438980798316544, _root_=10010}, SolrDocument{id=10025, _version_=1672438980809850880, _root_=10025}, SolrDocument{id=10030, _version_=1672438980811948032, _root_=10030}, SolrDocument{id=10035, _version_=1672438980811948032, _root_=10035}, SolrDocument{id=10040, _version_=1672438980890591232, _root_=10040}, SolrDocument{id=10045, _version_=1672438980831870976, _root_=10045}]}}, {groupValue=177044606,doclist={numFound=7,numFoundExact=true,start=0,maxScore=1.0,docs=[SolrDocument{id=0, intGSL=177044606, longGSL=3810853080805174880, doubleGSL=5924.415842786574, floatGSL=7440.4976, dateGSL=Mon May 28 08:04:11 EEST 17038057, stringGSL=base_string_100322__00003245, boolGSL=true, sortableGSL=base_string_672740__00002777, _version_=1672438980643127296, _root_=0}, SolrDocument{id=1, intGSL=177044606, longGSL=3810853080805174880, doubleGSL=5924.415842786574, floatGSL=7440.4976, dateGSL=Mon May 28 08:04:11 EEST 17038057, stringGSL=base_string_100322__00003245, boolGSL=false, sortableGSL=base_string_672740__00002777, _version_=1672438980671438848, _root_=1}, SolrDocument{id=2, intGSL=177044606, longGSL=3810853080805174880, doubleGSL=5924.415842786574, floatGSL=7440.4976, dateGSL=Mon May 28 08:04:11 EEST 17038057, stringGSL=base_string_100322__00003245, boolGSL=true, sortableGSL=base_string_672740__00002777, _version_=1672438980671438848, _root_=2}, SolrDocument{id=3, intGSL=177044606, longGSL=3810853080805174880, doubleGSL=5924.415842786574, floatGSL=7440.4976, dateGSL=Mon May 28 08:04:11 EEST 17038057, stringGSL=base_string_100322__00003245, boolGSL=false, sortableGSL=base_string_672740__00002777, _version_=1672438980795170816, _root_=3}, SolrDocument{id=4, intGSL=177044606, longGSL=3810853080805174880, doubleGSL=5924.415842786574, floatGSL=7440.4976, dateGSL=Mon May 28 08:04:11 EEST 17038057, stringGSL=base_string_100322__00003245, boolGSL=true, sortableGSL=base_string_672740__00002777, _version_=1672438980795170816, _root_=4}, SolrDocument{id=5, intGSL=177044606, longGSL=3810853080805174880, doubleGSL=5924.415842786574, floatGSL=7440.4976, dateGSL=Mon May 28 08:04:11 EEST 17038057, stringGSL=base_string_100322__00003245, boolGSL=false, sortableGSL=base_string_672740__00002777, _version_=1672438980801462272, _root_=5}, SolrDocument{id=6, intGSL=177044606, longGSL=3810853080805174880, doubleGSL=5924.415842786574, floatGSL=7440.4976, dateGSL=Mon May 28 08:04:11 EEST 17038057, stringGSL=base_string_100322__00003245, boolGSL=true, sortableGSL=base_string_672740__00002777, _version_=1672438980796219392, _root_=6}]}}, {groupValue=177054083,doclist={numFound=6,numFoundExact=true,start=0,maxScore=1.0,docs=[SolrDocument{id=15, intGSL=177054083, longGSL=3810853080805183821, doubleGSL=18936.415842786573, floatGSL=14421.498, dateGSL=Mon May 28 08:04:20 EEST 17038057, stringGSL=base_string_100322__00018259, boolGSL=false, sortableGSL=base_string_672740__00011715, _version_=1672438980797267968, _root_=15}, SolrDocument{id=16, intGSL=177054083, longGSL=3810853080805183821, doubleGSL=18936.415842786573, floatGSL=14421.498, dateGSL=Mon May 28 08:04:20 EEST 17038057, stringGSL=base_string_100322__00018259, boolGSL=true, sortableGSL=base_string_672740__00011715, _version_=1672438980801462272, _root_=16}, SolrDocument{id=17, intGSL=177054083, longGSL=3810853080805183821, doubleGSL=18936.415842786573, floatGSL=14421.498, dateGSL=Mon May 28 08:04:20 EEST 17038057, stringGSL=base_string_100322__00018259, boolGSL=false, sortableGSL=base_string_672740__00011715, _version_=1672438980803559424, _root_=17}, SolrDocument{id=18, intGSL=177054083, longGSL=3810853080805183821, doubleGSL=18936.415842786573, floatGSL=14421.498, dateGSL=Mon May 28 08:04:20 EEST 17038057, stringGSL=base_string_100322__00018259, boolGSL=true, sortableGSL=base_string_672740__00011715, _version_=1672438980808802304, _root_=18}, SolrDocument{id=19, intGSL=177054083, longGSL=3810853080805183821, doubleGSL=18936.415842786573, floatGSL=14421.498, dateGSL=Mon May 28 08:04:20 EEST 17038057, stringGSL=base_string_100322__00018259, boolGSL=false, sortableGSL=base_string_672740__00011715, _version_=1672438980803559425, _root_=19}, SolrDocument{id=20, intGSL=177054083, longGSL=3810853080805183821, doubleGSL=18936.415842786573, floatGSL=14421.498, dateGSL=Mon May 28 08:04:20 EEST 17038057, stringGSL=base_string_100322__00018259, boolGSL=true, sortableGSL=base_string_672740__00011715, _version_=1672438980802510848, _root_=20}]}}, {groupValue=177059790,doclist={numFound=5,numFoundExact=true,start=0,maxScore=1.0,docs=[SolrDocument{id=21, intGSL=177059790, longGSL=3810853080805185268, doubleGSL=22805.415842786573, floatGSL=19958.498, dateGSL=Mon May 28 08:04:27 EEST 17038057, stringGSL=base_string_100322__00024461, boolGSL=false, sortableGSL=base_string_672740__00011787, _version_=1672438980804608000, _root_=21}, SolrDocument{id=22, intGSL=177059790, longGSL=3810853080805185268, doubleGSL=22805.415842786573, floatGSL=19958.498, dateGSL=Mon May 28 08:04:27 EEST 17038057, stringGSL=base_string_100322__00024461, boolGSL=true, sortableGSL=base_string_672740__00011787, _version_=1672438980803559424, _root_=22}, SolrDocument{id=23, intGSL=177059790, longGSL=3810853080805185268, doubleGSL=22805.415842786573, floatGSL=19958.498, dateGSL=Mon May 28 08:04:27 EEST 17038057, stringGSL=base_string_100322__00024461, boolGSL=false, sortableGSL=base_string_672740__00011787, _version_=1672438980805656576, _root_=23}, SolrDocument{id=25, intGSL=177059790, longGSL=3810853080805185268, doubleGSL=22805.415842786573, floatGSL=19958.498, dateGSL=Mon May 28 08:04:27 EEST 17038057, stringGSL=base_string_100322__00024461, boolGSL=false, sortableGSL=base_string_672740__00011787, _version_=1672438980805656577, _root_=25}, SolrDocument{id=26, intGSL=177059790, longGSL=3810853080805185268, doubleGSL=22805.415842786573, floatGSL=19958.498, dateGSL=Mon May 28 08:04:27 EEST 17038057, stringGSL=base_string_100322__00024461, boolGSL=true, sortableGSL=base_string_672740__00011787, _version_=1672438980809850881, _root_=26}]}}, {groupValue=177066259,doclist={numFound=5,numFoundExact=true,start=0,maxScore=1.0,docs=[SolrDocument{id=29, intGSL=177066259, longGSL=3810853080805193495, doubleGSL=23452.415842786573, floatGSL=20480.498, dateGSL=Mon May 28 08:04:37 EEST 17038057, stringGSL=base_string_100322__00031031, boolGSL=false, sortableGSL=base_string_672740__00019347, _version_=1672438980806705152, _root_=29}, SolrDocument{id=30, intGSL=177066259, longGSL=3810853080805193495, doubleGSL=23452.415842786573, floatGSL=20480.498, dateGSL=Mon May 28 08:04:37 EEST 17038057, stringGSL=base_string_100322__00031031, boolGSL=true, sortableGSL=base_string_672740__00019347, _version_=1672438980810899456, _root_=30}, SolrDocument{id=31, intGSL=177066259, longGSL=3810853080805193495, doubleGSL=23452.415842786573, floatGSL=20480.498, dateGSL=Mon May 28 08:04:37 EEST 17038057, stringGSL=base_string_100322__00031031, boolGSL=false, sortableGSL=base_string_672740__00019347, _version_=1672438980810899457, _root_=31}, SolrDocument{id=33, intGSL=177066259, longGSL=3810853080805193495, doubleGSL=23452.415842786573, floatGSL=20480.498, dateGSL=Mon May 28 08:04:37 EEST 17038057, stringGSL=base_string_100322__00031031, boolGSL=false, sortableGSL=base_string_672740__00019347, _version_=1672438980888494080, _root_=33}, SolrDocument{id=34, intGSL=177066259, longGSL=3810853080805193495, doubleGSL=23452.415842786573, floatGSL=20480.498, dateGSL=Mon May 28 08:04:37 EEST 17038057, stringGSL=base_string_100322__00031031, boolGSL=true, sortableGSL=base_string_672740__00019347, _version_=1672438980804608000, _root_=34}]}}, {groupValue=177071047,doclist={numFound=5,numFoundExact=true,start=0,maxScore=1.0,docs=[SolrDocument{id=35, intGSL=177071047, longGSL=3810853080805203433, doubleGSL=24994.415842786573, floatGSL=27273.498, dateGSL=Mon May 28 08:04:43 EEST 17038057, stringGSL=base_string_100322__00036318, boolGSL=false, sortableGSL=base_string_672740__00026337, _version_=1672438980805656576, _root_=35}, SolrDocument{id=36, intGSL=177071047, longGSL=3810853080805203433, doubleGSL=24994.415842786573, floatGSL=27273.498, dateGSL=Mon May 28 08:04:43 EEST 17038057, stringGSL=base_string_100322__00036318, boolGSL=true, sortableGSL=base_string_672740__00026337, _version_=1672438980806705152, _root_=36}, SolrDocument{id=37, intGSL=177071047, longGSL=3810853080805203433, doubleGSL=24994.415842786573, floatGSL=27273.498, dateGSL=Mon May 28 08:04:43 EEST 17038057, stringGSL=base_string_100322__00036318, boolGSL=false, sortableGSL=base_string_672740__00026337, _version_=1672438980889542656, _root_=37}, SolrDocument{id=39, intGSL=177071047, longGSL=3810853080805203433, doubleGSL=24994.415842786573, floatGSL=27273.498, dateGSL=Mon May 28 08:04:43 EEST 17038057, stringGSL=base_string_100322__00036318, boolGSL=false, sortableGSL=base_string_672740__00026337, _version_=1672438980811948033, _root_=39}, SolrDocument{id=41, intGSL=177071047, longGSL=3810853080805203433, doubleGSL=24994.415842786573, floatGSL=27273.498, dateGSL=Mon May 28 08:04:43 EEST 17038057, stringGSL=base_string_100322__00036318, boolGSL=false, sortableGSL=base_string_672740__00026337, _version_=1672438980806705153, _root_=41}]}}, {groupValue=177079067,doclist={numFound=5,numFoundExact=true,start=0,maxScore=1.0,docs=[SolrDocument{id=43, intGSL=177079067, longGSL=3810853080805212930, doubleGSL=32142.415842786573, floatGSL=36815.496, dateGSL=Mon May 28 08:04:50 EEST 17038057, stringGSL=base_string_100322__00038745, boolGSL=false, sortableGSL=base_string_672740__00032964, _version_=1672438980810899456, _root_=43}, SolrDocument{id=44, intGSL=177079067, longGSL=3810853080805212930, doubleGSL=32142.415842786573, floatGSL=36815.496, dateGSL=Mon May 28 08:04:50 EEST 17038057, stringGSL=base_string_100322__00038745, boolGSL=true, sortableGSL=base_string_672740__00032964, _version_=1672438980811948032, _root_=44}, SolrDocument{id=45, intGSL=177079067, longGSL=3810853080805212930, doubleGSL=32142.415842786573, floatGSL=36815.496, dateGSL=Mon May 28 08:04:50 EEST 17038057, stringGSL=base_string_100322__00038745, boolGSL=false, sortableGSL=base_string_672740__00032964, _version_=1672438980890591233, _root_=45}, SolrDocument{id=46, intGSL=177079067, longGSL=3810853080805212930, doubleGSL=32142.415842786573, floatGSL=36815.496, dateGSL=Mon May 28 08:04:50 EEST 17038057, stringGSL=base_string_100322__00038745, boolGSL=true, sortableGSL=base_string_672740__00032964, _version_=1672438980812996608, _root_=46}, SolrDocument{id=47, intGSL=177079067, longGSL=3810853080805212930, doubleGSL=32142.415842786573, floatGSL=36815.496, dateGSL=Mon May 28 08:04:50 EEST 17038057, stringGSL=base_string_100322__00038745, boolGSL=false, sortableGSL=base_string_672740__00032964, _version_=1672438980845502464, _root_=47}]}}, {groupValue=177046802,doclist={numFound=3,numFoundExact=true,start=0,maxScore=1.0,docs=[SolrDocument{id=12, intGSL=177046802, longGSL=3810853080805177499, doubleGSL=13219.415842786573, floatGSL=14335.498, dateGSL=Mon May 28 08:04:12 EEST 17038057, stringGSL=base_string_100322__00010328, boolGSL=true, sortableGSL=base_string_672740__00007585, _version_=1672438980796219393, _root_=12}, SolrDocument{id=7, intGSL=177046802, longGSL=3810853080805177499, doubleGSL=13219.415842786573, floatGSL=14335.498, dateGSL=Mon May 28 08:04:12 EEST 17038057, stringGSL=base_string_100322__00010328, boolGSL=false, sortableGSL=base_string_672740__00007585, _version_=1672438980797267968, _root_=7}, SolrDocument{id=9, intGSL=177046802, longGSL=3810853080805177499, doubleGSL=13219.415842786573, floatGSL=14335.498, dateGSL=Mon May 28 08:04:12 EEST 17038057, stringGSL=base_string_100322__00010328, boolGSL=false, sortableGSL=base_string_672740__00007585, _version_=1672438980797267969, _root_=9}]}}]}}}

Stack Trace:
java.lang.AssertionError: Unexpected number of elements in the group for 'intGSL' size: '8' GroupValue: 'null' rsp: {responseHeader={zkConnected=true,status=0,QTime=924,params={q=*:*,group.sort=id asc,_stateVer_=dv_coll:5,group.limit=100,rows=100,wt=javabin,version=2,group.field=intGSL,group=true}},grouped={intGSL={matches=44,groups=[{groupValue=null,doclist={numFound=8,numFoundExact=true,start=0,maxScore=1.0,docs=[SolrDocument{id=10000, _version_=1672438980650467328, _root_=10000}, SolrDocument{id=10005, _version_=1672438980796219392, _root_=10005}, SolrDocument{id=10010, _version_=1672438980798316544, _root_=10010}, SolrDocument{id=10025, _version_=1672438980809850880, _root_=10025}, SolrDocument{id=10030, _version_=1672438980811948032, _root_=10030}, SolrDocument{id=10035, _version_=1672438980811948032, _root_=10035}, SolrDocument{id=10040, _version_=1672438980890591232, _root_=10040}, SolrDocument{id=10045, _version_=1672438980831870976, _root_=10045}]}}, {groupValue=177044606,doclist={numFound=7,numFoundExact=true,start=0,maxScore=1.0,docs=[SolrDocument{id=0, intGSL=177044606, longGSL=3810853080805174880, doubleGSL=5924.415842786574, floatGSL=7440.4976, dateGSL=Mon May 28 08:04:11 EEST 17038057, stringGSL=base_string_100322__00003245, boolGSL=true, sortableGSL=base_string_672740__00002777, _version_=1672438980643127296, _root_=0}, SolrDocument{id=1, intGSL=177044606, longGSL=3810853080805174880, doubleGSL=5924.415842786574, floatGSL=7440.4976, dateGSL=Mon May 28 08:04:11 EEST 17038057, stringGSL=base_string_100322__00003245, boolGSL=false, sortableGSL=base_string_672740__00002777, _version_=1672438980671438848, _root_=1}, SolrDocument{id=2, intGSL=177044606, longGSL=3810853080805174880, doubleGSL=5924.415842786574, floatGSL=7440.4976, dateGSL=Mon May 28 08:04:11 EEST 17038057, stringGSL=base_string_100322__00003245, boolGSL=true, sortableGSL=base_string_672740__00002777, _version_=1672438980671438848, _root_=2}, SolrDocument{id=3, intGSL=177044606, longGSL=3810853080805174880, doubleGSL=5924.415842786574, floatGSL=7440.4976, dateGSL=Mon May 28 08:04:11 EEST 17038057, stringGSL=base_string_100322__00003245, boolGSL=false, sortableGSL=base_string_672740__00002777, _version_=1672438980795170816, _root_=3}, SolrDocument{id=4, intGSL=177044606, longGSL=3810853080805174880, doubleGSL=5924.415842786574, floatGSL=7440.4976, dateGSL=Mon May 28 08:04:11 EEST 17038057, stringGSL=base_string_100322__00003245, boolGSL=true, sortableGSL=base_string_672740__00002777, _version_=1672438980795170816, _root_=4}, SolrDocument{id=5, intGSL=177044606, longGSL=3810853080805174880, doubleGSL=5924.415842786574, floatGSL=7440.4976, dateGSL=Mon May 28 08:04:11 EEST 17038057, stringGSL=base_string_100322__00003245, boolGSL=false, sortableGSL=base_string_672740__00002777, _version_=1672438980801462272, _root_=5}, SolrDocument{id=6, intGSL=177044606, longGSL=3810853080805174880, doubleGSL=5924.415842786574, floatGSL=7440.4976, dateGSL=Mon May 28 08:04:11 EEST 17038057, stringGSL=base_string_100322__00003245, boolGSL=true, sortableGSL=base_string_672740__00002777, _version_=1672438980796219392, _root_=6}]}}, {groupValue=177054083,doclist={numFound=6,numFoundExact=true,start=0,maxScore=1.0,docs=[SolrDocument{id=15, intGSL=177054083, longGSL=3810853080805183821, doubleGSL=18936.415842786573, floatGSL=14421.498, dateGSL=Mon May 28 08:04:20 EEST 17038057, stringGSL=base_string_100322__00018259, boolGSL=false, sortableGSL=base_string_672740__00011715, _version_=1672438980797267968, _root_=15}, SolrDocument{id=16, intGSL=177054083, longGSL=3810853080805183821, doubleGSL=18936.415842786573, floatGSL=14421.498, dateGSL=Mon May 28 08:04:20 EEST 17038057, stringGSL=base_string_100322__00018259, boolGSL=true, sortableGSL=base_string_672740__00011715, _version_=1672438980801462272, _root_=16}, SolrDocument{id=17, intGSL=177054083, longGSL=3810853080805183821, doubleGSL=18936.415842786573, floatGSL=14421.498, dateGSL=Mon May 28 08:04:20 EEST 17038057, stringGSL=base_string_100322__00018259, boolGSL=false, sortableGSL=base_string_672740__00011715, _version_=1672438980803559424, _root_=17}, SolrDocument{id=18, intGSL=177054083, longGSL=3810853080805183821, doubleGSL=18936.415842786573, floatGSL=14421.498, dateGSL=Mon May 28 08:04:20 EEST 17038057, stringGSL=base_string_100322__00018259, boolGSL=true, sortableGSL=base_string_672740__00011715, _version_=1672438980808802304, _root_=18}, SolrDocument{id=19, intGSL=177054083, longGSL=3810853080805183821, doubleGSL=18936.415842786573, floatGSL=14421.498, dateGSL=Mon May 28 08:04:20 EEST 17038057, stringGSL=base_string_100322__00018259, boolGSL=false, sortableGSL=base_string_672740__00011715, _version_=1672438980803559425, _root_=19}, SolrDocument{id=20, intGSL=177054083, longGSL=3810853080805183821, doubleGSL=18936.415842786573, floatGSL=14421.498, dateGSL=Mon May 28 08:04:20 EEST 17038057, stringGSL=base_string_100322__00018259, boolGSL=true, sortableGSL=base_string_672740__00011715, _version_=1672438980802510848, _root_=20}]}}, {groupValue=177059790,doclist={numFound=5,numFoundExact=true,start=0,maxScore=1.0,docs=[SolrDocument{id=21, intGSL=177059790, longGSL=3810853080805185268, doubleGSL=22805.415842786573, floatGSL=19958.498, dateGSL=Mon May 28 08:04:27 EEST 17038057, stringGSL=base_string_100322__00024461, boolGSL=false, sortableGSL=base_string_672740__00011787, _version_=1672438980804608000, _root_=21}, SolrDocument{id=22, intGSL=177059790, longGSL=3810853080805185268, doubleGSL=22805.415842786573, floatGSL=19958.498, dateGSL=Mon May 28 08:04:27 EEST 17038057, stringGSL=base_string_100322__00024461, boolGSL=true, sortableGSL=base_string_672740__00011787, _version_=1672438980803559424, _root_=22}, SolrDocument{id=23, intGSL=177059790, longGSL=3810853080805185268, doubleGSL=22805.415842786573, floatGSL=19958.498, dateGSL=Mon May 28 08:04:27 EEST 17038057, stringGSL=base_string_100322__00024461, boolGSL=false, sortableGSL=base_string_672740__00011787, _version_=1672438980805656576, _root_=23}, SolrDocument{id=25, intGSL=177059790, longGSL=3810853080805185268, doubleGSL=22805.415842786573, floatGSL=19958.498, dateGSL=Mon May 28 08:04:27 EEST 17038057, stringGSL=base_string_100322__00024461, boolGSL=false, sortableGSL=base_string_672740__00011787, _version_=1672438980805656577, _root_=25}, SolrDocument{id=26, intGSL=177059790, longGSL=3810853080805185268, doubleGSL=22805.415842786573, floatGSL=19958.498, dateGSL=Mon May 28 08:04:27 EEST 17038057, stringGSL=base_string_100322__00024461, boolGSL=true, sortableGSL=base_string_672740__00011787, _version_=1672438980809850881, _root_=26}]}}, {groupValue=177066259,doclist={numFound=5,numFoundExact=true,start=0,maxScore=1.0,docs=[SolrDocument{id=29, intGSL=177066259, longGSL=3810853080805193495, doubleGSL=23452.415842786573, floatGSL=20480.498, dateGSL=Mon May 28 08:04:37 EEST 17038057, stringGSL=base_string_100322__00031031, boolGSL=false, sortableGSL=base_string_672740__00019347, _version_=1672438980806705152, _root_=29}, SolrDocument{id=30, intGSL=177066259, longGSL=3810853080805193495, doubleGSL=23452.415842786573, floatGSL=20480.498, dateGSL=Mon May 28 08:04:37 EEST 17038057, stringGSL=base_string_100322__00031031, boolGSL=true, sortableGSL=base_string_672740__00019347, _version_=1672438980810899456, _root_=30}, SolrDocument{id=31, intGSL=177066259, longGSL=3810853080805193495, doubleGSL=23452.415842786573, floatGSL=20480.498, dateGSL=Mon May 28 08:04:37 EEST 17038057, stringGSL=base_string_100322__00031031, boolGSL=false, sortableGSL=base_string_672740__00019347, _version_=1672438980810899457, _root_=31}, SolrDocument{id=33, intGSL=177066259, longGSL=3810853080805193495, doubleGSL=23452.415842786573, floatGSL=20480.498, dateGSL=Mon May 28 08:04:37 EEST 17038057, stringGSL=base_string_100322__00031031, boolGSL=false, sortableGSL=base_string_672740__00019347, _version_=1672438980888494080, _root_=33}, SolrDocument{id=34, intGSL=177066259, longGSL=3810853080805193495, doubleGSL=23452.415842786573, floatGSL=20480.498, dateGSL=Mon May 28 08:04:37 EEST 17038057, stringGSL=base_string_100322__00031031, boolGSL=true, sortableGSL=base_string_672740__00019347, _version_=1672438980804608000, _root_=34}]}}, {groupValue=177071047,doclist={numFound=5,numFoundExact=true,start=0,maxScore=1.0,docs=[SolrDocument{id=35, intGSL=177071047, longGSL=3810853080805203433, doubleGSL=24994.415842786573, floatGSL=27273.498, dateGSL=Mon May 28 08:04:43 EEST 17038057, stringGSL=base_string_100322__00036318, boolGSL=false, sortableGSL=base_string_672740__00026337, _version_=1672438980805656576, _root_=35}, SolrDocument{id=36, intGSL=177071047, longGSL=3810853080805203433, doubleGSL=24994.415842786573, floatGSL=27273.498, dateGSL=Mon May 28 08:04:43 EEST 17038057, stringGSL=base_string_100322__00036318, boolGSL=true, sortableGSL=base_string_672740__00026337, _version_=1672438980806705152, _root_=36}, SolrDocument{id=37, intGSL=177071047, longGSL=3810853080805203433, doubleGSL=24994.415842786573, floatGSL=27273.498, dateGSL=Mon May 28 08:04:43 EEST 17038057, stringGSL=base_string_100322__00036318, boolGSL=false, sortableGSL=base_string_672740__00026337, _version_=1672438980889542656, _root_=37}, SolrDocument{id=39, intGSL=177071047, longGSL=3810853080805203433, doubleGSL=24994.415842786573, floatGSL=27273.498, dateGSL=Mon May 28 08:04:43 EEST 17038057, stringGSL=base_string_100322__00036318, boolGSL=false, sortableGSL=base_string_672740__00026337, _version_=1672438980811948033, _root_=39}, SolrDocument{id=41, intGSL=177071047, longGSL=3810853080805203433, doubleGSL=24994.415842786573, floatGSL=27273.498, dateGSL=Mon May 28 08:04:43 EEST 17038057, stringGSL=base_string_100322__00036318, boolGSL=false, sortableGSL=base_string_672740__00026337, _version_=1672438980806705153, _root_=41}]}}, {groupValue=177079067,doclist={numFound=5,numFoundExact=true,start=0,maxScore=1.0,docs=[SolrDocument{id=43, intGSL=177079067, longGSL=3810853080805212930, doubleGSL=32142.415842786573, floatGSL=36815.496, dateGSL=Mon May 28 08:04:50 EEST 17038057, stringGSL=base_string_100322__00038745, boolGSL=false, sortableGSL=base_string_672740__00032964, _version_=1672438980810899456, _root_=43}, SolrDocument{id=44, intGSL=177079067, longGSL=3810853080805212930, doubleGSL=32142.415842786573, floatGSL=36815.496, dateGSL=Mon May 28 08:04:50 EEST 17038057, stringGSL=base_string_100322__00038745, boolGSL=true, sortableGSL=base_string_672740__00032964, _version_=1672438980811948032, _root_=44}, SolrDocument{id=45, intGSL=177079067, longGSL=3810853080805212930, doubleGSL=32142.415842786573, floatGSL=36815.496, dateGSL=Mon May 28 08:04:50 EEST 17038057, stringGSL=base_string_100322__00038745, boolGSL=false, sortableGSL=base_string_672740__00032964, _version_=1672438980890591233, _root_=45}, SolrDocument{id=46, intGSL=177079067, longGSL=3810853080805212930, doubleGSL=32142.415842786573, floatGSL=36815.496, dateGSL=Mon May 28 08:04:50 EEST 17038057, stringGSL=base_string_100322__00038745, boolGSL=true, sortableGSL=base_string_672740__00032964, _version_=1672438980812996608, _root_=46}, SolrDocument{id=47, intGSL=177079067, longGSL=3810853080805212930, doubleGSL=32142.415842786573, floatGSL=36815.496, dateGSL=Mon May 28 08:04:50 EEST 17038057, stringGSL=base_string_100322__00038745, boolGSL=false, sortableGSL=base_string_672740__00032964, _version_=1672438980845502464, _root_=47}]}}, {groupValue=177046802,doclist={numFound=3,numFoundExact=true,start=0,maxScore=1.0,docs=[SolrDocument{id=12, intGSL=177046802, longGSL=3810853080805177499, doubleGSL=13219.415842786573, floatGSL=14335.498, dateGSL=Mon May 28 08:04:12 EEST 17038057, stringGSL=base_string_100322__00010328, boolGSL=true, sortableGSL=base_string_672740__00007585, _version_=1672438980796219393, _root_=12}, SolrDocument{id=7, intGSL=177046802, longGSL=3810853080805177499, doubleGSL=13219.415842786573, floatGSL=14335.498, dateGSL=Mon May 28 08:04:12 EEST 17038057, stringGSL=base_string_100322__00010328, boolGSL=false, sortableGSL=base_string_672740__00007585, _version_=1672438980797267968, _root_=7}, SolrDocument{id=9, intGSL=177046802, longGSL=3810853080805177499, doubleGSL=13219.415842786573, floatGSL=14335.498, dateGSL=Mon May 28 08:04:12 EEST 17038057, stringGSL=base_string_100322__00010328, boolGSL=false, sortableGSL=base_string_672740__00007585, _version_=1672438980797267969, _root_=9}]}}]}}}
	at __randomizedtesting.SeedInfo.seed([2A6148CFC96672D7:9F920CFCA8C11789]:0)
	at org.junit.Assert.fail(Assert.java:88)
	at org.apache.solr.cloud.DocValuesNotIndexedTest.doGroupingDvOnly(DocValuesNotIndexedTest.java:404)
	at org.apache.solr.cloud.DocValuesNotIndexedTest.testGroupingDVOnlySortLast(DocValuesNotIndexedTest.java:332)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 13464 lines...]
   [junit4] Suite: org.apache.solr.cloud.DocValuesNotIndexedTest
   [junit4]   2> 91673 INFO  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 91673 INFO  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 91674 INFO  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.DocValuesNotIndexedTest_2A6148CFC96672D7-001/data-dir-11-001
   [junit4]   2> 91674 INFO  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker) [     ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 91675 INFO  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN) w/ MAC_OS_X supressed clientAuth
   [junit4]   2> 91679 INFO  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker) [     ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.DocValuesNotIndexedTest_2A6148CFC96672D7-001/tempDir-001
   [junit4]   2> 91679 INFO  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 91679 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
   [junit4]   2> 91679 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 91681 WARN  (ZkTestServer Run Thread) [     ] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0.
   [junit4]   2> 91779 INFO  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker) [     ] o.a.s.c.ZkTestServer start zk server on port: 59962
   [junit4]   2> 91779 INFO  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:59962
   [junit4]   2> 91779 INFO  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:59962
   [junit4]   2> 91779 INFO  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 59962
   [junit4]   2> 91783 INFO  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 91789 INFO  (zkConnectionManagerCallback-477-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 91789 INFO  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 91800 INFO  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 91805 INFO  (zkConnectionManagerCallback-479-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 91805 INFO  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 91806 INFO  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 91810 INFO  (zkConnectionManagerCallback-481-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 91810 INFO  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 91921 WARN  (jetty-launcher-482-thread-1) [     ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
   [junit4]   2> 91921 WARN  (jetty-launcher-482-thread-2) [     ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
   [junit4]   2> 91921 INFO  (jetty-launcher-482-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 91921 INFO  (jetty-launcher-482-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 91922 INFO  (jetty-launcher-482-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 91922 INFO  (jetty-launcher-482-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 91922 INFO  (jetty-launcher-482-thread-1) [     ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 1.8.0_201-b09
   [junit4]   2> 91922 INFO  (jetty-launcher-482-thread-2) [     ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 1.8.0_201-b09
   [junit4]   2> 91925 INFO  (jetty-launcher-482-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 91925 INFO  (jetty-launcher-482-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 91925 INFO  (jetty-launcher-482-thread-1) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 91927 INFO  (jetty-launcher-482-thread-2) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 91928 INFO  (jetty-launcher-482-thread-2) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 91928 INFO  (jetty-launcher-482-thread-2) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 91928 INFO  (jetty-launcher-482-thread-2) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1ea5ec37{/solr,null,AVAILABLE}
   [junit4]   2> 91929 INFO  (jetty-launcher-482-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@13b4f28f{/solr,null,AVAILABLE}
   [junit4]   2> 91932 INFO  (jetty-launcher-482-thread-2) [     ] o.e.j.s.AbstractConnector Started ServerConnector@5720c291{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:59967}
   [junit4]   2> 91932 INFO  (jetty-launcher-482-thread-2) [     ] o.e.j.s.Server Started @92027ms
   [junit4]   2> 91933 INFO  (jetty-launcher-482-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=59967}
   [junit4]   2> 91933 ERROR (jetty-launcher-482-thread-2) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 91933 INFO  (jetty-launcher-482-thread-2) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 91933 INFO  (jetty-launcher-482-thread-2) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.7.0
   [junit4]   2> 91933 INFO  (jetty-launcher-482-thread-2) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 91933 INFO  (jetty-launcher-482-thread-2) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr
   [junit4]   2> 91933 INFO  (jetty-launcher-482-thread-2) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2020-07-17T05:01:33.253Z
   [junit4]   2> 91933 INFO  (jetty-launcher-482-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@6c9c08{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:59968}
   [junit4]   2> 91933 INFO  (jetty-launcher-482-thread-1) [     ] o.e.j.s.Server Started @92027ms
   [junit4]   2> 91933 INFO  (jetty-launcher-482-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=59968}
   [junit4]   2> 91933 INFO  (jetty-launcher-482-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 91933 ERROR (jetty-launcher-482-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 91933 INFO  (jetty-launcher-482-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 91933 INFO  (jetty-launcher-482-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.7.0
   [junit4]   2> 91937 INFO  (jetty-launcher-482-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 91937 INFO  (jetty-launcher-482-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr
   [junit4]   2> 91937 INFO  (jetty-launcher-482-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2020-07-17T05:01:33.257Z
   [junit4]   2> 91938 INFO  (jetty-launcher-482-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 91941 INFO  (zkConnectionManagerCallback-484-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 91941 INFO  (jetty-launcher-482-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 91944 INFO  (zkConnectionManagerCallback-486-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 91944 INFO  (jetty-launcher-482-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 91945 INFO  (jetty-launcher-482-thread-1) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 91947 INFO  (jetty-launcher-482-thread-2) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 91968 WARN  (jetty-launcher-482-thread-1-SendThread(127.0.0.1:59962)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100d1ccb7b50004.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x100d1ccb7b50004, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100d1ccb7b50004, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:348) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1262) [zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 92133 INFO  (jetty-launcher-482-thread-2) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 92135 WARN  (jetty-launcher-482-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@14846647[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 92135 WARN  (jetty-launcher-482-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@14846647[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 92141 WARN  (jetty-launcher-482-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@6e07d270[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 92141 WARN  (jetty-launcher-482-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@6e07d270[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 92141 INFO  (jetty-launcher-482-thread-2) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59962/solr
   [junit4]   2> 92153 INFO  (jetty-launcher-482-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 92157 INFO  (zkConnectionManagerCallback-496-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 92158 INFO  (jetty-launcher-482-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 92289 INFO  (jetty-launcher-482-thread-2) [n:127.0.0.1:59967_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 92294 INFO  (zkConnectionManagerCallback-501-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 92294 INFO  (jetty-launcher-482-thread-2) [n:127.0.0.1:59967_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 92311 INFO  (jetty-launcher-482-thread-1) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 92313 WARN  (jetty-launcher-482-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@1144f074[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 92314 WARN  (jetty-launcher-482-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@1144f074[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 92342 WARN  (jetty-launcher-482-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3c7b22d6[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 92343 WARN  (jetty-launcher-482-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3c7b22d6[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 92349 INFO  (jetty-launcher-482-thread-1) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59962/solr
   [junit4]   2> 92355 INFO  (jetty-launcher-482-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 92357 INFO  (zkConnectionManagerCallback-510-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 92358 INFO  (jetty-launcher-482-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 92381 WARN  (jetty-launcher-482-thread-1-SendThread(127.0.0.1:59962)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100d1ccb7b50007.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x100d1ccb7b50007, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100d1ccb7b50007, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:348) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1262) [zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 92493 INFO  (jetty-launcher-482-thread-1) [n:127.0.0.1:59968_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 92501 INFO  (zkConnectionManagerCallback-512-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 92503 INFO  (jetty-launcher-482-thread-1) [n:127.0.0.1:59968_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 92701 INFO  (jetty-launcher-482-thread-1) [n:127.0.0.1:59968_solr     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:59968_solr
   [junit4]   2> 92712 INFO  (jetty-launcher-482-thread-1) [n:127.0.0.1:59968_solr     ] o.a.s.c.Overseer Overseer (id=72288271223554056-127.0.0.1:59968_solr-n_0000000000) starting
   [junit4]   2> 92833 INFO  (OverseerStateUpdate-72288271223554056-127.0.0.1:59968_solr-n_0000000000) [n:127.0.0.1:59968_solr     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:59968_solr
   [junit4]   2> 92837 INFO  (jetty-launcher-482-thread-1) [n:127.0.0.1:59968_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59968_solr
   [junit4]   2> 92859 INFO  (zkCallback-511-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 92881 INFO  (jetty-launcher-482-thread-1) [n:127.0.0.1:59968_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 92884 WARN  (jetty-launcher-482-thread-1) [n:127.0.0.1:59968_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 93061 INFO  (jetty-launcher-482-thread-1) [n:127.0.0.1:59968_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 93176 INFO  (jetty-launcher-482-thread-1) [n:127.0.0.1:59968_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59968.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65f4ce94
   [junit4]   2> 93187 INFO  (jetty-launcher-482-thread-1) [n:127.0.0.1:59968_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59968.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65f4ce94
   [junit4]   2> 93187 INFO  (jetty-launcher-482-thread-1) [n:127.0.0.1:59968_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59968.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65f4ce94
   [junit4]   2> 93189 INFO  (jetty-launcher-482-thread-1) [n:127.0.0.1:59968_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.DocValuesNotIndexedTest_2A6148CFC96672D7-001/tempDir-001/node1
   [junit4]   2> 93338 INFO  (jetty-launcher-482-thread-2) [n:127.0.0.1:59967_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 93395 INFO  (jetty-launcher-482-thread-2) [n:127.0.0.1:59967_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:59967_solr as DOWN
   [junit4]   2> 93403 INFO  (jetty-launcher-482-thread-2) [n:127.0.0.1:59967_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 93403 INFO  (jetty-launcher-482-thread-2) [n:127.0.0.1:59967_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59967_solr
   [junit4]   2> 93405 INFO  (zkCallback-511-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 93405 INFO  (zkCallback-500-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 93413 INFO  (jetty-launcher-482-thread-2) [n:127.0.0.1:59967_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 93413 WARN  (jetty-launcher-482-thread-2) [n:127.0.0.1:59967_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 93463 INFO  (jetty-launcher-482-thread-2) [n:127.0.0.1:59967_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 93502 INFO  (jetty-launcher-482-thread-2) [n:127.0.0.1:59967_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59967.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65f4ce94
   [junit4]   2> 93511 INFO  (jetty-launcher-482-thread-2) [n:127.0.0.1:59967_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59967.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65f4ce94
   [junit4]   2> 93512 INFO  (jetty-launcher-482-thread-2) [n:127.0.0.1:59967_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59967.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65f4ce94
   [junit4]   2> 93513 INFO  (jetty-launcher-482-thread-2) [n:127.0.0.1:59967_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.DocValuesNotIndexedTest_2A6148CFC96672D7-001/tempDir-001/node2
   [junit4]   2> 93552 INFO  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker) [     ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=2
   [junit4]   2> 93553 INFO  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 93558 INFO  (zkConnectionManagerCallback-535-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 93558 INFO  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 93562 INFO  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 93567 INFO  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:59962/solr ready
   [junit4]   2> 93579 INFO  (qtp1508325341-708) [n:127.0.0.1:59967_solr     ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&maxShardsPerNode=2&name=dv_coll&nrtReplicas=1&action=CREATE&numShards=4&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 93589 INFO  (OverseerThreadFactory-519-thread-1-processing-n:127.0.0.1:59968_solr) [n:127.0.0.1:59968_solr     ] o.a.s.c.a.c.CreateCollectionCmd Create collection dv_coll
   [junit4]   2> 93718 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
   [junit4]   2> 93722 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 93722 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
   [junit4]   2> 93769 INFO  (OverseerStateUpdate-72288271223554056-127.0.0.1:59968_solr-n_0000000000) [n:127.0.0.1:59968_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"dv_coll",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"dv_coll_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:59968/solr",
   [junit4]   2>   "node_name":"127.0.0.1:59968_solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 93779 INFO  (OverseerStateUpdate-72288271223554056-127.0.0.1:59968_solr-n_0000000000) [n:127.0.0.1:59968_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"dv_coll",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"dv_coll_shard2_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:59967/solr",
   [junit4]   2>   "node_name":"127.0.0.1:59967_solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 93787 INFO  (OverseerStateUpdate-72288271223554056-127.0.0.1:59968_solr-n_0000000000) [n:127.0.0.1:59968_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"dv_coll",
   [junit4]   2>   "shard":"shard3",
   [junit4]   2>   "core":"dv_coll_shard3_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:59967/solr",
   [junit4]   2>   "node_name":"127.0.0.1:59967_solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 93799 INFO  (OverseerStateUpdate-72288271223554056-127.0.0.1:59968_solr-n_0000000000) [n:127.0.0.1:59968_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"dv_coll",
   [junit4]   2>   "shard":"shard4",
   [junit4]   2>   "core":"dv_coll_shard4_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:59968/solr",
   [junit4]   2>   "node_name":"127.0.0.1:59968_solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 94031 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr    x:dv_coll_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&newCollection=true&name=dv_coll_shard1_replica_n1&action=CREATE&numShards=4&collection=dv_coll&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 94032 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr    x:dv_coll_shard4_replica_n6 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf1&newCollection=true&name=dv_coll_shard4_replica_n6&action=CREATE&numShards=4&collection=dv_coll&shard=shard4&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 94045 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr    x:dv_coll_shard2_replica_n2 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf1&newCollection=true&name=dv_coll_shard2_replica_n2&action=CREATE&numShards=4&collection=dv_coll&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 94045 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr    x:dv_coll_shard3_replica_n4 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf1&newCollection=true&name=dv_coll_shard3_replica_n4&action=CREATE&numShards=4&collection=dv_coll&shard=shard3&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 94095 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.7.0
   [junit4]   2> 94095 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.7.0
   [junit4]   2> 94095 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.7.0
   [junit4]   2> 94116 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6 ] o.a.s.c.CoreContainer Creating SolrCore 'dv_coll_shard4_replica_n6' using configuration from configset conf1, trusted=true
   [junit4]   2> 94125 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'dv_coll_shard1_replica_n1' using configuration from configset conf1, trusted=true
   [junit4]   2> 94127 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4 ] o.a.s.c.CoreContainer Creating SolrCore 'dv_coll_shard3_replica_n4' using configuration from configset conf1, trusted=true
   [junit4]   2> 94131 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.7.0
   [junit4]   2> 94141 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2 ] o.a.s.c.CoreContainer Creating SolrCore 'dv_coll_shard2_replica_n2' using configuration from configset conf1, trusted=true
   [junit4]   2> 94141 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 94147 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 94148 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 94160 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 94162 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 94163 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59968.solr.core.dv_coll.shard1.replica_n1' (registry 'solr.core.dv_coll.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65f4ce94
   [junit4]   2> 94165 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.c.SolrCore [[dv_coll_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.DocValuesNotIndexedTest_2A6148CFC96672D7-001/tempDir-001/node1/dv_coll_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.DocValuesNotIndexedTest_2A6148CFC96672D7-001/tempDir-001/node1/dv_coll_shard1_replica_n1/data/]
   [junit4]   2> 94165 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 94165 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 94165 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59967.solr.core.dv_coll.shard2.replica_n2' (registry 'solr.core.dv_coll.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65f4ce94
   [junit4]   2> 94165 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2 ] o.a.s.c.SolrCore [[dv_coll_shard2_replica_n2] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.DocValuesNotIndexedTest_2A6148CFC96672D7-001/tempDir-001/node2/dv_coll_shard2_replica_n2], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.DocValuesNotIndexedTest_2A6148CFC96672D7-001/tempDir-001/node2/dv_coll_shard2_replica_n2/data/]
   [junit4]   2> 94165 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59967.solr.core.dv_coll.shard3.replica_n4' (registry 'solr.core.dv_coll.shard3.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65f4ce94
   [junit4]   2> 94166 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4 ] o.a.s.c.SolrCore [[dv_coll_shard3_replica_n4] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.DocValuesNotIndexedTest_2A6148CFC96672D7-001/tempDir-001/node2/dv_coll_shard3_replica_n4], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.DocValuesNotIndexedTest_2A6148CFC96672D7-001/tempDir-001/node2/dv_coll_shard3_replica_n4/data/]
   [junit4]   2> 94167 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 94167 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59968.solr.core.dv_coll.shard4.replica_n6' (registry 'solr.core.dv_coll.shard4.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@65f4ce94
   [junit4]   2> 94168 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6 ] o.a.s.c.SolrCore [[dv_coll_shard4_replica_n6] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.DocValuesNotIndexedTest_2A6148CFC96672D7-001/tempDir-001/node1/dv_coll_shard4_replica_n6], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.DocValuesNotIndexedTest_2A6148CFC96672D7-001/tempDir-001/node1/dv_coll_shard4_replica_n6/data/]
   [junit4]   2> 94653 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 94653 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 94714 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 94716 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 94808 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 94814 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 94814 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema
   [junit4]   2> 94820 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 94821 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 94821 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1672438974923145216
   [junit4]   2> 94830 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 94830 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 94833 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 94833 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 94880 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 94891 INFO  (searcherExecutor-543-thread-1-processing-n:127.0.0.1:59967_solr x:dv_coll_shard2_replica_n2 c:dv_coll s:shard2 r:core_node5) [n:127.0.0.1:59967_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2 ] o.a.s.c.SolrCore [dv_coll_shard2_replica_n2]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 94892 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 94892 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 94894 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 94894 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 94897 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 94897 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4 ] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema
   [junit4]   2> 94910 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 94910 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 94913 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 94913 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 94913 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1672438975019614208
   [junit4]   2> 94914 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 94914 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 94921 INFO  (searcherExecutor-541-thread-1-processing-n:127.0.0.1:59967_solr x:dv_coll_shard3_replica_n4 c:dv_coll s:shard3 r:core_node7) [n:127.0.0.1:59967_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4 ] o.a.s.c.SolrCore [dv_coll_shard3_replica_n4]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 94922 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 94949 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 94950 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 94950 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema
   [junit4]   2> 94953 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 94953 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6 ] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema
   [junit4]   2> 94962 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 94962 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 94962 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1672438975070994432
   [junit4]   2> 94977 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 94978 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 94978 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1672438975087771648
   [junit4]   2> 95000 INFO  (searcherExecutor-539-thread-1-processing-n:127.0.0.1:59968_solr x:dv_coll_shard1_replica_n1 c:dv_coll s:shard1 r:core_node3) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.c.SolrCore [dv_coll_shard1_replica_n1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 95016 INFO  (searcherExecutor-537-thread-1-processing-n:127.0.0.1:59968_solr x:dv_coll_shard4_replica_n6 c:dv_coll s:shard4 r:core_node8) [n:127.0.0.1:59968_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6 ] o.a.s.c.SolrCore [dv_coll_shard4_replica_n6]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 95047 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/dv_coll/terms/shard3 to Terms{values={core_node7=0}, version=0}
   [junit4]   2> 95047 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/dv_coll/leaders/shard3
   [junit4]   2> 95380 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/dv_coll/terms/shard2 to Terms{values={core_node5=0}, version=0}
   [junit4]   2> 95386 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/dv_coll/terms/shard1 to Terms{values={core_node3=0}, version=0}
   [junit4]   2> 95386 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/dv_coll/leaders/shard1
   [junit4]   2> 95397 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/dv_coll/leaders/shard2
   [junit4]   2> 95635 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 95635 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 95635 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:59967/solr/dv_coll_shard3_replica_n4/
   [junit4]   2> 95640 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 95667 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4 ] o.a.s.c.SyncStrategy http://127.0.0.1:59967/solr/dv_coll_shard3_replica_n4/ has no replicas
   [junit4]   2> 95668 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/dv_coll/leaders/shard3/leader after winning as /collections/dv_coll/leader_elect/shard3/election/72288271223554054-core_node7-n_0000000000
   [junit4]   2> 95671 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/dv_coll/terms/shard4 to Terms{values={core_node8=0}, version=0}
   [junit4]   2> 95681 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/dv_coll/leaders/shard4
   [junit4]   2> 95751 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:59967/solr/dv_coll_shard3_replica_n4/ shard3
   [junit4]   2> 95785 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 95785 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 95785 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:59967/solr/dv_coll_shard2_replica_n2/
   [junit4]   2> 95787 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 95787 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 95787 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 95787 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:59968/solr/dv_coll_shard1_replica_n1/
   [junit4]   2> 95801 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 95807 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2 ] o.a.s.c.SyncStrategy http://127.0.0.1:59967/solr/dv_coll_shard2_replica_n2/ has no replicas
   [junit4]   2> 95807 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/dv_coll/leaders/shard2/leader after winning as /collections/dv_coll/leader_elect/shard2/election/72288271223554054-core_node5-n_0000000000
   [junit4]   2> 95852 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.c.SyncStrategy http://127.0.0.1:59968/solr/dv_coll_shard1_replica_n1/ has no replicas
   [junit4]   2> 95852 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/dv_coll/leaders/shard1/leader after winning as /collections/dv_coll/leader_elect/shard1/election/72288271223554056-core_node3-n_0000000000
   [junit4]   2> 95941 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:59967/solr/dv_coll_shard2_replica_n2/ shard2
   [junit4]   2> 95968 INFO  (zkCallback-500-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/dv_coll/state.json] for collection [dv_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 95969 INFO  (zkCallback-500-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/dv_coll/state.json] for collection [dv_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 95975 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4 ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 95998 INFO  (qtp1508325341-706) [n:127.0.0.1:59967_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf1&newCollection=true&name=dv_coll_shard3_replica_n4&action=CREATE&numShards=4&collection=dv_coll&shard=shard3&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1953
   [junit4]   2> 96019 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 96019 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 96019 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:59968/solr/dv_coll_shard4_replica_n6/
   [junit4]   2> 96039 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 96039 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:59968/solr/dv_coll_shard1_replica_n1/ shard1
   [junit4]   2> 96042 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6 ] o.a.s.c.SyncStrategy http://127.0.0.1:59968/solr/dv_coll_shard4_replica_n6/ has no replicas
   [junit4]   2> 96043 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/dv_coll/leaders/shard4/leader after winning as /collections/dv_coll/leader_elect/shard4/election/72288271223554056-core_node8-n_0000000000
   [junit4]   2> 96074 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:59968/solr/dv_coll_shard4_replica_n6/ shard4
   [junit4]   2> 96224 INFO  (zkCallback-511-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/dv_coll/state.json] for collection [dv_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 96225 INFO  (zkCallback-500-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/dv_coll/state.json] for collection [dv_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 96226 INFO  (zkCallback-500-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/dv_coll/state.json] for collection [dv_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 96244 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2 ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 96258 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 96272 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6 ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 96279 INFO  (qtp1508325341-703) [n:127.0.0.1:59967_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf1&newCollection=true&name=dv_coll_shard2_replica_n2&action=CREATE&numShards=4&collection=dv_coll&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2234
   [junit4]   2> 96330 INFO  (qtp246113197-698) [n:127.0.0.1:59968_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&newCollection=true&name=dv_coll_shard1_replica_n1&action=CREATE&numShards=4&collection=dv_coll&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2303
   [junit4]   2> 96354 INFO  (qtp246113197-699) [n:127.0.0.1:59968_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf1&newCollection=true&name=dv_coll_shard4_replica_n6&action=CREATE&numShards=4&collection=dv_coll&shard=shard4&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2326
   [junit4]   2> 96376 INFO  (qtp1508325341-708) [n:127.0.0.1:59967_solr     ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
   [junit4]   2> 96448 INFO  (zkCallback-511-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/dv_coll/state.json] for collection [dv_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 96448 INFO  (zkCallback-500-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/dv_coll/state.json] for collection [dv_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 96449 INFO  (zkCallback-500-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/dv_coll/state.json] for collection [dv_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 96448 INFO  (zkCallback-511-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/dv_coll/state.json] for collection [dv_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 96454 INFO  (qtp1508325341-708) [n:127.0.0.1:59967_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&maxShardsPerNode=2&name=dv_coll&nrtReplicas=1&action=CREATE&numShards=4&wt=javabin&version=2} status=0 QTime=2874
   [junit4]   2> 96455 INFO  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker) [     ] o.a.s.c.MiniSolrCloudCluster waitForActiveCollection: dv_coll
   [junit4]   2> 96608 INFO  (qtp246113197-701) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.s.SchemaManager managed schema loaded . version : 0 
   [junit4]   2> 96622 INFO  (qtp246113197-701) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 96776 INFO  (qtp246113197-701) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 96965 INFO  (zkCallback-500-thread-2) [     ] o.a.s.s.ZkIndexSchemaReader A schema change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/configs/conf1/managed-schema, has occurred - updating schema from ZooKeeper ...
   [junit4]   2> 96965 INFO  (qtp246113197-701) [n:127.0.0.1:59968_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1 ] o.a.s.c.ZkController Persisted config data to node /configs/conf1/managed-schema 
   [junit4]   2> 96970 INFO  (zkCallback-500-thread-1) [     ] o.a.s.s.ZkIndexSchemaReader A schema change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/configs/conf1/managed-schema, has occurred - updating schema from ZooKeeper ...
   [junit4]   2> 96976 INFO  (zkCallback-511-thread-1) [     ] o.a.s.s.ZkIndexSchemaReader A schema change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/configs/conf1/managed-schema, has occurred - updating schema from ZooKeeper ...
   [junit4]   2> 96982 INFO  (zkCallback-511-thread-2) [     ] o.a.s.s.ZkIndexSchemaReader A schema change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/configs/conf1/managed-schema, has occurred - updating schema from ZooKeeper ...
   [junit4]   2> 97007 INFO  (zkCallback-511-thread-

[...truncated too long message...]

jetty-closer-584-thread-1) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@141cd69a: rootName = solr_59968, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@5f91487a
   [junit4]   2> 110040 INFO  (jetty-closer-584-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
   [junit4]   2> 110041 INFO  (closeThreadPool-596-thread-2) [     ] o.a.s.c.Overseer Overseer (id=72288271223554056-127.0.0.1:59968_solr-n_0000000000) closing
   [junit4]   2> 110042 INFO  (OverseerStateUpdate-72288271223554056-127.0.0.1:59968_solr-n_0000000000) [n:127.0.0.1:59968_solr     ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:59968_solr
   [junit4]   2> 110048 INFO  (OverseerAutoScalingTriggerThread-72288271223554056-127.0.0.1:59968_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 110048 INFO  (closeThreadPool-596-thread-1) [     ] o.a.s.c.Overseer Overseer (id=72288271223554056-127.0.0.1:59968_solr-n_0000000000) closing
   [junit4]   2> 110057 WARN  (jetty-launcher-482-thread-1-SendThread(127.0.0.1:59962)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100d1ccb7b50008.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x100d1ccb7b50008, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100d1ccb7b50008, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:348) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1262) [zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 110130 INFO  (jetty-closer-584-thread-2) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@5720c291{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
   [junit4]   2> 110131 INFO  (jetty-closer-584-thread-2) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1ea5ec37{/solr,null,UNAVAILABLE}
   [junit4]   2> 110132 INFO  (jetty-closer-584-thread-2) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 110219 INFO  (jetty-closer-584-thread-1) [     ] o.a.s.c.Overseer Overseer (id=72288271223554056-127.0.0.1:59968_solr-n_0000000000) closing
   [junit4]   2> 110223 INFO  (jetty-closer-584-thread-1) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@6c9c08{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
   [junit4]   2> 110226 INFO  (jetty-closer-584-thread-1) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@13b4f28f{/solr,null,UNAVAILABLE}
   [junit4]   2> 110229 INFO  (jetty-closer-584-thread-1) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 110231 INFO  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker) [     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 110826 WARN  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker-SendThread(127.0.0.1:59962)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100d1ccb7b50001.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x100d1ccb7b50001, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100d1ccb7b50001, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:348) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1262) [zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 110937 WARN  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	8	/solr/configs/conf1/managed-schema
   [junit4]   2> 	4	/solr/configs/conf1
   [junit4]   2> 	3	/solr/clusterprops.json
   [junit4]   2> 	3	/solr/aliases.json
   [junit4]   2> 	3	/solr/collections/dv_coll/terms/shard3
   [junit4]   2> 	3	/solr/collections/dv_coll/terms/shard2
   [junit4]   2> 	3	/solr/collections/dv_coll/terms/shard1
   [junit4]   2> 	3	/solr/collections/dv_coll/terms/shard4
   [junit4]   2> 	2	/solr/packages.json
   [junit4]   2> 	2	/solr/security.json
   [junit4]   2> 	2	/solr/collections/dv_coll/collectionprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	26	/solr/collections/dv_coll/state.json
   [junit4]   2> 	4	/solr/configs/conf1/managed-schema
   [junit4]   2> 	3	/solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	23	/solr/overseer/queue
   [junit4]   2> 	7	/solr/live_nodes
   [junit4]   2> 	6	/solr/collections
   [junit4]   2> 	4	/solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> 110945 INFO  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker) [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:59962
   [junit4]   2> 110945 INFO  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:59962
   [junit4]   2> 110945 INFO  (SUITE-DocValuesNotIndexedTest-seed#[2A6148CFC96672D7]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 59962
   [junit4]   2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.DocValuesNotIndexedTest_2A6148CFC96672D7-001
   [junit4]   2> Jul 17, 2020 5:01:52 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene86): {_root_=PostingsFormat(name=LuceneFixedGap), id=BlockTreeOrds(blocksize=128)}, docValues:{floatField=DocValuesFormat(name=Lucene80), doubleField=DocValuesFormat(name=Asserting), intFieldMulti=DocValuesFormat(name=Lucene80), sortableGSL=DocValuesFormat(name=Lucene80), boolFieldMulti=DocValuesFormat(name=Asserting), floatGSL=DocValuesFormat(name=Lucene80), longFieldMulti=DocValuesFormat(name=Direct), sortableGSF=DocValuesFormat(name=Lucene80), intField=DocValuesFormat(name=Asserting), boolField=DocValuesFormat(name=Lucene80), sortableFieldMulti=DocValuesFormat(name=Direct), stringFieldMulti=DocValuesFormat(name=Lucene80), dateFieldMulti=DocValuesFormat(name=Direct), doubleFieldMulti=DocValuesFormat(name=Lucene80), longGSF=DocValuesFormat(name=Lucene80), stringGSL=DocValuesFormat(name=Direct), doubleGSF=DocValuesFormat(name=Asserting), doubleGSL=DocValuesFormat(name=Direct), stringGSF=DocValuesFormat(name=Asserting), intGSL=DocValuesFormat(name=Asserting), sortableText=DocValuesFormat(name=Direct), longField=DocValuesFormat(name=Lucene80), dateField=DocValuesFormat(name=Lucene80), dateGSF=DocValuesFormat(name=Lucene80), boolGSF=DocValuesFormat(name=Lucene80), longGSL=DocValuesFormat(name=Lucene80), boolGSL=DocValuesFormat(name=Lucene80), floatFieldMulti=DocValuesFormat(name=Asserting), floatGSF=DocValuesFormat(name=Lucene80), dateGSL=DocValuesFormat(name=Lucene80), intGSF=DocValuesFormat(name=Direct), stringField=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=592, maxMBSortInHeap=7.340656510431603, sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=ja, timezone=Asia/Hebron
   [junit4]   2> NOTE: Mac OS X 10.14.6 x86_64/Oracle Corporation 1.8.0_201 (64-bit)/cpus=6,threads=1,free=127416328,total=194707456
   [junit4]   2> NOTE: All tests run in this JVM: [TestNonDefinedSimilarityFactory, TestConfigReload, SimpleCollectionCreateDeleteTest, UUIDUpdateProcessorFallbackTest, TestSchemaSimilarityResource, TestIndexingPerformance, RuleEngineTest, DocValuesNotIndexedTest]
   [junit4] Completed [29/915 (1!)] on J3 in 19.68s, 5 tests, 1 failure <<< FAILURES!

[...truncated 55134 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-MacOSX/1267/consoleText

[repro] Revision: 7a7ce5582c9eed56590ea088e48721af803db0c5

[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC"
[repro] Repro line:  ant test  -Dtestcase=DocValuesNotIndexedTest -Dtests.method=testGroupingDVOnlySortLast -Dtests.seed=2A6148CFC96672D7 -Dtests.slow=true -Dtests.locale=ja -Dtests.timezone=Asia/Hebron -Dtests.asserts=true -Dtests.file.encoding=US-ASCII

[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       DocValuesNotIndexedTest
[repro] ant compile-test

[...truncated 3467 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.DocValuesNotIndexedTest" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseSerialGC" -Dtests.seed=2A6148CFC96672D7 -Dtests.slow=true -Dtests.locale=ja -Dtests.timezone=Asia/Hebron -Dtests.asserts=true -Dtests.file.encoding=US-ASCII

[...truncated 96 lines...]
[repro] Failures w/original seeds:
[repro]   0/5 failed: org.apache.solr.cloud.DocValuesNotIndexedTest
[repro] Exiting with code 0

[...truncated 91 lines...]

[JENKINS] Lucene-Solr-8.x-MacOSX (64bit/jdk-13.0.2) - Build # 1266 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-MacOSX/1266/
Java: 64bit/jdk-13.0.2 -XX:+UseCompressedOops -XX:+UseG1GC

5 tests failed.
FAILED:  org.apache.solr.cloud.HttpPartitionOnCommitTest.test

Error Message:
Error from server at http://127.0.0.1:63567/bw_hb/d: Underlying core creation failed while creating collection: c8n_1x3_commits

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:63567/bw_hb/d: Underlying core creation failed while creating collection: c8n_1x3_commits
	at __randomizedtesting.SeedInfo.seed([4679BD3D342E99F1:CE2D82E79AD2F409]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:681)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:266)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1290)
	at org.apache.solr.cloud.BasicDistributedZkTest.createCollection(BasicDistributedZkTest.java:810)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1766)
	at org.apache.solr.cloud.HttpPartitionOnCommitTest.oneShardTest(HttpPartitionOnCommitTest.java:125)
	at org.apache.solr.cloud.HttpPartitionOnCommitTest.test(HttpPartitionOnCommitTest.java:66)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:567)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1090)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1061)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:830)


FAILED:  org.apache.solr.cloud.HttpPartitionOnCommitTest.test

Error Message:
Error from server at http://127.0.0.1:59365/bw_hb/d: Underlying core creation failed while creating collection: c8n_1x3_commits

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:59365/bw_hb/d: Underlying core creation failed while creating collection: c8n_1x3_commits
	at __randomizedtesting.SeedInfo.seed([4679BD3D342E99F1:CE2D82E79AD2F409]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:681)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:266)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1290)
	at org.apache.solr.cloud.BasicDistributedZkTest.createCollection(BasicDistributedZkTest.java:810)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1766)
	at org.apache.solr.cloud.HttpPartitionOnCommitTest.oneShardTest(HttpPartitionOnCommitTest.java:125)
	at org.apache.solr.cloud.HttpPartitionOnCommitTest.test(HttpPartitionOnCommitTest.java:66)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:567)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1090)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1061)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:830)


FAILED:  org.apache.solr.cloud.MultiThreadedOCPTest.test

Error Message:
acoll: 1594942298752 bcoll: 1594942298920

Stack Trace:
java.lang.AssertionError: acoll: 1594942298752 bcoll: 1594942298920
	at __randomizedtesting.SeedInfo.seed([4679BD3D342E99F1:CE2D82E79AD2F409]:0)
	at org.junit.Assert.fail(Assert.java:88)
	at org.junit.Assert.assertTrue(Assert.java:41)
	at org.apache.solr.cloud.MultiThreadedOCPTest.testFillWorkQueue(MultiThreadedOCPTest.java:113)
	at org.apache.solr.cloud.MultiThreadedOCPTest.test(MultiThreadedOCPTest.java:68)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:567)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1090)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1061)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:830)


FAILED:  org.apache.solr.cloud.api.collections.TestCollectionAPI.testRecreateCollectionAfterFailure

Error Message:
Error from server at http://127.0.0.1:49414: Underlying core creation failed while creating collection: testcollection

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:49414: Underlying core creation failed while creating collection: testcollection
	at __randomizedtesting.SeedInfo.seed([4679BD3D342E99F1:714BE5D62E4DD206]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:681)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:266)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
	at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:389)
	at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:359)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1157)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:918)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:850)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:214)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:231)
	at org.apache.solr.cloud.api.collections.TestCollectionAPI.testRecreateCollectionAfterFailure(TestCollectionAPI.java:1134)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:567)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1090)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1061)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:830)


FAILED:  junit.framework.TestSuite.org.apache.solr.schema.SchemaApiFailureTest

Error Message:
ObjectTracker found 3 object(s) that were not released!!! [MockDirectoryWrapper, MockDirectoryWrapper, MockDirectoryWrapper] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)  at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:404)  at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:780)  at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1007)  at org.apache.solr.core.SolrCore.<init>(SolrCore.java:920)  at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1388)  at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1274)  at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:95)  at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367)  at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)  at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)  at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214)  at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:854)  at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:818)  at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)  at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)  at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)  at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)  at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)  at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)  at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)  at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)  at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)  at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)  at org.eclipse.jetty.server.Server.handle(Server.java:500)  at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)  at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)  at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)  at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335)  at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)  at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)  at java.base/java.lang.Thread.run(Thread.java:830)  org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)  at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:552)  at org.apache.solr.core.SolrCore.<init>(SolrCore.java:999)  at org.apache.solr.core.SolrCore.<init>(SolrCore.java:920)  at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1388)  at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1274)  at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:95)  at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367)  at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)  at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)  at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214)  at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:854)  at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:818)  at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)  at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)  at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)  at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)  at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)  at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)  at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)  at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)  at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)  at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)  at org.eclipse.jetty.server.Server.handle(Server.java:500)  at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)  at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)  at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)  at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335)  at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)  at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)  at java.base/java.lang.Thread.run(Thread.java:830)  org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)  at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:98)  at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:812)  at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1007)  at org.apache.solr.core.SolrCore.<init>(SolrCore.java:920)  at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1388)  at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1274)  at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:95)  at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367)  at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)  at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)  at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214)  at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:854)  at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:818)  at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)  at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)  at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)  at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)  at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)  at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)  at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)  at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)  at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)  at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)  at org.eclipse.jetty.server.Server.handle(Server.java:500)  at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)  at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)  at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)  at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335)  at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)  at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)  at java.base/java.lang.Thread.run(Thread.java:830)   expected null, but was:<ObjectTracker found 3 object(s) that were not released!!! [MockDirectoryWrapper, MockDirectoryWrapper, MockDirectoryWrapper] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)  at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:404)  at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:780)  at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1007)  at org.apache.solr.core.SolrCore.<init>(SolrCore.java:920)  at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1388)  at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1274)  at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:95)  at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367)  at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)  at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)  at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214)  at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:854)  at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:818)  at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)  at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)  at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)  at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)  at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)  at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)  at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)  at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)  at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)  at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)  at org.eclipse.jetty.server.Server.handle(Server.java:500)  at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)  at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)  at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)  at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335)  at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)  at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)  at java.base/java.lang.Thread.run(Thread.java:830)  org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)  at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:552)  at org.apache.solr.core.SolrCore.<init>(SolrCore.java:999)  at org.apache.solr.core.SolrCore.<init>(SolrCore.java:920)  at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1388)  at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1274)  at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:95)  at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367)  at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)  at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)  at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214)  at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:854)  at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:818)  at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)  at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)  at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)  at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)  at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)  at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)  at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)  at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)  at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)  at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)  at org.eclipse.jetty.server.Server.handle(Server.java:500)  at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)  at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)  at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)  at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335)  at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)  at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)  at java.base/java.lang.Thread.run(Thread.java:830)  org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)  at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:98)  at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:812)  at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1007)  at org.apache.solr.core.SolrCore.<init>(SolrCore.java:920)  at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1388)  at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1274)  at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:95)  at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367)  at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)  at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)  at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214)  at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:854)  at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:818)  at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)  at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)  at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)  at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)  at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)  at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)  at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)  at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)  at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)  at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)  at org.eclipse.jetty.server.Server.handle(Server.java:500)  at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)  at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)  at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)  at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335)  at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)  at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)  at java.base/java.lang.Thread.run(Thread.java:830)  >

Stack Trace:
java.lang.AssertionError: ObjectTracker found 3 object(s) that were not released!!! [MockDirectoryWrapper, MockDirectoryWrapper, MockDirectoryWrapper]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)
	at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:404)
	at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:780)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1007)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:920)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1388)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1274)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:95)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)
	at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214)
	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:854)
	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:818)
	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.server.Server.handle(Server.java:500)
	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)
	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
	at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)
	at java.base/java.lang.Thread.run(Thread.java:830)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)
	at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:552)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:999)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:920)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1388)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1274)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:95)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)
	at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214)
	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:854)
	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:818)
	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.server.Server.handle(Server.java:500)
	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)
	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
	at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)
	at java.base/java.lang.Thread.run(Thread.java:830)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)
	at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:98)
	at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:812)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1007)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:920)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1388)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1274)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:95)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)
	at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214)
	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:854)
	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:818)
	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.server.Server.handle(Server.java:500)
	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)
	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
	at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)
	at java.base/java.lang.Thread.run(Thread.java:830)

 expected null, but was:<ObjectTracker found 3 object(s) that were not released!!! [MockDirectoryWrapper, MockDirectoryWrapper, MockDirectoryWrapper]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)
	at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:404)
	at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:780)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1007)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:920)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1388)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1274)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:95)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)
	at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214)
	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:854)
	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:818)
	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.server.Server.handle(Server.java:500)
	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)
	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
	at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)
	at java.base/java.lang.Thread.run(Thread.java:830)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)
	at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:552)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:999)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:920)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1388)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1274)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:95)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)
	at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214)
	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:854)
	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:818)
	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.server.Server.handle(Server.java:500)
	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)
	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
	at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)
	at java.base/java.lang.Thread.run(Thread.java:830)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)
	at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:98)
	at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:812)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1007)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:920)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1388)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1274)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:95)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)
	at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214)
	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:854)
	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:818)
	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.server.Server.handle(Server.java:500)
	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)
	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
	at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)
	at java.base/java.lang.Thread.run(Thread.java:830)

>
	at __randomizedtesting.SeedInfo.seed([4679BD3D342E99F1]:0)
	at org.junit.Assert.fail(Assert.java:88)
	at org.junit.Assert.failNotNull(Assert.java:755)
	at org.junit.Assert.assertNull(Assert.java:737)
	at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:327)
	at jdk.internal.reflect.GeneratedMethodAccessor35.invoke(Unknown Source)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:567)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:901)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:830)




Build Log:
[...truncated 14434 lines...]
   [junit4] Suite: org.apache.solr.cloud.MultiThreadedOCPTest
   [junit4]   2> 768646 INFO  (SUITE-MultiThreadedOCPTest-seed#[4679BD3D342E99F1]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 768646 INFO  (SUITE-MultiThreadedOCPTest-seed#[4679BD3D342E99F1]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 768646 INFO  (SUITE-MultiThreadedOCPTest-seed#[4679BD3D342E99F1]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_4679BD3D342E99F1-001/data-dir-47-001
   [junit4]   2> 768646 WARN  (SUITE-MultiThreadedOCPTest-seed#[4679BD3D342E99F1]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=71 numCloses=71
   [junit4]   2> 768646 INFO  (SUITE-MultiThreadedOCPTest-seed#[4679BD3D342E99F1]-worker) [     ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 768648 INFO  (SUITE-MultiThreadedOCPTest-seed#[4679BD3D342E99F1]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
   [junit4]   2> 768648 INFO  (SUITE-MultiThreadedOCPTest-seed#[4679BD3D342E99F1]-worker) [     ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 768667 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 768668 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
   [junit4]   2> 768668 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 768672 WARN  (ZkTestServer Run Thread) [     ] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0.
   [junit4]   2> 768769 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.ZkTestServer start zk server on port: 58262
   [junit4]   2> 768769 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:58262
   [junit4]   2> 768769 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:58262
   [junit4]   2> 768769 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 58262
   [junit4]   2> 768775 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 768784 INFO  (zkConnectionManagerCallback-5204-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 768784 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 768795 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 768800 INFO  (zkConnectionManagerCallback-5206-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 768800 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 768805 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 768810 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 768818 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 768824 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 768839 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 768849 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 768853 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 768865 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 768870 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 768885 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 768889 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 768893 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
   [junit4]   2> 769365 WARN  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
   [junit4]   2> 769366 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 769366 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 769366 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 13.0.2+8
   [junit4]   2> 769373 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 769373 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 769373 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 769376 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6ee77743{/,null,AVAILABLE}
   [junit4]   2> 769382 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.e.j.s.AbstractConnector Started ServerConnector@376dec21{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:58267}
   [junit4]   2> 769382 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.e.j.s.Server Started @769442ms
   [junit4]   2> 769382 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_4679BD3D342E99F1-001/tempDir-001/control/data, hostPort=58267, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_4679BD3D342E99F1-001/control-001/cores, replicaType=NRT}
   [junit4]   2> 769384 ERROR (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 769384 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 769384 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.7.0
   [junit4]   2> 769384 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 769384 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr
   [junit4]   2> 769385 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2020-07-16T23:30:57.437016Z
   [junit4]   2> 769392 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 769394 INFO  (zkConnectionManagerCallback-5208-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 769395 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 769400 WARN  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]-SendThread(127.0.0.1:58262)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100d09e0a3e0002.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x100d09e0a3e0002, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100d09e0a3e0002, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:348) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1262) [zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 769501 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 769502 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_4679BD3D342E99F1-001/control-001/solr.xml
   [junit4]   2> 769505 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 769505 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 769507 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@5546f0aa, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 769562 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
   [junit4]   2> 769563 WARN  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3a0c159f[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 769563 WARN  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3a0c159f[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 769567 WARN  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@14b37001[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 769567 WARN  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@14b37001[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 769568 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:58262/solr
   [junit4]   2> 769569 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 769574 INFO  (zkConnectionManagerCallback-5218-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 769574 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 769579 WARN  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]-SendThread(127.0.0.1:58262)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100d09e0a3e0003.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x100d09e0a3e0003, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100d09e0a3e0003, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:348) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1262) [zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 769681 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [n:127.0.0.1:58267_     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 769685 INFO  (zkConnectionManagerCallback-5220-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 769685 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [n:127.0.0.1:58267_     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 770282 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [n:127.0.0.1:58267_     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:58267_
   [junit4]   2> 770287 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [n:127.0.0.1:58267_     ] o.a.s.c.Overseer Overseer (id=72286971233173508-127.0.0.1:58267_-n_0000000000) starting
   [junit4]   2> 770305 INFO  (OverseerStateUpdate-72286971233173508-127.0.0.1:58267_-n_0000000000) [n:127.0.0.1:58267_     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:58267_
   [junit4]   2> 770306 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [n:127.0.0.1:58267_     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58267_
   [junit4]   2> 770316 INFO  (zkCallback-5219-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 770329 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [n:127.0.0.1:58267_     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 770332 WARN  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [n:127.0.0.1:58267_     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 770362 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [n:127.0.0.1:58267_     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 770394 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [n:127.0.0.1:58267_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5546f0aa
   [junit4]   2> 770420 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [n:127.0.0.1:58267_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5546f0aa
   [junit4]   2> 770420 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [n:127.0.0.1:58267_     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5546f0aa
   [junit4]   2> 770422 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [n:127.0.0.1:58267_     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_4679BD3D342E99F1-001/control-001/cores
   [junit4]   2> 770464 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 770472 INFO  (zkConnectionManagerCallback-5237-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 770473 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 770481 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 770494 INFO  (TEST-MultiThreadedOCPTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:58262/solr ready
   [junit4]   2> 770498 INFO  (qtp1423610374-9188) [n:127.0.0.1:58267_     ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:58267_&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 770531 INFO  (OverseerThreadFactory-5227-thread-1-processing-n:127.0.0.1:58267_) [n:127.0.0.1:58267_     ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 770683 INFO  (qtp1423610374-9190) [n:127.0.0.1:58267_     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 770683 INFO  (qtp1423610374-9190) [n:127.0.0.1:58267_     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=1
   [junit4]   2> 770715 INFO  (qtp1423610374-9190) [n:127.0.0.1:58267_    x:control_collection_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 771784 INFO  (qtp1423610374-9190) [n:127.0.0.1:58267_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.7.0
   [junit4]   2> 771790 INFO  (qtp1423610374-9190) [n:127.0.0.1:58267_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from configset conf1, trusted=true
   [junit4]   2> 771796 INFO  (qtp1423610374-9190) [n:127.0.0.1:58267_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=test
   [junit4]   2> 771863 INFO  (qtp1423610374-9190) [n:127.0.0.1:58267_ c:control_collection s:sha

[...truncated too long message...]

=CREATE&numShards=1&collection=c8n_1x3_commits&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=400 QTime=11345
   [junit4]   2> 183624 INFO  (closeThreadPool-713-thread-4) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@3ccb7b64{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
   [junit4]   2> 183625 WARN  (closeThreadPool-713-thread-3) [     ] o.a.s.c.s.c.SocketProxy Closing 7 connections to: http://127.0.0.1:63567/bw_hb/d, target: http://127.0.0.1:63568/bw_hb/d
   [junit4]   2> 183626 INFO  (closeThreadPool-713-thread-4) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2458f311{/bw_hb/d,null,UNAVAILABLE}
   [junit4]   2> 183626 WARN  (closeThreadPool-713-thread-2) [     ] o.a.s.c.s.c.SocketProxy Closing 8 connections to: http://127.0.0.1:63505/bw_hb/d, target: http://127.0.0.1:63506/bw_hb/d
   [junit4]   2> 183627 INFO  (closeThreadPool-713-thread-4) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 183630 WARN  (closeThreadPool-713-thread-4) [     ] o.a.s.c.s.c.SocketProxy Closing 4 connections to: http://127.0.0.1:63595/bw_hb/d, target: http://127.0.0.1:63596/bw_hb/d
   [junit4]   2> 183630 INFO  (TEST-HttpPartitionOnCommitTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 183840 WARN  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	14	/solr/collections/collection1/terms/shard1
   [junit4]   2> 	7	/solr/aliases.json
   [junit4]   2> 	5	/solr/packages.json
   [junit4]   2> 	5	/solr/security.json
   [junit4]   2> 	5	/solr/configs/conf1
   [junit4]   2> 	4	/solr/collections/collection1/collectionprops.json
   [junit4]   2> 	2	/solr/collections/control_collection/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	101	/solr/collections/collection1/state.json
   [junit4]   2> 	12	/solr/collections/control_collection/state.json
   [junit4]   2> 	7	/solr/clusterprops.json
   [junit4]   2> 	7	/solr/clusterstate.json
   [junit4]   2> 	2	/solr/overseer_elect/election/72287136600162314-127.0.0.1:63560_bw_hb%2Fd-n_0000000001
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	53	/solr/overseer/queue
   [junit4]   2> 	36	/solr/live_nodes
   [junit4]   2> 	24	/solr/collections
   [junit4]   2> 	22	/solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> 183849 INFO  (TEST-HttpPartitionOnCommitTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:63493
   [junit4]   2> 183849 INFO  (TEST-HttpPartitionOnCommitTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:63493
   [junit4]   2> 183849 INFO  (TEST-HttpPartitionOnCommitTest.test-seed#[4679BD3D342E99F1]) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 63493
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=HttpPartitionOnCommitTest -Dtests.method=test -Dtests.seed=4679BD3D342E99F1 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=shi-Tfng-MA -Dtests.timezone=America/Puerto_Rico -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   29.5s J0 | HttpPartitionOnCommitTest.test <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:63567/bw_hb/d: Underlying core creation failed while creating collection: c8n_1x3_commits
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([4679BD3D342E99F1:CE2D82E79AD2F409]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:681)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:266)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1290)
   [junit4]    > 	at org.apache.solr.cloud.BasicDistributedZkTest.createCollection(BasicDistributedZkTest.java:810)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1766)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionOnCommitTest.oneShardTest(HttpPartitionOnCommitTest.java:125)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionOnCommitTest.test(HttpPartitionOnCommitTest.java:66)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.base/java.lang.reflect.Method.invoke(Method.java:567)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1090)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1061)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:830)
   [junit4]   2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionOnCommitTest_4679BD3D342E99F1-001
   [junit4]   2> Jul 17, 2020 12:13:29 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Lucene86, sim=Asserting(RandomSimilarity(queryNorm=true): {}), locale=shi-Tfng-MA, timezone=America/Puerto_Rico
   [junit4]   2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 13.0.2 (64-bit)/cpus=6,threads=1,free=136702288,total=293601280
   [junit4]   2> NOTE: All tests run in this JVM: [SchemaApiFailureTest, TestCollectionAPI, HttpPartitionOnCommitTest]
   [junit4] Completed [15/20 (3!)] on J0 in 30.73s, 1 test, 1 error <<< FAILURES!

[...truncated 35 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/lucene/common-build.xml:1599: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/lucene/common-build.xml:1126: There were test failures: 20 suites, 25 tests, 2 suite-level errors, 1 error [seed: 4679BD3D342E99F1]

Total time: 3 minutes 39 seconds

[repro] Setting last failure code to 256

[repro] Failures w/original seeds:
[repro]   0/5 failed: org.apache.solr.cloud.MultiThreadedOCPTest
[repro]   0/5 failed: org.apache.solr.cloud.api.collections.TestCollectionAPI
[repro]   1/5 failed: org.apache.solr.cloud.HttpPartitionOnCommitTest
[repro]   2/5 failed: org.apache.solr.schema.SchemaApiFailureTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Archiving artifacts
[Java] Sleeping for 5 seconds due to JENKINS-32191...
[Java] Parsing console log (workspace: '/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX')
[Java] Successfully parsed console log
[Java] -> found 113 issues (skipped 104 duplicates)
[Java] Post processing issues on 'MacOSX VBOX' with source code encoding 'UTF-8'
[Java] Creating SCM blamer to obtain author and commit information for affected files
[Java] Creating SCM miner to obtain statistics for affected repository files
[Java] Resolving file names for all issues in source directory '/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX'
[Java] -> resolved paths in source directory (54 found, 0 not found)
[Java] Resolving module names from module definitions (build.xml, pom.xml, or Manifest.mf files)
[Java] -> resolved module names for 113 issues
[Java] Resolving package names (or namespaces) by parsing the affected files
[Java] -> resolved package names of 54 affected files
[Java] No filter has been set, publishing all 113 issues
[Java] Creating fingerprints for all affected code blocks to track issues over different builds
[Java] -> created fingerprints for 113 issues (skipped 0 issues)
[Java] Copying affected files to Jenkins' build folder '/home/jenkins/jobs/Lucene-Solr-8.x-MacOSX/builds/1266/files-with-issues'
[Java] -> 54 copied, 0 not in workspace, 0 not-found, 0 with I/O error
[Java] Using reference build 'Lucene-Solr-8.x-MacOSX #1265' to compute new, fixed, and outstanding issues
[Java] Issues delta (vs. reference build): outstanding: 113, new: 0, fixed: 0
[Java] No quality gates have been set - skipping
[Java] Health report is disabled - skipping
[Java] Created analysis result for 113 issues (found 0 new issues, fixed 0 issues)
[Java] Attaching ResultAction with ID 'java' to run 'Lucene-Solr-8.x-MacOSX #1266'.
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Recording test results
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS-Experimental-GC] Lucene-Solr-8.x-MacOSX (64bit/jdk-14.0.1) - Build # 1265 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-MacOSX/1265/
Java: 64bit/jdk-14.0.1 -XX:-UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseZGC

1 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.schema.SchemaApiFailureTest

Error Message:
ObjectTracker found 3 object(s) that were not released!!! [MockDirectoryWrapper, MockDirectoryWrapper, MockDirectoryWrapper] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)  at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:404)  at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:780)  at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1007)  at org.apache.solr.core.SolrCore.<init>(SolrCore.java:920)  at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1388)  at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1274)  at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:95)  at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367)  at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)  at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)  at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214)  at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:854)  at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:818)  at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)  at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)  at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)  at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)  at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)  at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)  at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)  at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)  at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)  at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)  at org.eclipse.jetty.server.Server.handle(Server.java:500)  at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)  at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)  at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)  at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335)  at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)  at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)  at java.base/java.lang.Thread.run(Thread.java:832)  org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)  at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:552)  at org.apache.solr.core.SolrCore.<init>(SolrCore.java:999)  at org.apache.solr.core.SolrCore.<init>(SolrCore.java:920)  at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1388)  at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1274)  at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:95)  at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367)  at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)  at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)  at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214)  at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:854)  at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:818)  at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)  at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)  at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)  at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)  at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)  at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)  at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)  at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)  at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)  at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)  at org.eclipse.jetty.server.Server.handle(Server.java:500)  at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)  at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)  at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)  at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335)  at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)  at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)  at java.base/java.lang.Thread.run(Thread.java:832)  org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)  at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:98)  at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:812)  at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1007)  at org.apache.solr.core.SolrCore.<init>(SolrCore.java:920)  at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1388)  at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1274)  at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:95)  at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367)  at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)  at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)  at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214)  at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:854)  at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:818)  at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)  at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)  at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)  at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)  at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)  at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)  at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)  at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)  at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)  at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)  at org.eclipse.jetty.server.Server.handle(Server.java:500)  at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)  at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)  at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)  at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335)  at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)  at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)  at java.base/java.lang.Thread.run(Thread.java:832)   expected null, but was:<ObjectTracker found 3 object(s) that were not released!!! [MockDirectoryWrapper, MockDirectoryWrapper, MockDirectoryWrapper] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)  at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:404)  at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:780)  at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1007)  at org.apache.solr.core.SolrCore.<init>(SolrCore.java:920)  at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1388)  at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1274)  at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:95)  at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367)  at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)  at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)  at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214)  at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:854)  at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:818)  at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)  at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)  at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)  at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)  at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)  at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)  at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)  at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)  at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)  at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)  at org.eclipse.jetty.server.Server.handle(Server.java:500)  at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)  at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)  at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)  at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335)  at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)  at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)  at java.base/java.lang.Thread.run(Thread.java:832)  org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)  at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:552)  at org.apache.solr.core.SolrCore.<init>(SolrCore.java:999)  at org.apache.solr.core.SolrCore.<init>(SolrCore.java:920)  at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1388)  at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1274)  at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:95)  at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367)  at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)  at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)  at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214)  at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:854)  at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:818)  at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)  at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)  at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)  at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)  at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)  at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)  at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)  at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)  at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)  at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)  at org.eclipse.jetty.server.Server.handle(Server.java:500)  at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)  at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)  at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)  at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335)  at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)  at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)  at java.base/java.lang.Thread.run(Thread.java:832)  org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper  at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)  at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)  at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:98)  at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:812)  at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1007)  at org.apache.solr.core.SolrCore.<init>(SolrCore.java:920)  at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1388)  at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1274)  at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:95)  at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367)  at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)  at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)  at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214)  at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:854)  at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:818)  at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415)  at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)  at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)  at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)  at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)  at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)  at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)  at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)  at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)  at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)  at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)  at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)  at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)  at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)  at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)  at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)  at org.eclipse.jetty.server.Server.handle(Server.java:500)  at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)  at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)  at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)  at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335)  at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)  at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)  at java.base/java.lang.Thread.run(Thread.java:832)  >

Stack Trace:
java.lang.AssertionError: ObjectTracker found 3 object(s) that were not released!!! [MockDirectoryWrapper, MockDirectoryWrapper, MockDirectoryWrapper]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)
	at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:404)
	at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:780)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1007)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:920)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1388)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1274)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:95)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)
	at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214)
	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:854)
	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:818)
	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.server.Server.handle(Server.java:500)
	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)
	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
	at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)
	at java.base/java.lang.Thread.run(Thread.java:832)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)
	at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:552)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:999)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:920)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1388)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1274)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:95)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)
	at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214)
	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:854)
	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:818)
	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.server.Server.handle(Server.java:500)
	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)
	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
	at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)
	at java.base/java.lang.Thread.run(Thread.java:832)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)
	at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:98)
	at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:812)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1007)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:920)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1388)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1274)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:95)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)
	at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214)
	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:854)
	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:818)
	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.server.Server.handle(Server.java:500)
	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)
	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
	at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)
	at java.base/java.lang.Thread.run(Thread.java:832)

 expected null, but was:<ObjectTracker found 3 object(s) that were not released!!! [MockDirectoryWrapper, MockDirectoryWrapper, MockDirectoryWrapper]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)
	at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:404)
	at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:780)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1007)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:920)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1388)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1274)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:95)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)
	at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214)
	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:854)
	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:818)
	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.server.Server.handle(Server.java:500)
	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)
	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
	at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)
	at java.base/java.lang.Thread.run(Thread.java:832)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)
	at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:552)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:999)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:920)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1388)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1274)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:95)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)
	at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214)
	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:854)
	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:818)
	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.server.Server.handle(Server.java:500)
	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)
	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
	at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)
	at java.base/java.lang.Thread.run(Thread.java:832)

org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)
	at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:98)
	at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:812)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1007)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:920)
	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1388)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1274)
	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:95)
	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367)
	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)
	at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214)
	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:854)
	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:818)
	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)
	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
	at org.eclipse.jetty.server.Server.handle(Server.java:500)
	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)
	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
	at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)
	at java.base/java.lang.Thread.run(Thread.java:832)

>
	at __randomizedtesting.SeedInfo.seed([15EB2E1624B5E72E]:0)
	at org.junit.Assert.fail(Assert.java:88)
	at org.junit.Assert.failNotNull(Assert.java:755)
	at org.junit.Assert.assertNull(Assert.java:737)
	at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:327)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:901)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:832)




Build Log:
[...truncated 16033 lines...]
   [junit4] Suite: org.apache.solr.schema.SchemaApiFailureTest
   [junit4]   2> 2090883 INFO  (SUITE-SchemaApiFailureTest-seed#[15EB2E1624B5E72E]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 2090950 INFO  (SUITE-SchemaApiFailureTest-seed#[15EB2E1624B5E72E]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.SchemaApiFailureTest_15EB2E1624B5E72E-001/data-dir-225-001
   [junit4]   2> 2090950 WARN  (SUITE-SchemaApiFailureTest-seed#[15EB2E1624B5E72E]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=21 numCloses=21
   [junit4]   2> 2090950 INFO  (SUITE-SchemaApiFailureTest-seed#[15EB2E1624B5E72E]-worker) [     ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 2090952 INFO  (SUITE-SchemaApiFailureTest-seed#[15EB2E1624B5E72E]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
   [junit4]   2> 2090952 INFO  (SUITE-SchemaApiFailureTest-seed#[15EB2E1624B5E72E]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 2090952 INFO  (SUITE-SchemaApiFailureTest-seed#[15EB2E1624B5E72E]-worker) [     ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.SchemaApiFailureTest_15EB2E1624B5E72E-001/tempDir-001
   [junit4]   2> 2090953 INFO  (SUITE-SchemaApiFailureTest-seed#[15EB2E1624B5E72E]-worker) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2091011 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
   [junit4]   2> 2091011 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2091035 WARN  (ZkTestServer Run Thread) [     ] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0.
   [junit4]   2> 2091065 INFO  (SUITE-SchemaApiFailureTest-seed#[15EB2E1624B5E72E]-worker) [     ] o.a.s.c.ZkTestServer start zk server on port: 62089
   [junit4]   2> 2091065 INFO  (SUITE-SchemaApiFailureTest-seed#[15EB2E1624B5E72E]-worker) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:62089
   [junit4]   2> 2091065 INFO  (SUITE-SchemaApiFailureTest-seed#[15EB2E1624B5E72E]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:62089
   [junit4]   2> 2091065 INFO  (SUITE-SchemaApiFailureTest-seed#[15EB2E1624B5E72E]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 62089
   [junit4]   2> 2091190 INFO  (SUITE-SchemaApiFailureTest-seed#[15EB2E1624B5E72E]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2091340 INFO  (zkConnectionManagerCallback-16285-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2091344 INFO  (SUITE-SchemaApiFailureTest-seed#[15EB2E1624B5E72E]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2091424 INFO  (SUITE-SchemaApiFailureTest-seed#[15EB2E1624B5E72E]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2091503 INFO  (zkConnectionManagerCallback-16287-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2091505 INFO  (SUITE-SchemaApiFailureTest-seed#[15EB2E1624B5E72E]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2091508 INFO  (SUITE-SchemaApiFailureTest-seed#[15EB2E1624B5E72E]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2091591 INFO  (zkConnectionManagerCallback-16289-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2091595 INFO  (SUITE-SchemaApiFailureTest-seed#[15EB2E1624B5E72E]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2092559 WARN  (jetty-launcher-16290-thread-1) [     ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
   [junit4]   2> 2092559 INFO  (jetty-launcher-16290-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 2092559 INFO  (jetty-launcher-16290-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 2092559 INFO  (jetty-launcher-16290-thread-1) [     ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14.0.1+7
   [junit4]   2> 2092562 INFO  (jetty-launcher-16290-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2092562 INFO  (jetty-launcher-16290-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2092563 INFO  (jetty-launcher-16290-thread-1) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 2092563 INFO  (jetty-launcher-16290-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@d23adc5{/solr,null,AVAILABLE}
   [junit4]   2> 2092567 INFO  (jetty-launcher-16290-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@4e8caf7b{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:62094}
   [junit4]   2> 2092567 INFO  (jetty-launcher-16290-thread-1) [     ] o.e.j.s.Server Started @2092694ms
   [junit4]   2> 2092568 INFO  (jetty-launcher-16290-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=62094}
   [junit4]   2> 2092568 ERROR (jetty-launcher-16290-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2092568 INFO  (jetty-launcher-16290-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2092568 INFO  (jetty-launcher-16290-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.7.0
   [junit4]   2> 2092568 INFO  (jetty-launcher-16290-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2092568 INFO  (jetty-launcher-16290-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr
   [junit4]   2> 2092568 INFO  (jetty-launcher-16290-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2020-07-16T18:37:11.406717Z
   [junit4]   2> 2092574 INFO  (jetty-launcher-16290-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2092710 INFO  (zkConnectionManagerCallback-16292-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2092710 INFO  (jetty-launcher-16290-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2092712 INFO  (jetty-launcher-16290-thread-1) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2092722 WARN  (jetty-launcher-16290-thread-1-SendThread(127.0.0.1:62089)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100cf9113c70003.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x100cf9113c70003, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100cf9113c70003, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:348) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1262) [zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 2093140 INFO  (jetty-launcher-16290-thread-1) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 2093189 WARN  (jetty-launcher-16290-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3cb61645[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2093189 WARN  (jetty-launcher-16290-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3cb61645[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2093225 WARN  (jetty-launcher-16290-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@14f7c250[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2093225 WARN  (jetty-launcher-16290-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@14f7c250[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2093227 INFO  (jetty-launcher-16290-thread-1) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62089/solr
   [junit4]   2> 2093231 INFO  (jetty-launcher-16290-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2093237 INFO  (zkConnectionManagerCallback-16302-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2093252 INFO  (jetty-launcher-16290-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2093302 WARN  (jetty-launcher-16290-thread-1-SendThread(127.0.0.1:62089)) [     ] o.a.z.ClientCnxn An exception was thrown while closing send thread for session 0x100cf9113c70004.
   [junit4]   2>           => EndOfStreamException: Unable to read additional data from server sessionid 0x100cf9113c70004, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75)
   [junit4]   2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100cf9113c70004, likely server has closed socket
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:75) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:348) ~[zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1262) [zookeeper-3.6.1.jar:3.6.1]
   [junit4]   2> 2093447 INFO  (jetty-launcher-16290-thread-1) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2093488 INFO  (zkConnectionManagerCallback-16304-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2093500 INFO  (jetty-launcher-16290-thread-1) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2095657 INFO  (jetty-launcher-16290-thread-1) [n:127.0.0.1:62094_solr     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:62094_solr
   [junit4]   2> 2095660 INFO  (jetty-launcher-16290-thread-1) [n:127.0.0.1:62094_solr     ] o.a.s.c.Overseer Overseer (id=72285816046944261-127.0.0.1:62094_solr-n_0000000000) starting
   [junit4]   2> 2095676 INFO  (OverseerStateUpdate-72285816046944261-127.0.0.1:62094_solr-n_0000000000) [n:127.0.0.1:62094_solr     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:62094_solr
   [junit4]   2> 2095677 INFO  (jetty-launcher-16290-thread-1) [n:127.0.0.1:62094_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62094_solr
   [junit4]   2> 2095686 INFO  (zkCallback-16303-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2095692 INFO  (jetty-launcher-16290-thread-1) [n:127.0.0.1:62094_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 2095693 WARN  (jetty-launcher-16290-thread-1) [n:127.0.0.1:62094_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 2095719 INFO  (jetty-launcher-16290-thread-1) [n:127.0.0.1:62094_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 2095750 INFO  (jetty-launcher-16290-thread-1) [n:127.0.0.1:62094_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_62094.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@32327c88
   [junit4]   2> 2095773 INFO  (jetty-launcher-16290-thread-1) [n:127.0.0.1:62094_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_62094.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@32327c88
   [junit4]   2> 2095774 INFO  (jetty-launcher-16290-thread-1) [n:127.0.0.1:62094_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_62094.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@32327c88
   [junit4]   2> 2095777 INFO  (jetty-launcher-16290-thread-1) [n:127.0.0.1:62094_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.SchemaApiFailureTest_15EB2E1624B5E72E-001/tempDir-001/node1
   [junit4]   2> 2095838 INFO  (SUITE-SchemaApiFailureTest-seed#[15EB2E1624B5E72E]-worker) [     ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=1
   [junit4]   2> 2095839 INFO  (SUITE-SchemaApiFailureTest-seed#[15EB2E1624B5E72E]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2095851 INFO  (zkConnectionManagerCallback-16321-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2095851 INFO  (SUITE-SchemaApiFailureTest-seed#[15EB2E1624B5E72E]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2095893 INFO  (SUITE-SchemaApiFailureTest-seed#[15EB2E1624B5E72E]-worker) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2095948 INFO  (SUITE-SchemaApiFailureTest-seed#[15EB2E1624B5E72E]-worker) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:62089/solr ready
   [junit4]   2> 2095952 INFO  (qtp1078679810-27619) [n:127.0.0.1:62094_solr     ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&maxShardsPerNode=2&name=schema-api-failure&nrtReplicas=1&action=CREATE&numShards=2&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2095987 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.a.c.CreateCollectionCmd Create collection schema-api-failure
   [junit4]   2> 2095993 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/managed-schema to /configs/schema-api-failure.AUTOCREATED/managed-schema
   [junit4]   2> 2096036 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/protwords.txt to /configs/schema-api-failure.AUTOCREATED/protwords.txt
   [junit4]   2> 2096096 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_it.txt to /configs/schema-api-failure.AUTOCREATED/lang/contractions_it.txt
   [junit4]   2> 2096130 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ca.txt to /configs/schema-api-failure.AUTOCREATED/lang/contractions_ca.txt
   [junit4]   2> 2096233 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stemdict_nl.txt to /configs/schema-api-failure.AUTOCREATED/lang/stemdict_nl.txt
   [junit4]   2> 2096268 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_no.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_no.txt
   [junit4]   2> 2096293 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hy.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_hy.txt
   [junit4]   2> 2096397 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_id.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_id.txt
   [junit4]   2> 2096441 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_et.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_et.txt
   [junit4]   2> 2096530 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_da.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_da.txt
   [junit4]   2> 2096569 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hi.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_hi.txt
   [junit4]   2> 2096639 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ga.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_ga.txt
   [junit4]   2> 2096772 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_pt.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_pt.txt
   [junit4]   2> 2096959 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ja.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_ja.txt
   [junit4]   2> 2097102 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hu.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_hu.txt
   [junit4]   2> 2097134 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_el.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_el.txt
   [junit4]   2> 2097213 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ru.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_ru.txt
   [junit4]   2> 2097264 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_tr.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_tr.txt
   [junit4]   2> 2097315 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ar.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_ar.txt
   [junit4]   2> 2097324 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/userdict_ja.txt to /configs/schema-api-failure.AUTOCREATED/lang/userdict_ja.txt
   [junit4]   2> 2097351 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_eu.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_eu.txt
   [junit4]   2> 2097358 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_it.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_it.txt
   [junit4]   2> 2097378 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_cz.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_cz.txt
   [junit4]   2> 2097384 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stoptags_ja.txt to /configs/schema-api-failure.AUTOCREATED/lang/stoptags_ja.txt
   [junit4]   2> 2097399 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_fr.txt to /configs/schema-api-failure.AUTOCREATED/lang/contractions_fr.txt
   [junit4]   2> 2097424 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_de.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_de.txt
   [junit4]   2> 2097462 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fa.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_fa.txt
   [junit4]   2> 2097490 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ga.txt to /configs/schema-api-failure.AUTOCREATED/lang/contractions_ga.txt
   [junit4]   2> 2097508 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ca.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_ca.txt
   [junit4]   2> 2097571 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_nl.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_nl.txt
   [junit4]   2> 2097617 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_bg.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_bg.txt
   [junit4]   2> 2097635 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_es.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_es.txt
   [junit4]   2> 2097685 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_lv.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_lv.txt
   [junit4]   2> 2097721 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_en.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_en.txt
   [junit4]   2> 2097758 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ro.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_ro.txt
   [junit4]   2> 2097790 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_th.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_th.txt
   [junit4]   2> 2097875 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fr.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_fr.txt
   [junit4]   2> 2097935 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_sv.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_sv.txt
   [junit4]   2> 2097980 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fi.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_fi.txt
   [junit4]   2> 2097997 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/hyphenations_ga.txt to /configs/schema-api-failure.AUTOCREATED/lang/hyphenations_ga.txt
   [junit4]   2> 2098004 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_gl.txt to /configs/schema-api-failure.AUTOCREATED/lang/stopwords_gl.txt
   [junit4]   2> 2098014 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/solrconfig.xml to /configs/schema-api-failure.AUTOCREATED/solrconfig.xml
   [junit4]   2> 2098049 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/synonyms.txt to /configs/schema-api-failure.AUTOCREATED/synonyms.txt
   [junit4]   2> 2098079 INFO  (OverseerThreadFactory-16311-thread-1-processing-n:127.0.0.1:62094_solr) [n:127.0.0.1:62094_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/stopwords.txt to /configs/schema-api-failure.AUTOCREATED/stopwords.txt
   [junit4]   2> 2098324 INFO  (qtp1078679810-27617) [n:127.0.0.1:62094_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2098324 INFO  (qtp1078679810-27617) [n:127.0.0.1:62094_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=1
   [junit4]   2> 2098519 INFO  (OverseerStateUpdate-72285816046944261-127.0.0.1:62094_solr-n_0000000000) [n:127.0.0.1:62094_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"schema-api-failure",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"schema-api-failure_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:62094/solr",
   [junit4]   2>   "node_name":"127.0.0.1:62094_solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2098887 INFO  (OverseerStateUpdate-72285816046944261-127.0.0.1:62094_solr-n_0000000000) [n:127.0.0.1:62094_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"schema-api-failure",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"schema-api-failure_shard2_replica_n3",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:62094/solr",
   [junit4]   2>   "node_name":"127.0.0.1:62094_solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2099284 INFO  (qtp1078679810-27617) [n:127.0.0.1:62094_solr    x:schema-api-failure_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=schema-api-failure.AUTOCREATED&newCollection=true&name=schema-api-failure_shard1_replica_n1&action=CREATE&numShards=2&collection=schema-api-failure&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2099314 INFO  (qtp1078679810-27618) [n:127.0.0.1:62094_solr    x:schema-api-failure_shard2_replica_n3 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=schema-api-failure.AUTOCREATED&newCollection=true&name=schema-api-failure_shard2_replica_n3&action=CREATE&numShards=2&collection=schema-api-failure&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2100097 INFO  (qtp1078679810-27617) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard1 r:core_node2 x:schema-api-failure_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.7.0
   [junit4]   2> 2100161 INFO  (qtp1078679810-27617) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard1 r:core_node2 x:schema-api-failure_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'schema-api-failure_shard1_replica_n1' using configuration from configset schema-api-failure.AUTOCREATED, trusted=true
   [junit4]   2> 2100387 INFO  (qtp1078679810-27617) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard1 r:core_node2 x:schema-api-failure_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=default-config
   [junit4]   2> 2100407 INFO  (qtp1078679810-27618) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard2 r:core_node4 x:schema-api-failure_shard2_replica_n3 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.7.0
   [junit4]   2> 2100479 INFO  (qtp1078679810-27618) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard2 r:core_node4 x:schema-api-failure_shard2_replica_n3 ] o.a.s.c.CoreContainer Creating SolrCore 'schema-api-failure_shard2_replica_n3' using configuration from configset schema-api-failure.AUTOCREATED, trusted=true
   [junit4]   2> 2100531 INFO  (qtp1078679810-27618) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard2 r:core_node4 x:schema-api-failure_shard2_replica_n3 ] o.a.s.s.IndexSchema Schema name=default-config
   [junit4]   2> 2105022 INFO  (qtp1078679810-27617) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard1 r:core_node2 x:schema-api-failure_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema default-config/1.6 with uniqueid field id
   [junit4]   2> 2105419 INFO  (qtp1078679810-27618) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard2 r:core_node4 x:schema-api-failure_shard2_replica_n3 ] o.a.s.s.IndexSchema Loaded schema default-config/1.6 with uniqueid field id
   [junit4]   2> 2106088 INFO  (qtp1078679810-27617) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard1 r:core_node2 x:schema-api-failure_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_62094.solr.core.schema-api-failure.shard1.replica_n1' (registry 'solr.core.schema-api-failure.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@32327c88
   [junit4]   2> 2106089 INFO  (qtp1078679810-27617) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard1 r:core_node2 x:schema-api-failure_shard1_replica_n1 ] o.a.s.c.SolrCore [[schema-api-failure_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.SchemaApiFailureTest_15EB2E1624B5E72E-001/tempDir-001/node1/schema-api-failure_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.SchemaApiFailureTest_15EB2E1624B5E72E-001/tempDir-001/node1/schema-api-failure_shard1_replica_n1/data/]
   [junit4]   2> 2106217 INFO  (qtp1078679810-27617) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard1 r:core_node2 x:schema-api-failure_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2106217 INFO  (qtp1078679810-27617) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard1 r:core_node2 x:schema-api-failure_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2106220 INFO  (qtp1078679810-27617) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard1 r:core_node2 x:schema-api-failure_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: if uncommitted for 15000ms; 
   [junit4]   2> 2106220 INFO  (qtp1078679810-27617) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard1 r:core_node2 x:schema-api-failure_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2106241 INFO  (qtp1078679810-27617) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard1 r:core_node2 x:schema-api-failure_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/schema-api-failure.AUTOCREATED
   [junit4]   2> 2106262 INFO  (qtp1078679810-27617) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard1 r:core_node2 x:schema-api-failure_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/schema-api-failure.AUTOCREATED
   [junit4]   2> 2106262 INFO  (qtp1078679810-27617) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard1 r:core_node2 x:schema-api-failure_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/schema-api-failure.AUTOCREATED/managed-schema
   [junit4]   2> 2106274 INFO  (qtp1078679810-27617) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard1 r:core_node2 x:schema-api-failure_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 2106275 INFO  (qtp1078679810-27617) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard1 r:core_node2 x:schema-api-failure_shard1_replica_n1 ] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 2106275 INFO  (qtp1078679810-27617) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard1 r:core_node2 x:schema-api-failure_shard1_replica_n1 ] o.a.s.s.DirectSolrSpellChecker init: {name=default,field=_text_,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
   [junit4]   2> 2106277 INFO  (qtp1078679810-27617) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard1 r:core_node2 x:schema-api-failure_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 2106277 INFO  (qtp1078679810-27617) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard1 r:core_node2 x:schema-api-failure_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1672399704676106240
   [junit4]   2> 2106303 INFO  (searcherExecutor-16323-thread-1-processing-n:127.0.0.1:62094_solr x:schema-api-failure_shard1_replica_n1 c:schema-api-failure s:shard1 r:core_node2) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard1 r:core_node2 x:schema-api-failure_shard1_replica_n1 ] o.a.s.c.QuerySenderListener QuerySenderListener done.
   [junit4]   2> 2106303 INFO  (searcherExecutor-16323-thread-1-processing-n:127.0.0.1:62094_solr x:schema-api-failure_shard1_replica_n1 c:schema-api-failure s:shard1 r:core_node2) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard1 r:core_node2 x:schema-api-failure_shard1_replica_n1 ] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 2106305 INFO  (searcherExecutor-16323-thread-1-processing-n:127.0.0.1:62094_solr x:schema-api-failure_shard1_replica_n1 c:schema-api-failure s:shard1 r:core_node2) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard1 r:core_node2 x:schema-api-failure_shard1_replica_n1 ] o.a.s.c.SolrCore [schema-api-failure_shard1_replica_n1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 2106327 INFO  (qtp1078679810-27618) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard2 r:core_node4 x:schema-api-failure_shard2_replica_n3 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_62094.solr.core.schema-api-failure.shard2.replica_n3' (registry 'solr.core.schema-api-failure.shard2.replica_n3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@32327c88
   [junit4]   2> 2106327 INFO  (qtp1078679810-27618) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard2 r:core_node4 x:schema-api-failure_shard2_replica_n3 ] o.a.s.c.SolrCore [[schema-api-failure_shard2_replica_n3] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.SchemaApiFailureTest_15EB2E1624B5E72E-001/tempDir-001/node1/schema-api-failure_shard2_replica_n3], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.SchemaApiFailureTest_15EB2E1624B5E72E-001/tempDir-001/node1/schema-api-failure_shard2_replica_n3/data/]
   [junit4]   2> 2106380 INFO  (qtp1078679810-27617) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard1 r:core_node2 x:schema-api-failure_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/schema-api-failure/terms/shard1 to Terms{values={core_node2=0}, version=0}
   [junit4]   2> 2106380 INFO  (qtp1078679810-27617) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard1 r:core_node2 x:schema-api-failure_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/schema-api-failure/leaders/shard1
   [junit4]   2> 2106426 INFO  (qtp1078679810-27618) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard2 r:core_node4 x:schema-api-failure_shard2_replica_n3 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2106426 INFO  (qtp1078679810-27618) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard2 r:core_node4 x:schema-api-failure_shard2_replica_n3 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2106433 INFO  (qtp1078679810-27618) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard2 r:core_node4 x:schema-api-failure_shard2_replica_n3 ] o.a.s.u.CommitTracker Hard AutoCommit: if uncommitted for 15000ms; 
   [junit4]   2> 2106433 INFO  (qtp1078679810-27618) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard2 r:core_node4 x:schema-api-failure_shard2_replica_n3 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2106487 INFO  (qtp1078679810-27618) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard2 r:core_node4 x:schema-api-failure_shard2_replica_n3 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/schema-api-failure.AUTOCREATED
   [junit4]   2> 2106492 INFO  (qtp1078679810-27618) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard2 r:core_node4 x:schema-api-failure_shard2_replica_n3 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/schema-api-failure.AUTOCREATED
   [junit4]   2> 2106492 INFO  (qtp1078679810-27618) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard2 r:core_node4 x:schema-api-failure_shard2_replica_n3 ] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/schema-api-failure.AUTOCREATED/managed-schema
   [junit4]   2> 2106496 INFO  (qtp1078679810-27618) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard2 r:core_node4 x:schema-api-failure_shard2_replica_n3 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 2106496 INFO  (qtp1078679810-27618) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard2 r:core_node4 x:schema-api-failure_shard2_replica_n3 ] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 2106497 INFO  (qtp1078679810-27618) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard2 r:core_node4 x:schema-api-failure_shard2_replica_n3 ] o.a.s.s.DirectSolrSpellChecker init: {name=default,field=_text_,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
   [junit4]   2> 2106498 INFO  (qtp1078679810-27618) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard2 r:core_node4 x:schema-api-failure_shard2_replica_n3 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 2106498 INFO  (qtp1078679810-27618) [n:127.0.0.1:62094_solr c:schema-api-failure s:shard2 r:core_node4 x:schema-api-failure_s

[...truncated too long message...]

e.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)
   [junit4]    > 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]    > 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]    > 	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
   [junit4]    > 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)
   [junit4]    > 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]    > 	at org.eclipse.jetty.server.Server.handle(Server.java:500)
   [junit4]    > 	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
   [junit4]    > 	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)
   [junit4]    > 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
   [junit4]    > 	at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335)
   [junit4]    > 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)
   [junit4]    > 	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:832)
   [junit4]    > org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
   [junit4]    > 	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
   [junit4]    > 	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:354)
   [junit4]    > 	at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:404)
   [junit4]    > 	at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:780)
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1007)
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:920)
   [junit4]    > 	at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1388)
   [junit4]    > 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1274)
   [junit4]    > 	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:95)
   [junit4]    > 	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367)
   [junit4]    > 	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397)
   [junit4]    > 	at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181)
   [junit4]    > 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214)
   [junit4]    > 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:854)
   [junit4]    > 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:818)
   [junit4]    > 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566)
   [junit4]    > 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415)
   [junit4]    > 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)
   [junit4]    > 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
   [junit4]    > 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)
   [junit4]    > 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)
   [junit4]    > 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)
   [junit4]    > 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]    > 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)
   [junit4]    > 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
   [junit4]    > 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)
   [junit4]    > 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
   [junit4]    > 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)
   [junit4]    > 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)
   [junit4]    > 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
   [junit4]    > 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)
   [junit4]    > 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]    > 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]    > 	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
   [junit4]    > 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)
   [junit4]    > 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
   [junit4]    > 	at org.eclipse.jetty.server.Server.handle(Server.java:500)
   [junit4]    > 	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
   [junit4]    > 	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)
   [junit4]    > 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
   [junit4]    > 	at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335)
   [junit4]    > 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)
   [junit4]    > 	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:832)
   [junit4]    > >
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([15EB2E1624B5E72E]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:327)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:832)
   [junit4] Completed [5/5 (3!)] on J1 in 86.13s, 1 test, 1 failure <<< FAILURES!

[...truncated 15 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/lucene/common-build.xml:1599: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/lucene/common-build.xml:1126: There were test failures: 5 suites, 5 tests, 3 suite-level errors [seed: 15EB2E1624B5E72E]

Total time: 1 minute 30 seconds

[repro] Setting last failure code to 256

[repro] Failures w/original seeds:
[repro]   3/5 failed: org.apache.solr.schema.SchemaApiFailureTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Archiving artifacts
[Java] Sleeping for 5 seconds due to JENKINS-32191...
[Java] Parsing console log (workspace: '/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX')
[Java] Successfully parsed console log
[Java] -> found 113 issues (skipped 104 duplicates)
[Java] Post processing issues on 'MacOSX VBOX' with source code encoding 'UTF-8'
[Java] Creating SCM blamer to obtain author and commit information for affected files
[Java] Creating SCM miner to obtain statistics for affected repository files
[Java] Resolving file names for all issues in source directory '/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX'
[Java] -> resolved paths in source directory (54 found, 0 not found)
[Java] Resolving module names from module definitions (build.xml, pom.xml, or Manifest.mf files)
[Java] -> resolved module names for 113 issues
[Java] Resolving package names (or namespaces) by parsing the affected files
[Java] -> resolved package names of 54 affected files
[Java] No filter has been set, publishing all 113 issues
[Java] Creating fingerprints for all affected code blocks to track issues over different builds
[Java] -> created fingerprints for 113 issues (skipped 0 issues)
[Java] Copying affected files to Jenkins' build folder '/home/jenkins/jobs/Lucene-Solr-8.x-MacOSX/builds/1265/files-with-issues'
[Java] -> 54 copied, 0 not in workspace, 0 not-found, 0 with I/O error
[Java] Using reference build 'Lucene-Solr-8.x-MacOSX #1264' to compute new, fixed, and outstanding issues
[Java] Issues delta (vs. reference build): outstanding: 113, new: 0, fixed: 0
[Java] No quality gates have been set - skipping
[Java] Health report is disabled - skipping
[Java] Created analysis result for 113 issues (found 0 new issues, fixed 0 issues)
[Java] Attaching ResultAction with ID 'java' to run 'Lucene-Solr-8.x-MacOSX #1265'.
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Recording test results
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2