You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2020/02/18 19:20:15 UTC

[JENKINS] Lucene-Solr-master-MacOSX (64bit/jdk-13.0.2) - Build # 5679 - Unstable!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/5679/
Java: 64bit/jdk-13.0.2 -XX:+UseCompressedOops -XX:+UseParallelGC

2 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestWaitForStateWithJettyShutdowns

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.TestWaitForStateWithJettyShutdowns:     1) Thread[id=9007, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestWaitForStateWithJettyShutdowns]         at java.base@13.0.2/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.TestWaitForStateWithJettyShutdowns: 
   1) Thread[id=9007, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestWaitForStateWithJettyShutdowns]
        at java.base@13.0.2/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
	at __randomizedtesting.SeedInfo.seed([D58593425AEC91F0]:0)


FAILED:  org.apache.solr.cloud.autoscaling.SearchRateTriggerTest.testWaitForElapsed

Error Message:
[]

Stack Trace:
java.lang.AssertionError: []
	at __randomizedtesting.SeedInfo.seed([D58593425AEC91F0:3D89A153CB90A3F2]:0)
	at org.junit.Assert.fail(Assert.java:88)
	at org.junit.Assert.assertTrue(Assert.java:41)
	at org.apache.solr.cloud.autoscaling.SearchRateTriggerTest.testWaitForElapsed(SearchRateTriggerTest.java:263)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:567)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
	at java.base/java.lang.Thread.run(Thread.java:830)




Build Log:
[...truncated 13460 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestWaitForStateWithJettyShutdowns
   [junit4]   2> 785952 INFO  (SUITE-TestWaitForStateWithJettyShutdowns-seed#[D58593425AEC91F0]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 785953 INFO  (SUITE-TestWaitForStateWithJettyShutdowns-seed#[D58593425AEC91F0]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 785953 INFO  (SUITE-TestWaitForStateWithJettyShutdowns-seed#[D58593425AEC91F0]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestWaitForStateWithJettyShutdowns_D58593425AEC91F0-001/data-dir-47-001
   [junit4]   2> 785954 WARN  (SUITE-TestWaitForStateWithJettyShutdowns-seed#[D58593425AEC91F0]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=3 numCloses=3
   [junit4]   2> 785954 INFO  (SUITE-TestWaitForStateWithJettyShutdowns-seed#[D58593425AEC91F0]-worker) [     ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 785955 INFO  (SUITE-TestWaitForStateWithJettyShutdowns-seed#[D58593425AEC91F0]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
   [junit4]   2> 785958 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testWaitForStateBeforeShutDown
   [junit4]   2> 785958 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestWaitForStateWithJettyShutdowns_D58593425AEC91F0-001/tempDir-001
   [junit4]   2> 785959 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 785959 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 785959 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 786060 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkTestServer start zk server on port:53185
   [junit4]   2> 786060 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:53185
   [junit4]   2> 786060 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:53185
   [junit4]   2> 786060 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 53185
   [junit4]   2> 786067 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 786072 INFO  (zkConnectionManagerCallback-2095-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 786072 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 786077 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 786080 INFO  (zkConnectionManagerCallback-2097-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 786081 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 786082 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 786087 INFO  (zkConnectionManagerCallback-2099-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 786087 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 786196 WARN  (jetty-launcher-2100-thread-1) [     ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
   [junit4]   2> 786196 INFO  (jetty-launcher-2100-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 786196 INFO  (jetty-launcher-2100-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 786196 INFO  (jetty-launcher-2100-thread-1) [     ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 13.0.2+8
   [junit4]   2> 786197 INFO  (jetty-launcher-2100-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 786197 INFO  (jetty-launcher-2100-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 786198 INFO  (jetty-launcher-2100-thread-1) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 786198 INFO  (jetty-launcher-2100-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4a1e4412{/solr,null,AVAILABLE}
   [junit4]   2> 786199 INFO  (jetty-launcher-2100-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@7e1b82f4{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:53195}
   [junit4]   2> 786199 INFO  (jetty-launcher-2100-thread-1) [     ] o.e.j.s.Server Started @786244ms
   [junit4]   2> 786199 INFO  (jetty-launcher-2100-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=53195}
   [junit4]   2> 786199 ERROR (jetty-launcher-2100-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 786199 INFO  (jetty-launcher-2100-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 786199 INFO  (jetty-launcher-2100-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 9.0.0
   [junit4]   2> 786199 INFO  (jetty-launcher-2100-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 786199 INFO  (jetty-launcher-2100-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
   [junit4]   2> 786199 INFO  (jetty-launcher-2100-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2020-02-18T18:35:35.718758Z
   [junit4]   2> 786201 INFO  (jetty-launcher-2100-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 786204 INFO  (zkConnectionManagerCallback-2102-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 786204 INFO  (jetty-launcher-2100-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 786205 INFO  (jetty-launcher-2100-thread-1) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 786398 INFO  (jetty-launcher-2100-thread-1) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 786399 WARN  (jetty-launcher-2100-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@7d76c90b[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 786399 WARN  (jetty-launcher-2100-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@7d76c90b[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 786403 WARN  (jetty-launcher-2100-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@51d874a7[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 786403 WARN  (jetty-launcher-2100-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@51d874a7[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 786404 INFO  (jetty-launcher-2100-thread-1) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53185/solr
   [junit4]   2> 786405 INFO  (jetty-launcher-2100-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 786409 INFO  (zkConnectionManagerCallback-2109-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 786409 INFO  (jetty-launcher-2100-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 786514 INFO  (jetty-launcher-2100-thread-1) [n:127.0.0.1:53195_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 786519 INFO  (zkConnectionManagerCallback-2111-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 786519 INFO  (jetty-launcher-2100-thread-1) [n:127.0.0.1:53195_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 786954 INFO  (jetty-launcher-2100-thread-1) [n:127.0.0.1:53195_solr     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:53195_solr
   [junit4]   2> 786956 INFO  (jetty-launcher-2100-thread-1) [n:127.0.0.1:53195_solr     ] o.a.s.c.Overseer Overseer (id=72087724544491525-127.0.0.1:53195_solr-n_0000000000) starting
   [junit4]   2> 786979 INFO  (OverseerStateUpdate-72087724544491525-127.0.0.1:53195_solr-n_0000000000) [n:127.0.0.1:53195_solr     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:53195_solr
   [junit4]   2> 786980 INFO  (jetty-launcher-2100-thread-1) [n:127.0.0.1:53195_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53195_solr
   [junit4]   2> 786983 INFO  (OverseerStateUpdate-72087724544491525-127.0.0.1:53195_solr-n_0000000000) [n:127.0.0.1:53195_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 786990 INFO  (jetty-launcher-2100-thread-1) [n:127.0.0.1:53195_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 786990 WARN  (jetty-launcher-2100-thread-1) [n:127.0.0.1:53195_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 787022 INFO  (jetty-launcher-2100-thread-1) [n:127.0.0.1:53195_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 787054 INFO  (jetty-launcher-2100-thread-1) [n:127.0.0.1:53195_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53195.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@60b1c16f
   [junit4]   2> 787082 INFO  (jetty-launcher-2100-thread-1) [n:127.0.0.1:53195_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53195.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@60b1c16f
   [junit4]   2> 787083 INFO  (jetty-launcher-2100-thread-1) [n:127.0.0.1:53195_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53195.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@60b1c16f
   [junit4]   2> 787086 INFO  (jetty-launcher-2100-thread-1) [n:127.0.0.1:53195_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestWaitForStateWithJettyShutdowns_D58593425AEC91F0-001/tempDir-001/node1/.
   [junit4]   2> 787111 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=1
   [junit4]   2> 787112 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 787119 INFO  (zkConnectionManagerCallback-2120-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 787119 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 787126 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 787136 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:53185/solr ready
   [junit4]   2> 787136 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.TestWaitForStateWithJettyShutdowns Create our collection
   [junit4]   2> 787141 INFO  (qtp1893495455-8945) [n:127.0.0.1:53195_solr     ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=_default&name=test_col&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 787179 INFO  (OverseerThreadFactory-2410-thread-1-processing-n:127.0.0.1:53195_solr) [n:127.0.0.1:53195_solr     ] o.a.s.c.a.c.CreateCollectionCmd Create collection test_col
   [junit4]   2> 787343 INFO  (OverseerStateUpdate-72087724544491525-127.0.0.1:53195_solr-n_0000000000) [n:127.0.0.1:53195_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"test_col",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"test_col_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:53195/solr",
   [junit4]   2>   "node_name":"127.0.0.1:53195_solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 787557 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr    x:test_col_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=_default&newCollection=true&name=test_col_shard1_replica_n1&action=CREATE&numShards=1&collection=test_col&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 787557 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr    x:test_col_shard1_replica_n1 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 787605 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
   [junit4]   2> 787642 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.s.IndexSchema [test_col_shard1_replica_n1] Schema name=default-config
   [junit4]   2> 788400 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema default-config/1.6 with uniqueid field id
   [junit4]   2> 788400 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'test_col_shard1_replica_n1' using configuration from configset _default, trusted=true
   [junit4]   2> 788401 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53195.solr.core.test_col.shard1.replica_n1' (registry 'solr.core.test_col.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@60b1c16f
   [junit4]   2> 788402 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.SolrCore [[test_col_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestWaitForStateWithJettyShutdowns_D58593425AEC91F0-001/tempDir-001/node1/test_col_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestWaitForStateWithJettyShutdowns_D58593425AEC91F0-001/tempDir-001/node1/./test_col_shard1_replica_n1/data/]
   [junit4]   2> 788592 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 788592 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 788598 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: if uncommitted for 15000ms; 
   [junit4]   2> 788598 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 788602 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@62952383[test_col_shard1_replica_n1] main]
   [junit4]   2> 788607 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/_default
   [junit4]   2> 788608 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/_default
   [junit4]   2> 788608 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/_default/managed-schema
   [junit4]   2> 788611 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 788612 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 788612 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.s.DirectSolrSpellChecker init: {name=default, field=_text_, classname=solr.DirectSolrSpellChecker, distanceMeasure=internal, accuracy=0.5, maxEdits=2, minPrefix=1, maxInspections=5, minQueryLength=4, maxQueryFrequency=0.01}
   [junit4]   2> 788613 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 788613 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1658900644502700032
   [junit4]   2> 788618 INFO  (searcherExecutor-2415-thread-1-processing-n:127.0.0.1:53195_solr x:test_col_shard1_replica_n1 c:test_col s:shard1 r:core_node2) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.QuerySenderListener QuerySenderListener sending requests to Searcher@62952383[test_col_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 788618 INFO  (searcherExecutor-2415-thread-1-processing-n:127.0.0.1:53195_solr x:test_col_shard1_replica_n1 c:test_col s:shard1 r:core_node2) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.QuerySenderListener QuerySenderListener done.
   [junit4]   2> 788618 INFO  (searcherExecutor-2415-thread-1-processing-n:127.0.0.1:53195_solr x:test_col_shard1_replica_n1 c:test_col s:shard1 r:core_node2) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 788619 INFO  (searcherExecutor-2415-thread-1-processing-n:127.0.0.1:53195_solr x:test_col_shard1_replica_n1 c:test_col s:shard1 r:core_node2) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.SolrCore [test_col_shard1_replica_n1] Registered new searcher Searcher@62952383[test_col_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 788630 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/test_col/terms/shard1 to Terms{values={core_node2=0}, version=0}
   [junit4]   2> 788631 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/test_col/leaders/shard1
   [junit4]   2> 788645 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 788645 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 788645 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:53195/solr/test_col_shard1_replica_n1/
   [junit4]   2> 788649 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 788651 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.SyncStrategy http://127.0.0.1:53195/solr/test_col_shard1_replica_n1/ has no replicas
   [junit4]   2> 788653 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/test_col/leaders/shard1/leader after winning as /collections/test_col/leader_elect/shard1/election/72087724544491525-core_node2-n_0000000000
   [junit4]   2> 788674 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:53195/solr/test_col_shard1_replica_n1/ shard1
   [junit4]   2> 788784 INFO  (zkCallback-2110-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 788784 INFO  (zkCallback-2110-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 788788 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 788794 INFO  (qtp1893495455-8947) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=_default&newCollection=true&name=test_col_shard1_replica_n1&action=CREATE&numShards=1&collection=test_col&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1238
   [junit4]   2> 788798 INFO  (qtp1893495455-8945) [n:127.0.0.1:53195_solr     ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
   [junit4]   2> 788903 INFO  (zkCallback-2110-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 788903 INFO  (zkCallback-2110-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 788904 INFO  (zkCallback-2110-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 788912 INFO  (qtp1893495455-8945) [n:127.0.0.1:53195_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=_default&name=test_col&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=1771
   [junit4]   2> 788913 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.TestWaitForStateWithJettyShutdowns Sanity check that our collection has come online
   [junit4]   2> 788922 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.SolrCloudTestCase active replica count: 1 expected replica count: 1
   [junit4]   2> 788923 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.SolrCloudTestCase active replica count: 1 expected replica count: 1
   [junit4]   2> 788924 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.SolrCloudTestCase active replica count: 1 expected replica count: 1
   [junit4]   2> 788925 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.TestWaitForStateWithJettyShutdowns Awaiting latch...
   [junit4]   2> 788927 INFO  (background_executor-2401-thread-1) [     ] o.a.s.c.SolrCloudTestCase active replica count: 1 expected replica count: 0
   [junit4]   2> 788927 INFO  (background_executor-2401-thread-1) [     ] o.a.s.c.TestWaitForStateWithJettyShutdowns Predicate called: result=false, (pre)latch=2, liveNodes=[127.0.0.1:53195_solr], state=DocCollection(test_col//collections/test_col/state.json/4)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{"core_node2":{
   [junit4]   2>           "core":"test_col_shard1_replica_n1",
   [junit4]   2>           "base_url":"http://127.0.0.1:53195/solr",
   [junit4]   2>           "node_name":"127.0.0.1:53195_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "force_set_state":"false",
   [junit4]   2>           "leader":"true"}}}},
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "tlogReplicas":"0"}
   [junit4]   2> 788927 INFO  (background_executor-2401-thread-1) [     ] o.a.s.c.SolrCloudTestCase active replica count: 1 expected replica count: 0
   [junit4]   2> 788927 INFO  (background_executor-2401-thread-1) [     ] o.a.s.c.TestWaitForStateWithJettyShutdowns Predicate called: result=false, (pre)latch=1, liveNodes=[127.0.0.1:53195_solr], state=DocCollection(test_col//collections/test_col/state.json/4)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{"core_node2":{
   [junit4]   2>           "core":"test_col_shard1_replica_n1",
   [junit4]   2>           "base_url":"http://127.0.0.1:53195/solr",
   [junit4]   2>           "node_name":"127.0.0.1:53195_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "force_set_state":"false",
   [junit4]   2>           "leader":"true"}}}},
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "tlogReplicas":"0"}
   [junit4]   2> 788927 INFO  (watches-2117-thread-1) [     ] o.a.s.c.SolrCloudTestCase active replica count: 1 expected replica count: 0
   [junit4]   2> 788928 INFO  (background_executor-2401-thread-1) [     ] o.a.s.c.SolrCloudTestCase active replica count: 1 expected replica count: 0
   [junit4]   2> 788928 INFO  (background_executor-2401-thread-1) [     ] o.a.s.c.TestWaitForStateWithJettyShutdowns Predicate called: result=false, (pre)latch=0, liveNodes=[127.0.0.1:53195_solr], state=DocCollection(test_col//collections/test_col/state.json/4)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{"core_node2":{
   [junit4]   2>           "core":"test_col_shard1_replica_n1",
   [junit4]   2>           "base_url":"http://127.0.0.1:53195/solr",
   [junit4]   2>           "node_name":"127.0.0.1:53195_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "force_set_state":"false",
   [junit4]   2>           "leader":"true"}}}},
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "tlogReplicas":"0"}
   [junit4]   2> 788928 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.TestWaitForStateWithJettyShutdowns Shutdown 1 node
   [junit4]   2> 788927 INFO  (watches-2117-thread-1) [     ] o.a.s.c.TestWaitForStateWithJettyShutdowns Predicate called: result=false, (pre)latch=0, liveNodes=[127.0.0.1:53195_solr], state=DocCollection(test_col//collections/test_col/state.json/4)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{"core_node2":{
   [junit4]   2>           "core":"test_col_shard1_replica_n1",
   [junit4]   2>           "base_url":"http://127.0.0.1:53195/solr",
   [junit4]   2>           "node_name":"127.0.0.1:53195_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "force_set_state":"false",
   [junit4]   2>           "leader":"true"}}}},
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "tlogReplicas":"0"}
   [junit4]   2> 788928 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=817576995
   [junit4]   2> 788928 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:53195_solr
   [junit4]   2> 788930 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkController Publish this node as DOWN...
   [junit4]   2> 788930 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkController Publish node=127.0.0.1:53195_solr as DOWN
   [junit4]   2> 788936 INFO  (coreCloseExecutor-2420-thread-1) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.SolrCore [test_col_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@3a5bbfc1
   [junit4]   2> 788936 INFO  (coreCloseExecutor-2420-thread-1) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.test_col.shard1.replica_n1, tag=SolrCore@3a5bbfc1
   [junit4]   2> 788936 INFO  (coreCloseExecutor-2420-thread-1) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2bf97c59: rootName = solr_53195, domain = solr.core.test_col.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.test_col.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@dab25a9
   [junit4]   2> 788949 INFO  (coreCloseExecutor-2420-thread-1) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.test_col.shard1.leader, tag=SolrCore@3a5bbfc1
   [junit4]   2> 788949 INFO  (coreCloseExecutor-2420-thread-1) [n:127.0.0.1:53195_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 788955 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 788956 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@291e6fc3: rootName = solr_53195, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@43ef2e96
   [junit4]   2> 788977 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 788977 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3c624ecc: rootName = solr_53195, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@56c45e38
   [junit4]   2> 788981 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 788981 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6f0f2988: rootName = solr_53195, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@4068f2bf
   [junit4]   2> 788981 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 788986 INFO  (closeThreadPool-2125-thread-1) [     ] o.a.s.c.Overseer Overseer (id=72087724544491525-127.0.0.1:53195_solr-n_0000000000) closing
   [junit4]   2> 788986 INFO  (OverseerStateUpdate-72087724544491525-127.0.0.1:53195_solr-n_0000000000) [n:127.0.0.1:53195_solr     ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:53195_solr
   [junit4]   2> 788989 INFO  (OverseerAutoScalingTriggerThread-72087724544491525-127.0.0.1:53195_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 788997 INFO  (closeThreadPool-2125-thread-2) [     ] o.a.s.c.Overseer Overseer (id=72087724544491525-127.0.0.1:53195_solr-n_0000000000) closing
   [junit4]   2> 789002 INFO  (zkCallback-2119-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 789002 INFO  (zkCallback-2119-thread-1) [     ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
   [junit4]   2> 789002 INFO  (zkCallback-2119-thread-1) [     ] o.a.s.c.TestWaitForStateWithJettyShutdowns Predicate called: result=true, (pre)latch=0, liveNodes=[], state=DocCollection(test_col//collections/test_col/state.json/4)={
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active",
   [junit4]   2>       "replicas":{"core_node2":{
   [junit4]   2>           "core":"test_col_shard1_replica_n1",
   [junit4]   2>           "base_url":"http://127.0.0.1:53195/solr",
   [junit4]   2>           "node_name":"127.0.0.1:53195_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "force_set_state":"false",
   [junit4]   2>           "leader":"true"}}}},
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"1",
   [junit4]   2>   "tlogReplicas":"0"}
   [junit4]   2> 789110 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.Overseer Overseer (id=72087724544491525-127.0.0.1:53195_solr-n_0000000000) closing
   [junit4]   2> 789120 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@7e1b82f4{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
   [junit4]   2> 789122 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4a1e4412{/solr,null,UNAVAILABLE}
   [junit4]   2> 789123 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 789125 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.TestWaitForStateWithJettyShutdowns Wait to confirm our node is fully shutdown
   [junit4]   2> 789125 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.MiniSolrCloudCluster waitForJettyToStop: 53195
   [junit4]   2> 789125 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.TestWaitForStateWithJettyShutdowns Checking Future result to see if waitForState finished successfully
   [junit4]   2> 789240 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 789471 WARN  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	2	/solr/aliases.json
   [junit4]   2> 	2	/solr/collections/test_col/terms/shard1
   [junit4]   2> 	2	/solr/clusterprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	11	/solr/collections/test_col/state.json
   [junit4]   2> 	2	/solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	12	/solr/overseer/queue
   [junit4]   2> 	4	/solr/live_nodes
   [junit4]   2> 	4	/solr/collections
   [junit4]   2> 	4	/solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> 789501 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:53185
   [junit4]   2> 789501 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:53185
   [junit4]   2> 789501 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 53185
   [junit4]   2> 789510 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testWaitForStateBeforeShutDown
   [junit4]   2> 789521 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testWaitForStateAfterShutDown
   [junit4]   2> 789522 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestWaitForStateWithJettyShutdowns_D58593425AEC91F0-001/tempDir-002
   [junit4]   2> 789522 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 789527 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 789528 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 789629 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkTestServer start zk server on port:53265
   [junit4]   2> 789629 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:53265
   [junit4]   2> 789629 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:53265
   [junit4]   2> 789629 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 53265
   [junit4]   2> 789643 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 789655 INFO  (zkConnectionManagerCallback-2128-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 789657 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 789677 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 789682 INFO  (zkConnectionManagerCallback-2130-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 789684 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 789690 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 789696 INFO  (zkConnectionManagerCallback-2132-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 789704 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 789836 WARN  (jetty-launcher-2133-thread-1) [     ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
   [junit4]   2> 789836 INFO  (jetty-launcher-2133-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 789836 INFO  (jetty-launcher-2133-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 789836 INFO  (jetty-launcher-2133-thread-1) [     ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 13.0.2+8
   [junit4]   2> 789839 INFO  (jetty-launcher-2133-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 789839 INFO  (jetty-launcher-2133-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 789839 INFO  (jetty-launcher-2133-thread-1) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 789841 INFO  (jetty-launcher-2133-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@68e1ed2a{/solr,null,AVAILABLE}
   [junit4]   2> 789843 INFO  (jetty-launcher-2133-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@68c4545b{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:53277}
   [junit4]   2> 789844 INFO  (jetty-launcher-2133-thread-1) [     ] o.e.j.s.Server Started @789889ms
   [junit4]   2> 789844 INFO  (jetty-launcher-2133-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=53277}
   [junit4]   2> 789845 ERROR (jetty-launcher-2133-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 789845 INFO  (jetty-launcher-2133-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 789845 INFO  (jetty-launcher-2133-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 9.0.0
   [junit4]   2> 789845 INFO  (jetty-launcher-2133-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 789846 INFO  (jetty-launcher-2133-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
   [junit4]   2> 789846 INFO  (jetty-launcher-2133-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2020-02-18T18:35:39.365128Z
   [junit4]   2> 789849 INFO  (jetty-launcher-2133-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 789862 INFO  (zkConnectionManagerCallback-2135-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 789862 INFO  (jetty-launcher-2133-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 789864 INFO  (jetty-launcher-2133-thread-1) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 790468 INFO  (jetty-launcher-2133-thread-1) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 790474 WARN  (jetty-launcher-2133-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@7df26c1e[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 790475 WARN  (jetty-launcher-2133-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@7df26c1e[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 790489 WARN  (jetty-launcher-2133-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@708c23[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 790489 WARN  (jetty-launcher-2133-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@708c23[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 790491 INFO  (jetty-launcher-2133-thread-1) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53265/solr
   [junit4]   2> 790494 INFO  (jetty-launcher-2133-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 790500 INFO  (zkConnectionManagerCallback-2142-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 790501 INFO  (jetty-launcher-2133-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 790618 INFO  (jetty-launcher-2133-thread-1) [n:127.0.0.1:53277_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 790633 INFO  (zkConnectionManagerCallback-2144-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 790634 INFO  (jetty-launcher-2133-thread-1) [n:127.0.0.1:53277_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 791446 INFO  (jetty-launcher-2133-thread-1) [n:127.0.0.1:53277_solr     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:53277_solr
   [junit4]   2> 791450 INFO  (jetty-launcher-2133-thread-1) [n:127.0.0.1:53277_solr     ] o.a.s.c.Overseer Overseer (id=72087724778586117-127.0.0.1:53277_solr-n_0000000000) starting
   [junit4]   2> 791495 INFO  (OverseerStateUpdate-72087724778586117-127.0.0.1:53277_solr-n_0000000000) [n:127.0.0.1:53277_solr     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:53277_solr
   [junit4]   2> 791498 INFO  (jetty-launcher-2133-thread-1) [n:127.0.0.1:53277_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53277_solr
   [junit4]   2> 791506 INFO  (zkCallback-2143-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 791517 INFO  (jetty-launcher-2133-thread-1) [n:127.0.0.1:53277_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 791518 WARN  (jetty-launcher-2133-thread-1) [n:127.0.0.1:53277_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 791556 INFO  (jetty-launcher-2133-thread-1) [n:127.0.0.1:53277_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 791585 INFO  (jetty-launcher-2133-thread-1) [n:127.0.0.1:53277_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53277.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@60b1c16f
   [junit4]   2> 791596 INFO  (jetty-launcher-2133-thread-1) [n:127.0.0.1:53277_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53277.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@60b1c16f
   [junit4]   2> 791596 INFO  (jetty-launcher-2133-thread-1) [n:127.0.0.1:53277_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53277.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@60b1c16f
   [junit4]   2> 791601 INFO  (jetty-launcher-2133-thread-1) [n:127.0.0.1:53277_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestWaitForStateWithJettyShutdowns_D58593425AEC91F0-001/tempDir-002/node1/.
   [junit4]   2> 791641 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=1
   [junit4]   2> 791661 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 791680 INFO  (zkConnectionManagerCallback-2153-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 791681 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 791687 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 791704 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:53265/solr ready
   [junit4]   2> 791704 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.TestWaitForStateWithJettyShutdowns Create our collection
   [junit4]   2> 791709 INFO  (qtp1711515371-9037) [n:127.0.0.1:53277_solr     ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=_default&name=test_col&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 791724 INFO  (OverseerThreadFactory-2430-thread-1-processing-n:127.0.0.1:53277_solr) [n:127.0.0.1:53277_solr     ] o.a.s.c.a.c.CreateCollectionCmd Create collection test_col
   [junit4]   2> 791865 INFO  (OverseerStateUpdate-72087724778586117-127.0.0.1:53277_solr-n_0000000000) [n:127.0.0.1:53277_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"test_col",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"test_col_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:53277/solr",
   [junit4]   2>   "node_name":"127.0.0.1:53277_solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 792075 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr    x:test_col_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=_default&newCollection=true&name=test_col_shard1_replica_n1&action=CREATE&numShards=1&collection=test_col&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 792076 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr    x:test_col_shard1_replica_n1 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 792195 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
   [junit4]   2> 792284 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.s.IndexSchema [test_col_shard1_replica_n1] Schema name=default-config
   [junit4]   2> 792539 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema default-config/1.6 with uniqueid field id
   [junit4]   2> 792539 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'test_col_shard1_replica_n1' using configuration from configset _default, trusted=true
   [junit4]   2> 792540 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53277.solr.core.test_col.shard1.replica_n1' (registry 'solr.core.test_col.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@60b1c16f
   [junit4]   2> 792540 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.SolrCore [[test_col_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestWaitForStateWithJettyShutdowns_D58593425AEC91F0-001/tempDir-002/node1/test_col_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestWaitForStateWithJettyShutdowns_D58593425AEC91F0-001/tempDir-002/node1/./test_col_shard1_replica_n1/data/]
   [junit4]   2> 792827 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 792827 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 792829 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: if uncommitted for 15000ms; 
   [junit4]   2> 792829 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 792830 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@2b421402[test_col_shard1_replica_n1] main]
   [junit4]   2> 792836 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/_default
   [junit4]   2> 792851 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/_default
   [junit4]   2> 792851 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/_default/managed-schema
   [junit4]   2> 792853 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 792854 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 792854 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.s.DirectSolrSpellChecker init: {name=default, field=_text_, classname=solr.DirectSolrSpellChecker, distanceMeasure=internal, accuracy=0.5, maxEdits=2, minPrefix=1, maxInspections=5, minQueryLength=4, maxQueryFrequency=0.01}
   [junit4]   2> 792856 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 792856 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1658900648951808000
   [junit4]   2> 792861 INFO  (searcherExecutor-2435-thread-1-processing-n:127.0.0.1:53277_solr x:test_col_shard1_replica_n1 c:test_col s:shard1 r:core_node2) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.QuerySenderListener QuerySenderListener sending requests to Searcher@2b421402[test_col_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 792861 INFO  (searcherExecutor-2435-thread-1-processing-n:127.0.0.1:53277_solr x:test_col_shard1_replica_n1 c:test_col s:shard1 r:core_node2) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.QuerySenderListener QuerySenderListener done.
   [junit4]   2> 792861 INFO  (searcherExecutor-2435-thread-1-processing-n:127.0.0.1:53277_solr x:test_col_shard1_replica_n1 c:test_col s:shard1 r:core_node2) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 792862 INFO  (searcherExecutor-2435-thread-1-processing-n:127.0.0.1:53277_solr x:test_col_shard1_replica_n1 c:test_col s:shard1 r:core_node2) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.SolrCore [test_col_shard1_replica_n1] Registered new searcher Searcher@2b421402[test_col_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 792881 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/test_col/terms/shard1 to Terms{values={core_node2=0}, version=0}
   [junit4]   2> 792883 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/test_col/leaders/shard1
   [junit4]   2> 792919 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 792919 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 792922 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:53277/solr/test_col_shard1_replica_n1/
   [junit4]   2> 792924 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 792930 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.SyncStrategy http://127.0.0.1:53277/solr/test_col_shard1_replica_n1/ has no replicas
   [junit4]   2> 792930 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/test_col/leaders/shard1/leader after winning as /collections/test_col/leader_elect/shard1/election/72087724778586117-core_node2-n_0000000000
   [junit4]   2> 792950 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:53277/solr/test_col_shard1_replica_n1/ shard1
   [junit4]   2> 793065 INFO  (zkCallback-2143-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 793073 INFO  (zkCallback-2143-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 793078 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 793085 INFO  (qtp1711515371-9039) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=_default&newCollection=true&name=test_col_shard1_replica_n1&action=CREATE&numShards=1&collection=test_col&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1009
   [junit4]   2> 793090 INFO  (qtp1711515371-9037) [n:127.0.0.1:53277_solr     ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
   [junit4]   2> 793188 INFO  (zkCallback-2143-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 793188 INFO  (zkCallback-2143-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 793188 INFO  (zkCallback-2143-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 793190 INFO  (qtp1711515371-9037) [n:127.0.0.1:53277_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=_default&name=test_col&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=1480
   [junit4]   2> 793190 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.TestWaitForStateWithJettyShutdowns Sanity check that our collection has come online
   [junit4]   2> 793192 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.SolrCloudTestCase active replica count: 1 expected replica count: 1
   [junit4]   2> 793194 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.SolrCloudTestCase active replica count: 1 expected replica count: 1
   [junit4]   2> 793195 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.SolrCloudTestCase active replica count: 1 expected replica count: 1
   [junit4]   2> 793195 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.TestWaitForStateWithJettyShutdowns Shutdown 1 node
   [junit4]   2> 793195 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1114177190
   [junit4]   2> 793196 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:53277_solr
   [junit4]   2> 793197 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkController Publish this node as DOWN...
   [junit4]   2> 793197 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkController Publish node=127.0.0.1:53277_solr as DOWN
   [junit4]   2> 793204 INFO  (coreCloseExecutor-2440-thread-1) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.c.SolrCore [test_col_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@64bcf8d3
   [junit4]   2> 793204 INFO  (coreCloseExecutor-2440-thread-1) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.test_col.shard1.replica_n1, tag=SolrCore@64bcf8d3
   [junit4]   2> 793205 INFO  (coreCloseExecutor-2440-thread-1) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@638b7614: rootName = solr_53277, domain = solr.core.test_col.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.test_col.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@27624518
   [junit4]   2> 793214 INFO  (coreCloseExecutor-2440-thread-1) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.test_col.shard1.leader, tag=SolrCore@64bcf8d3
   [junit4]   2> 793214 INFO  (coreCloseExecutor-2440-thread-1) [n:127.0.0.1:53277_solr c:test_col s:shard1 r:core_node2 x:test_col_shard1_replica_n1 ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 793219 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 793219 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3bcbf81e: rootName = solr_53277, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@96d7bf0
   [junit4]   2> 793227 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 793227 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3d89ff6d: rootName = solr_53277, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@56c45e38
   [junit4]   2> 793231 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 793231 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@620c4ddd: rootName = solr_53277, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@4068f2bf
   [junit4]   2> 793231 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 793232 INFO  (closeThreadPool-2158-thread-2) [     ] o.a.s.c.Overseer Overseer (id=72087724778586117-127.0.0.1:53277_solr-n_0000000000) closing
   [junit4]   2> 793232 INFO  (OverseerStateUpdate-72087724778586117-127.0.0.1:53277_solr-n_0000000000) [n:127.0.0.1:53277_solr     ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:53277_solr
   [junit4]   2> 793233 INFO  (OverseerAutoScalingTriggerThread-72087724778586117-127.0.0.1:53277_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 793243 INFO  (closeThreadPool-2158-thread-1) [     ] o.a.s.c.Overseer Overseer (id=72087724778586117-127.0.0.1:53277_solr-n_0000000000) closing
   [junit4]   2> 793244 INFO  (zkCallback-2152-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 793354 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.Overseer Overseer (id=72087724778586117-127.0.0.1:53277_solr-n_0000000000) closing
   [junit4]   2> 793358 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@68c4545b{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
   [junit4]   2> 793358 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@68e1ed2a{/solr,null,UNAVAILABLE}
   [junit4]   2> 793359 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 793361 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.TestWaitForStateWithJettyShutdowns Wait to confirm our node is fully shutdown
   [junit4]   2> 793361 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.MiniSolrCloudCluster waitForJettyToStop: 53277
   [junit4]   2> 793361 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.TestWaitForStateWithJettyShutdowns Now check if waitForState will recognize we already have the exepcted state
   [junit4]   2> 793363 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
   [junit4]   2> 793363 INFO  (watches-2150-thread-1) [     ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
   [junit4]   2> 793364 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
   [junit4]   2> 793365 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
   [junit4]   2> 793475 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 793694 WARN  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	2	/solr/aliases.json
   [junit4]   2> 	2	/solr/collections/test_col/terms/shard1
   [junit4]   2> 	2	/solr/clusterprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	11	/solr/collections/test_col/state.json
   [junit4]   2> 	2	/solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	12	/solr/overseer/queue
   [junit4]   2> 	4	/solr/live_nodes
   [junit4]   2> 	4	/solr/collections
   [junit4]   2> 	4	/solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> 793699 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:53265
   [junit4]   2> 793699 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:53265
   [junit4]   2> 793699 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 53265
   [junit4]   2> 793700 INFO  (TEST-TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown-seed#[D58593425AEC91F0]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testWaitForStateAfterShutDown
   [junit4]   2> 793701 INFO  (SUITE-TestWaitForStateWithJettyShutdowns-seed#[D58593425AEC91F0]-worker) [     ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> Feb 18, 2020 6:35:43 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> Feb 18, 2020 6:35:53 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.cloud.TestWaitForStateWithJettyShutdowns: 
   [junit4]   2>    1) Thread[id=9007, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestWaitForStateWithJettyShutdowns]
   [junit4]   2>         at java.base@13.0.2/java.lang.Thread.sleep(Native Method)
   [junit4]   2>         at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
   [junit4]   2> Feb 18, 2020 6:35:53 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=9007, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestWaitForStateWithJettyShutdowns]
   [junit4]   2> 803730 ERROR (SessionTracker) [     ] o.a.z.s.ZooKeeperCriticalThread Severe unrecoverable error, from thread : SessionTracker
   [junit4]   2>           => java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 	at java.base/java.lang.Thread.sleep(Native Method)
   [junit4]   2> java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 	at java.lang.Thread.sleep(Native Method) [?:?]
   [junit4]   2> 	at org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) ~[zookeeper-3.5.5.jar:3.5.5]
   [junit4]   2> Feb 18, 2020 6:35:53 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: All leaked threads terminated.
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@4146f269), locale=ta, timezone=America/Chihuahua
   [junit4]   2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 13.0.2 (64-bit)/cpus=6,threads=1,free=234691368,total=329777152
   [junit4]   2> NOTE: All tests run in this JVM: [TestSimNodeLostTrigger, TestPayloadCheckQParserPlugin, TestSchemaVersionResource, TestTlogReplayVsRecovery, TestDocTermOrds, TestSchemalessBufferedUpdates, TestRTGBase, TestDistributedMissingSort, TestFastOutputStream, InfixSuggestersTest, TestSolrCachePerf, TriggerSetPropertiesIntegrationTest, TestRestoreCore, TestStressThreadBackup, SolrMetricsIntegrationTest, TestCopyFieldCollectionResource, ResourceLoaderTest, TestCloudPivotFacet, TestJsonFacetsStatsParsing, TestPushWriter, ForceLeaderWithTlogReplicasTest, TestFieldCacheSortRandom, ChaosMonkeyNothingIsSafeWithPullReplicasTest, TestSolrCloudWithHadoopAuthPlugin, SpellingQueryConverterTest, SolrInfoBeanTest, BasicAuthOnSingleNodeTest, TestBadConfig, TestConfigSetProperties, CollectionStateFormat2Test, HttpPartitionWithTlogReplicasTest, SolrCloudReportersTest, TestCollationField, MoveReplicaTest, TestRemoteStreaming, TestOrdValues, CloudExitableDirectoryReaderTest, TestSolrIndexConfig, RulesTest, TolerantUpdateProcessorTest, SpatialHeatmapFacetsTest, PeerSyncWithBufferUpdatesTest, TestLeaderElectionWithEmptyReplica, SystemLogListenerTest, FuzzySearchTest, CollectionReloadTest, TestWaitForStateWithJettyShutdowns]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestWaitForStateWithJettyShutdowns -Dtests.seed=D58593425AEC91F0 -Dtests.slow=true -Dtests.locale=ta -Dtests.timezone=America/Chihuahua -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J0 | TestWaitForStateWithJettyShutdowns (suite) <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.TestWaitForStateWithJettyShutdowns: 
   [junit4]    >    1) Thread[id=9007, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestWaitForStateWithJettyShutdowns]
   [junit4]    >         at java.base@13.0.2/java.lang.Thread.sleep(Native Method)
   [junit4]    >         at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([D58593425AEC91F0]:0)
   [junit4] Completed [230/904 (1!)] on J0 in 17.81s, 2 tests, 1 error <<< FAILURES!

[...truncated 1 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.SearchRateTriggerTest
   [junit4]   2> 785640 INFO  (SUITE-SearchRateTriggerTest-seed#[D58593425AEC91F0]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 785640 INFO  (SUITE-SearchRateTriggerTest-seed#[D58593425AEC91F0]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 785641 INFO  (SUITE-SearchRateTriggerTest-seed#[D58593425AEC91F0]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.autoscaling.SearchRateTriggerTest_D58593425AEC91F0-001/data-dir-55-001
   [junit4]   2> 785641 WARN  (SUITE-SearchRateTriggerTest-seed#[D58593425AEC91F0]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=4 numCloses=4
   [junit4]   2> 785641 INFO  (SUITE-SearchRateTriggerTest-seed#[D58593425AEC91F0]-worker) [     ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_

[...truncated too long message...]

[     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 807377 INFO  (zkCallback-3411-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 807378 INFO  (closeThreadPool-3441-thread-1) [     ] o.a.s.c.Overseer Overseer (id=72087725771128845-127.0.0.1:53350_solr-n_0000000000) closing
   [junit4]   2> 807420 INFO  (jetty-closer-3428-thread-2) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 807420 INFO  (jetty-closer-3428-thread-2) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5a58c31d: rootName = solr_53348, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6691b970
   [junit4]   2> 807421 INFO  (jetty-closer-3428-thread-2) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 807430 INFO  (jetty-closer-3428-thread-4) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 807431 INFO  (jetty-closer-3428-thread-4) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1f0378f2: rootName = solr_53349, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6691b970
   [junit4]   2> 807432 INFO  (jetty-closer-3428-thread-4) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 807440 INFO  (jetty-closer-3428-thread-3) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 807440 INFO  (jetty-closer-3428-thread-3) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@519ce720: rootName = solr_53347, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@6691b970
   [junit4]   2> 807440 INFO  (jetty-closer-3428-thread-3) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 807478 INFO  (jetty-closer-3428-thread-1) [     ] o.a.s.c.Overseer Overseer (id=72087725771128845-127.0.0.1:53350_solr-n_0000000000) closing
   [junit4]   2> 807486 INFO  (jetty-closer-3428-thread-1) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@1a058263{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
   [junit4]   2> 807487 INFO  (jetty-closer-3428-thread-1) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1581d6e4{/solr,null,UNAVAILABLE}
   [junit4]   2> 807489 INFO  (jetty-closer-3428-thread-1) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 807546 INFO  (zkCallback-3390-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 807547 INFO  (zkCallback-3387-thread-2) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 807556 INFO  (jetty-closer-3428-thread-2) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@5d7a0edc{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
   [junit4]   2> 807557 INFO  (jetty-closer-3428-thread-2) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5b21e112{/solr,null,UNAVAILABLE}
   [junit4]   2> 807557 INFO  (jetty-closer-3428-thread-2) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 807673 INFO  (jetty-closer-3428-thread-3) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@235d0439{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
   [junit4]   2> 807674 INFO  (jetty-closer-3428-thread-3) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3edd39ad{/solr,null,UNAVAILABLE}
   [junit4]   2> 807674 INFO  (jetty-closer-3428-thread-3) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 807674 INFO  (jetty-closer-3428-thread-4) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@48d45c67{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
   [junit4]   2> 807679 INFO  (jetty-closer-3428-thread-4) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@577dcc91{/solr,null,UNAVAILABLE}
   [junit4]   2> 807679 INFO  (jetty-closer-3428-thread-4) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 807685 INFO  (TEST-SearchRateTriggerTest.testDefaultsAndBackcompat-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 807912 WARN  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/aliases.json
   [junit4]   2> 	5	/solr/clusterprops.json
   [junit4]   2> 	4	/solr/packages.json
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	21	/solr/live_nodes
   [junit4]   2> 	10	/solr/overseer/queue
   [junit4]   2> 	5	/solr/collections
   [junit4]   2> 
   [junit4]   2> 807920 INFO  (TEST-SearchRateTriggerTest.testDefaultsAndBackcompat-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:53337
   [junit4]   2> 807920 INFO  (TEST-SearchRateTriggerTest.testDefaultsAndBackcompat-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:53337
   [junit4]   2> 807920 INFO  (TEST-SearchRateTriggerTest.testDefaultsAndBackcompat-seed#[D58593425AEC91F0]) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 53337
   [junit4]   2> 807922 INFO  (TEST-SearchRateTriggerTest.testDefaultsAndBackcompat-seed#[D58593425AEC91F0]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testDefaultsAndBackcompat
   [junit4]   2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.autoscaling.SearchRateTriggerTest_D58593425AEC91F0-001
   [junit4]   2> Feb 18, 2020 6:35:57 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene84): {}, docValues:{}, maxPointsInLeafNode=83, maxMBSortInHeap=5.086216094554237, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@1f9b9ee4), locale=ha-NG, timezone=Australia/Currie
   [junit4]   2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 13.0.2 (64-bit)/cpus=6,threads=1,free=205130288,total=360185856
   [junit4]   2> NOTE: All tests run in this JVM: [BitVectorTest, TestSearchPerf, RequestHandlersTest, TestLazyCores, TestMacroExpander, TestUnifiedSolrHighlighter, TestCloudSchemaless, TestExactSharedStatsCache, QueryParsingTest, TestStressLiveNodes, AsyncCallRequestStatusResponseTest, CursorMarkTest, TestSimDistributedQueue, TestSolr4Spatial2, TestSolrDeletionPolicy2, TestSolrQueryResponse, DistributedFacetPivotSmallAdvancedTest, ForceLeaderTest, TestFieldResource, UpdateRequestProcessorFactoryTest, IndexSizeTriggerMixedBoundsTest, TestSolrCloudWithDelegationTokens, BadComponentTest, NodeMutatorTest, TestRealTimeGet, TimeRoutedAliasUpdateProcessorTest, TestQueryUtils, TestBulkSchemaAPI, TestPHPSerializedResponseWriter, TestDynamicFieldNamesIndexCorrectly, TestIntervalFaceting, ByteBuffersDirectoryFactoryTest, RequiredFieldsTest, TestStressReorder, TestImpersonationWithHadoopAuth, TestDistributedGrouping, RangeFacetCloudTest, DirectSolrSpellCheckerTest, SolrMetricReporterTest, SolrIndexSplitterTest, AddSchemaFieldsUpdateProcessorFactoryTest, TestNumericTerms32, HdfsThreadLeakTest, XCJFQueryTest, TestManagedSynonymFilterFactory, TestSafeXMLParsing, ProtectedTermFilterFactoryTest, DistribDocExpirationUpdateProcessorTest, OpenExchangeRatesOrgProviderTest, TestManagedSchemaAPI, TestSubQueryTransformerCrossCore, PrimUtilsTest, SearchRateTriggerTest]
   [junit4] Completed [231/904 (2!)] on J4 in 22.96s, 3 tests, 1 failure, 1 skipped <<< FAILURES!

[...truncated 54929 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/5679/consoleText

[repro] Revision: 2a88aa9d0f77044d9a69cadf97683cc478b49063

[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseParallelGC"
[repro] Repro line:  ant test  -Dtestcase=TestWaitForStateWithJettyShutdowns -Dtests.seed=D58593425AEC91F0 -Dtests.slow=true -Dtests.locale=ta -Dtests.timezone=America/Chihuahua -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[repro] Repro line:  ant test  -Dtestcase=SearchRateTriggerTest -Dtests.method=testWaitForElapsed -Dtests.seed=D58593425AEC91F0 -Dtests.slow=true -Dtests.locale=ha-NG -Dtests.timezone=Australia/Currie -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       TestWaitForStateWithJettyShutdowns
[repro]       SearchRateTriggerTest
[repro] ant compile-test

[...truncated 3168 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=10 -Dtests.class="*.TestWaitForStateWithJettyShutdowns|*.SearchRateTriggerTest" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseParallelGC" -Dtests.seed=D58593425AEC91F0 -Dtests.slow=true -Dtests.locale=ta -Dtests.timezone=America/Chihuahua -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[...truncated 121 lines...]
[repro] Failures w/original seeds:
[repro]   0/5 failed: org.apache.solr.cloud.TestWaitForStateWithJettyShutdowns
[repro]   0/5 failed: org.apache.solr.cloud.autoscaling.SearchRateTriggerTest
[repro] Exiting with code 0

[...truncated 73 lines...]

[JENKINS] Lucene-Solr-master-MacOSX (64bit/jdk-13.0.2) - Build # 5681 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/5681/
Java: 64bit/jdk-13.0.2 -XX:-UseCompressedOops -XX:+UseG1GC

1 tests failed.
FAILED:  org.apache.solr.cloud.TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess

Error Message:
No registered leader was found after waiting for 4000ms , collection: testPeersyncFailureReplicationSuccess slice: shard1 saw state=DocCollection(testPeersyncFailureReplicationSuccess//collections/testPeersyncFailureReplicationSuccess/state.json/10)={   "pullReplicas":"0",   "replicationFactor":"1",   "shards":{"shard1":{       "range":"80000000-7fffffff",       "state":"active",       "replicas":{         "core_node2":{           "core":"testPeersyncFailureReplicationSuccess_shard1_replica_n1",           "base_url":"http://127.0.0.1:52172/solr",           "node_name":"127.0.0.1:52172_solr",           "state":"down",           "type":"NRT",           "force_set_state":"false"},         "core_node4":{           "core":"testPeersyncFailureReplicationSuccess_shard1_replica_n3",           "base_url":"http://127.0.0.1:52212/solr",           "node_name":"127.0.0.1:52212_solr",           "state":"active",           "type":"NRT",           "force_set_state":"false"}}}},   "router":{"name":"compositeId"},   "maxShardsPerNode":"2",   "autoAddReplicas":"false",   "nrtReplicas":"1",   "tlogReplicas":"0"} with live_nodes=[127.0.0.1:52212_solr]

Stack Trace:
org.apache.solr.common.SolrException: No registered leader was found after waiting for 4000ms , collection: testPeersyncFailureReplicationSuccess slice: shard1 saw state=DocCollection(testPeersyncFailureReplicationSuccess//collections/testPeersyncFailureReplicationSuccess/state.json/10)={
  "pullReplicas":"0",
  "replicationFactor":"1",
  "shards":{"shard1":{
      "range":"80000000-7fffffff",
      "state":"active",
      "replicas":{
        "core_node2":{
          "core":"testPeersyncFailureReplicationSuccess_shard1_replica_n1",
          "base_url":"http://127.0.0.1:52172/solr",
          "node_name":"127.0.0.1:52172_solr",
          "state":"down",
          "type":"NRT",
          "force_set_state":"false"},
        "core_node4":{
          "core":"testPeersyncFailureReplicationSuccess_shard1_replica_n3",
          "base_url":"http://127.0.0.1:52212/solr",
          "node_name":"127.0.0.1:52212_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false"}}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"2",
  "autoAddReplicas":"false",
  "nrtReplicas":"1",
  "tlogReplicas":"0"} with live_nodes=[127.0.0.1:52212_solr]
	at __randomizedtesting.SeedInfo.seed([E66EF1E9351B9DF6:323F92A6E4A5AA95]:0)
	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:979)
	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:956)
	at org.apache.solr.cloud.TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess(TestCloudSearcherWarming.java:205)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:567)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
	at java.base/java.lang.Thread.run(Thread.java:830)




Build Log:
[...truncated 13296 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestCloudSearcherWarming
   [junit4]   2> 707239 INFO  (SUITE-TestCloudSearcherWarming-seed#[E66EF1E9351B9DF6]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 707240 INFO  (SUITE-TestCloudSearcherWarming-seed#[E66EF1E9351B9DF6]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 707244 INFO  (SUITE-TestCloudSearcherWarming-seed#[E66EF1E9351B9DF6]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.TestCloudSearcherWarming_E66EF1E9351B9DF6-001/data-dir-32-001
   [junit4]   2> 707244 WARN  (SUITE-TestCloudSearcherWarming-seed#[E66EF1E9351B9DF6]-worker) [     ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=27 numCloses=27
   [junit4]   2> 707258 INFO  (SUITE-TestCloudSearcherWarming-seed#[E66EF1E9351B9DF6]-worker) [     ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 707259 INFO  (SUITE-TestCloudSearcherWarming-seed#[E66EF1E9351B9DF6]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
   [junit4]   2> 707289 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testRepFactor1LeaderStartup
   [junit4]   2> 707290 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.TestCloudSearcherWarming_E66EF1E9351B9DF6-001/tempDir-001
   [junit4]   2> 707290 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 707290 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 707290 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 707390 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.ZkTestServer start zk server on port:52092
   [junit4]   2> 707391 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:52092
   [junit4]   2> 707391 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:52092
   [junit4]   2> 707391 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 52092
   [junit4]   2> 707404 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 707436 INFO  (zkConnectionManagerCallback-1752-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 707438 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 707465 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 707481 INFO  (zkConnectionManagerCallback-1754-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 707482 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 707483 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 707502 INFO  (zkConnectionManagerCallback-1756-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 707502 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 707645 WARN  (jetty-launcher-1757-thread-1) [     ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
   [junit4]   2> 707645 INFO  (jetty-launcher-1757-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 707645 INFO  (jetty-launcher-1757-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 707645 INFO  (jetty-launcher-1757-thread-1) [     ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 13.0.2+8
   [junit4]   2> 707648 INFO  (jetty-launcher-1757-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 707648 INFO  (jetty-launcher-1757-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 707648 INFO  (jetty-launcher-1757-thread-1) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 707649 INFO  (jetty-launcher-1757-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@52669523{/solr,null,AVAILABLE}
   [junit4]   2> 707662 INFO  (jetty-launcher-1757-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@523af747{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:52098}
   [junit4]   2> 707662 INFO  (jetty-launcher-1757-thread-1) [     ] o.e.j.s.Server Started @707727ms
   [junit4]   2> 707662 INFO  (jetty-launcher-1757-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=52098}
   [junit4]   2> 707663 ERROR (jetty-launcher-1757-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 707663 INFO  (jetty-launcher-1757-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 707663 INFO  (jetty-launcher-1757-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 9.0.0
   [junit4]   2> 707663 INFO  (jetty-launcher-1757-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 707663 INFO  (jetty-launcher-1757-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
   [junit4]   2> 707663 INFO  (jetty-launcher-1757-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2020-02-19T05:41:54.937678Z
   [junit4]   2> 707667 INFO  (jetty-launcher-1757-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 707684 INFO  (zkConnectionManagerCallback-1759-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 707684 INFO  (jetty-launcher-1757-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 707692 INFO  (jetty-launcher-1757-thread-1) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 708079 INFO  (jetty-launcher-1757-thread-1) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 708083 WARN  (jetty-launcher-1757-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@2b277d46[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 708084 WARN  (jetty-launcher-1757-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@2b277d46[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 708089 WARN  (jetty-launcher-1757-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@1a2bfe00[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 708090 WARN  (jetty-launcher-1757-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@1a2bfe00[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 708091 INFO  (jetty-launcher-1757-thread-1) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:52092/solr
   [junit4]   2> 708093 INFO  (jetty-launcher-1757-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 708095 INFO  (zkConnectionManagerCallback-1766-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 708095 INFO  (jetty-launcher-1757-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 708216 INFO  (jetty-launcher-1757-thread-1) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 708220 INFO  (zkConnectionManagerCallback-1768-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 708220 INFO  (jetty-launcher-1757-thread-1) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 708533 INFO  (jetty-launcher-1757-thread-1) [n:127.0.0.1:52098_solr     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:52098_solr
   [junit4]   2> 708536 INFO  (jetty-launcher-1757-thread-1) [n:127.0.0.1:52098_solr     ] o.a.s.c.Overseer Overseer (id=72090344619245573-127.0.0.1:52098_solr-n_0000000000) starting
   [junit4]   2> 708558 INFO  (OverseerStateUpdate-72090344619245573-127.0.0.1:52098_solr-n_0000000000) [n:127.0.0.1:52098_solr     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:52098_solr
   [junit4]   2> 708560 INFO  (jetty-launcher-1757-thread-1) [n:127.0.0.1:52098_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52098_solr
   [junit4]   2> 708566 INFO  (zkCallback-1767-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 708571 INFO  (jetty-launcher-1757-thread-1) [n:127.0.0.1:52098_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 708574 WARN  (jetty-launcher-1757-thread-1) [n:127.0.0.1:52098_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 708608 INFO  (jetty-launcher-1757-thread-1) [n:127.0.0.1:52098_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 708633 INFO  (jetty-launcher-1757-thread-1) [n:127.0.0.1:52098_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52098.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f864574
   [junit4]   2> 708644 INFO  (jetty-launcher-1757-thread-1) [n:127.0.0.1:52098_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52098.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f864574
   [junit4]   2> 708644 INFO  (jetty-launcher-1757-thread-1) [n:127.0.0.1:52098_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52098.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f864574
   [junit4]   2> 708646 INFO  (jetty-launcher-1757-thread-1) [n:127.0.0.1:52098_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.TestCloudSearcherWarming_E66EF1E9351B9DF6-001/tempDir-001/node1/.
   [junit4]   2> 708694 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=1
   [junit4]   2> 708700 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 708710 INFO  (zkConnectionManagerCallback-1777-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 708710 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 708727 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 708743 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:52092/solr ready
   [junit4]   2> 708764 INFO  (qtp1560085160-5039) [n:127.0.0.1:52098_solr     ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&name=testRepFactor1LeaderStartup&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&createNodeSet=127.0.0.1:52098_solr&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 708782 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.a.c.CreateCollectionCmd Create collection testRepFactor1LeaderStartup
   [junit4]   2> 708785 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/managed-schema to /configs/testRepFactor1LeaderStartup.AUTOCREATED/managed-schema
   [junit4]   2> 708792 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/protwords.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/protwords.txt
   [junit4]   2> 708804 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_it.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/contractions_it.txt
   [junit4]   2> 708813 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ca.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/contractions_ca.txt
   [junit4]   2> 708820 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stemdict_nl.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stemdict_nl.txt
   [junit4]   2> 708825 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_no.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_no.txt
   [junit4]   2> 708835 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hy.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_hy.txt
   [junit4]   2> 708850 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_id.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_id.txt
   [junit4]   2> 708869 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_et.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_et.txt
   [junit4]   2> 708891 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_da.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_da.txt
   [junit4]   2> 708901 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hi.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_hi.txt
   [junit4]   2> 708908 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ga.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_ga.txt
   [junit4]   2> 708913 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_pt.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_pt.txt
   [junit4]   2> 708920 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ja.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_ja.txt
   [junit4]   2> 708926 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hu.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_hu.txt
   [junit4]   2> 708933 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_el.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_el.txt
   [junit4]   2> 708957 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ru.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_ru.txt
   [junit4]   2> 708967 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_tr.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_tr.txt
   [junit4]   2> 708987 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ar.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_ar.txt
   [junit4]   2> 709031 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/userdict_ja.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/userdict_ja.txt
   [junit4]   2> 709060 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_eu.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_eu.txt
   [junit4]   2> 709082 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_it.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_it.txt
   [junit4]   2> 709101 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_cz.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_cz.txt
   [junit4]   2> 709113 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stoptags_ja.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stoptags_ja.txt
   [junit4]   2> 709128 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_fr.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/contractions_fr.txt
   [junit4]   2> 709141 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_de.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_de.txt
   [junit4]   2> 709153 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fa.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_fa.txt
   [junit4]   2> 709165 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ga.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/contractions_ga.txt
   [junit4]   2> 709177 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ca.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_ca.txt
   [junit4]   2> 709188 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_nl.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_nl.txt
   [junit4]   2> 709199 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_bg.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_bg.txt
   [junit4]   2> 709213 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_es.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_es.txt
   [junit4]   2> 709232 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_lv.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_lv.txt
   [junit4]   2> 709253 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_en.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_en.txt
   [junit4]   2> 709263 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ro.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_ro.txt
   [junit4]   2> 709282 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_th.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_th.txt
   [junit4]   2> 709295 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fr.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_fr.txt
   [junit4]   2> 709310 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_sv.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_sv.txt
   [junit4]   2> 709359 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fi.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_fi.txt
   [junit4]   2> 709373 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/hyphenations_ga.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/hyphenations_ga.txt
   [junit4]   2> 709393 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_gl.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/lang/stopwords_gl.txt
   [junit4]   2> 709440 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/solrconfig.xml to /configs/testRepFactor1LeaderStartup.AUTOCREATED/solrconfig.xml
   [junit4]   2> 709575 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/synonyms.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/synonyms.txt
   [junit4]   2> 709619 INFO  (OverseerThreadFactory-1498-thread-1-processing-n:127.0.0.1:52098_solr) [n:127.0.0.1:52098_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/stopwords.txt to /configs/testRepFactor1LeaderStartup.AUTOCREATED/stopwords.txt
   [junit4]   2> 709867 INFO  (OverseerStateUpdate-72090344619245573-127.0.0.1:52098_solr-n_0000000000) [n:127.0.0.1:52098_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testRepFactor1LeaderStartup",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testRepFactor1LeaderStartup_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:52098/solr",
   [junit4]   2>   "node_name":"127.0.0.1:52098_solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 710134 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr    x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=testRepFactor1LeaderStartup.AUTOCREATED&newCollection=true&name=testRepFactor1LeaderStartup_shard1_replica_n1&action=CREATE&numShards=1&collection=testRepFactor1LeaderStartup&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 710135 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr    x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 710466 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
   [junit4]   2> 710508 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.s.IndexSchema [testRepFactor1LeaderStartup_shard1_replica_n1] Schema name=default-config
   [junit4]   2> 711363 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema default-config/1.6 with uniqueid field id
   [junit4]   2> 711364 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'testRepFactor1LeaderStartup_shard1_replica_n1' using configuration from configset testRepFactor1LeaderStartup.AUTOCREATED, trusted=true
   [junit4]   2> 711382 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52098.solr.core.testRepFactor1LeaderStartup.shard1.replica_n1' (registry 'solr.core.testRepFactor1LeaderStartup.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f864574
   [junit4]   2> 711389 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.SolrCore [[testRepFactor1LeaderStartup_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.TestCloudSearcherWarming_E66EF1E9351B9DF6-001/tempDir-001/node1/testRepFactor1LeaderStartup_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.TestCloudSearcherWarming_E66EF1E9351B9DF6-001/tempDir-001/node1/./testRepFactor1LeaderStartup_shard1_replica_n1/data/]
   [junit4]   2> 711561 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 711562 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 711565 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: if uncommitted for 15000ms; 
   [junit4]   2> 711565 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 711569 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@60ef151b[testRepFactor1LeaderStartup_shard1_replica_n1] main]
   [junit4]   2> 711581 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/testRepFactor1LeaderStartup.AUTOCREATED
   [junit4]   2> 711585 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/testRepFactor1LeaderStartup.AUTOCREATED
   [junit4]   2> 711585 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/testRepFactor1LeaderStartup.AUTOCREATED/managed-schema
   [junit4]   2> 711605 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 711605 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 711606 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.s.DirectSolrSpellChecker init: {name=default, field=_text_, classname=solr.DirectSolrSpellChecker, distanceMeasure=internal, accuracy=0.5, maxEdits=2, minPrefix=1, maxInspections=5, minQueryLength=4, maxQueryFrequency=0.01}
   [junit4]   2> 711607 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 711607 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1658942567356563456
   [junit4]   2> 711642 INFO  (searcherExecutor-1503-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.QuerySenderListener QuerySenderListener sending requests to Searcher@60ef151b[testRepFactor1LeaderStartup_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 711642 INFO  (searcherExecutor-1503-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.QuerySenderListener QuerySenderListener done.
   [junit4]   2> 711642 INFO  (searcherExecutor-1503-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 711643 INFO  (searcherExecutor-1503-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.SolrCore [testRepFactor1LeaderStartup_shard1_replica_n1] Registered new searcher Searcher@60ef151b[testRepFactor1LeaderStartup_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 711899 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testRepFactor1LeaderStartup/terms/shard1 to Terms{values={core_node2=0}, version=0}
   [junit4]   2> 711899 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testRepFactor1LeaderStartup/leaders/shard1
   [junit4]   2> 712019 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 712019 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 712019 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:52098/solr/testRepFactor1LeaderStartup_shard1_replica_n1/
   [junit4]   2> 712025 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 712027 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.SyncStrategy http://127.0.0.1:52098/solr/testRepFactor1LeaderStartup_shard1_replica_n1/ has no replicas
   [junit4]   2> 712027 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/testRepFactor1LeaderStartup/leaders/shard1/leader after winning as /collections/testRepFactor1LeaderStartup/leader_elect/shard1/election/72090344619245573-core_node2-n_0000000000
   [junit4]   2> 712040 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:52098/solr/testRepFactor1LeaderStartup_shard1_replica_n1/ shard1
   [junit4]   2> 712147 INFO  (zkCallback-1767-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testRepFactor1LeaderStartup/state.json] for collection [testRepFactor1LeaderStartup] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 712147 INFO  (zkCallback-1767-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testRepFactor1LeaderStartup/state.json] for collection [testRepFactor1LeaderStartup] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 712151 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 712174 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=testRepFactor1LeaderStartup.AUTOCREATED&newCollection=true&name=testRepFactor1LeaderStartup_shard1_replica_n1&action=CREATE&numShards=1&collection=testRepFactor1LeaderStartup&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2040
   [junit4]   2> 712215 INFO  (qtp1560085160-5039) [n:127.0.0.1:52098_solr     ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
   [junit4]   2> 712276 INFO  (zkCallback-1767-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testRepFactor1LeaderStartup/state.json] for collection [testRepFactor1LeaderStartup] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 712276 INFO  (zkCallback-1767-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testRepFactor1LeaderStartup/state.json] for collection [testRepFactor1LeaderStartup] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 712280 INFO  (zkCallback-1767-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testRepFactor1LeaderStartup/state.json] for collection [testRepFactor1LeaderStartup] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 712304 INFO  (qtp1560085160-5039) [n:127.0.0.1:52098_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&name=testRepFactor1LeaderStartup&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&createNodeSet=127.0.0.1:52098_solr&wt=javabin&version=2} status=0 QTime=3539
   [junit4]   2> 712315 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.MiniSolrCloudCluster waitForActiveCollection: testRepFactor1LeaderStartup
   [junit4]   2> 712344 INFO  (qtp1560085160-5038) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler Waiting up to 30 secs for 1 replicas to set the property overlay to be of version 0 for collection testRepFactor1LeaderStartup
   [junit4]   2> 712347 INFO  (solrHandlerExecutor-1508-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler Time elapsed : 0 secs, maxWait 30
   [junit4]   2> 712350 INFO  (Thread-693) [     ] o.a.s.c.SolrCore config update listener called for core testRepFactor1LeaderStartup_shard1_replica_n1
   [junit4]   2> 712355 INFO  (Thread-693) [     ] o.a.s.c.SolrCore core reload testRepFactor1LeaderStartup_shard1_replica_n1
   [junit4]   2> 712397 INFO  (Thread-693) [     ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
   [junit4]   2> 712452 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler expecting overlay version 0 but my version is -1
   [junit4]   2> 712452 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.S.Request [testRepFactor1LeaderStartup_shard1_replica_n1]  webapp=/solr path=/config/znodeVersion params={overlay=0&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 712452 INFO  (SolrConfigHandler-refreshconf) [     ] o.a.s.h.SolrConfigHandler Another reload is in progress . Not doing anything
   [junit4]   2> 712453 INFO  (solrHandlerExecutor-1508-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler Could not get expectedVersion 0 from http://127.0.0.1:52098/solr/testRepFactor1LeaderStartup_shard1_replica_n1/ for prop overlay   after 1 attempts
   [junit4]   2> 712453 INFO  (solrHandlerExecutor-1508-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler Time elapsed : 0 secs, maxWait 30
   [junit4]   2> 712454 INFO  (Thread-693) [     ] o.a.s.s.IndexSchema [testRepFactor1LeaderStartup_shard1_replica_n1] Schema name=default-config
   [junit4]   2> 712582 INFO  (qtp1560085160-5039) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler expecting overlay version 0 but my version is -1
   [junit4]   2> 712582 INFO  (qtp1560085160-5039) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.S.Request [testRepFactor1LeaderStartup_shard1_replica_n1]  webapp=/solr path=/config/znodeVersion params={overlay=0&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 712583 INFO  (SolrConfigHandler-refreshconf) [     ] o.a.s.h.SolrConfigHandler Another reload is in progress . Not doing anything
   [junit4]   2> 712583 INFO  (solrHandlerExecutor-1508-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler Could not get expectedVersion 0 from http://127.0.0.1:52098/solr/testRepFactor1LeaderStartup_shard1_replica_n1/ for prop overlay   after 2 attempts
   [junit4]   2> 712583 INFO  (solrHandlerExecutor-1508-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler Time elapsed : 0 secs, maxWait 30
   [junit4]   2> 712693 INFO  (qtp1560085160-5040) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler expecting overlay version 0 but my version is -1
   [junit4]   2> 712694 INFO  (qtp1560085160-5040) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.S.Request [testRepFactor1LeaderStartup_shard1_replica_n1]  webapp=/solr path=/config/znodeVersion params={overlay=0&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 712694 INFO  (SolrConfigHandler-refreshconf) [     ] o.a.s.h.SolrConfigHandler Another reload is in progress . Not doing anything
   [junit4]   2> 712695 INFO  (solrHandlerExecutor-1508-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler Could not get expectedVersion 0 from http://127.0.0.1:52098/solr/testRepFactor1LeaderStartup_shard1_replica_n1/ for prop overlay   after 3 attempts
   [junit4]   2> 712695 INFO  (solrHandlerExecutor-1508-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler Time elapsed : 0 secs, maxWait 30
   [junit4]   2> 712796 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler expecting overlay version 0 but my version is -1
   [junit4]   2> 712802 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.S.Request [testRepFactor1LeaderStartup_shard1_replica_n1]  webapp=/solr path=/config/znodeVersion params={overlay=0&wt=javabin&version=2} status=0 QTime=5
   [junit4]   2> 712802 INFO  (SolrConfigHandler-refreshconf) [     ] o.a.s.h.SolrConfigHandler Another reload is in progress . Not doing anything
   [junit4]   2> 712803 INFO  (solrHandlerExecutor-1508-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler Could not get expectedVersion 0 from http://127.0.0.1:52098/solr/testRepFactor1LeaderStartup_shard1_replica_n1/ for prop overlay   after 4 attempts
   [junit4]   2> 712803 INFO  (solrHandlerExecutor-1508-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler Time elapsed : 0 secs, maxWait 30
   [junit4]   2> 712825 INFO  (Thread-693) [     ] o.a.s.s.IndexSchema Loaded schema default-config/1.6 with uniqueid field id
   [junit4]   2> 712825 INFO  (Thread-693) [     ] o.a.s.c.CoreContainer Reloading SolrCore 'testRepFactor1LeaderStartup_shard1_replica_n1' using configuration from configset testRepFactor1LeaderStartup.AUTOCREATED
   [junit4]   2> 712836 INFO  (OverseerCollectionConfigSetProcessor-72090344619245573-127.0.0.1:52098_solr-n_0000000000) [n:127.0.0.1:52098_solr     ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 712927 INFO  (qtp1560085160-5039) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler expecting overlay version 0 but my version is -1
   [junit4]   2> 712927 INFO  (qtp1560085160-5039) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.S.Request [testRepFactor1LeaderStartup_shard1_replica_n1]  webapp=/solr path=/config/znodeVersion params={overlay=0&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 712927 INFO  (SolrConfigHandler-refreshconf) [     ] o.a.s.h.SolrConfigHandler Another reload is in progress . Not doing anything
   [junit4]   2> 712928 INFO  (solrHandlerExecutor-1508-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler Could not get expectedVersion 0 from http://127.0.0.1:52098/solr/testRepFactor1LeaderStartup_shard1_replica_n1/ for prop overlay   after 5 attempts
   [junit4]   2> 712928 INFO  (solrHandlerExecutor-1508-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler Time elapsed : 0 secs, maxWait 30
   [junit4]   2> 712979 INFO  (Thread-693) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52098.solr.core.testRepFactor1LeaderStartup.shard1.replica_n1' (registry 'solr.core.testRepFactor1LeaderStartup.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f864574
   [junit4]   2> 712980 INFO  (Thread-693) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.SolrCore [[testRepFactor1LeaderStartup_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.TestCloudSearcherWarming_E66EF1E9351B9DF6-001/tempDir-001/node1/testRepFactor1LeaderStartup_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.TestCloudSearcherWarming_E66EF1E9351B9DF6-001/tempDir-001/node1/./testRepFactor1LeaderStartup_shard1_replica_n1/data/]
   [junit4]   2> 713061 INFO  (qtp1560085160-5040) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler expecting overlay version 0 but my version is -1
   [junit4]   2> 713062 INFO  (qtp1560085160-5040) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.S.Request [testRepFactor1LeaderStartup_shard1_replica_n1]  webapp=/solr path=/config/znodeVersion params={overlay=0&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 713062 INFO  (SolrConfigHandler-refreshconf) [     ] o.a.s.h.SolrConfigHandler Another reload is in progress . Not doing anything
   [junit4]   2> 713063 INFO  (solrHandlerExecutor-1508-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler Could not get expectedVersion 0 from http://127.0.0.1:52098/solr/testRepFactor1LeaderStartup_shard1_replica_n1/ for prop overlay   after 6 attempts
   [junit4]   2> 713063 INFO  (solrHandlerExecutor-1508-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler Time elapsed : 0 secs, maxWait 30
   [junit4]   2> 713176 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler expecting overlay version 0 but my version is -1
   [junit4]   2> 713176 INFO  (qtp1560085160-5041) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.S.Request [testRepFactor1LeaderStartup_shard1_replica_n1]  webapp=/solr path=/config/znodeVersion params={overlay=0&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 713176 INFO  (SolrConfigHandler-refreshconf) [     ] o.a.s.h.SolrConfigHandler Another reload is in progress . Not doing anything
   [junit4]   2> 713177 INFO  (solrHandlerExecutor-1508-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler Could not get expectedVersion 0 from http://127.0.0.1:52098/solr/testRepFactor1LeaderStartup_shard1_replica_n1/ for prop overlay   after 7 attempts
   [junit4]   2> 713177 INFO  (solrHandlerExecutor-1508-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler Time elapsed : 0 secs, maxWait 30
   [junit4]   2> 713190 INFO  (Thread-693) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: if uncommitted for 15000ms; 
   [junit4]   2> 713190 INFO  (Thread-693) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 713193 INFO  (Thread-693) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@4f6a016f[testRepFactor1LeaderStartup_shard1_replica_n1] main]
   [junit4]   2> 713235 INFO  (Thread-693) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/testRepFactor1LeaderStartup.AUTOCREATED
   [junit4]   2> 713285 INFO  (qtp1560085160-5039) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler expecting overlay version 0 but my version is -1
   [junit4]   2> 713286 INFO  (qtp1560085160-5039) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.S.Request [testRepFactor1LeaderStartup_shard1_replica_n1]  webapp=/solr path=/config/znodeVersion params={overlay=0&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 713286 INFO  (SolrConfigHandler-refreshconf) [     ] o.a.s.h.SolrConfigHandler Another reload is in progress . Not doing anything
   [junit4]   2> 713286 INFO  (solrHandlerExecutor-1508-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler Could not get expectedVersion 0 from http://127.0.0.1:52098/solr/testRepFactor1LeaderStartup_shard1_replica_n1/ for prop overlay   after 8 attempts
   [junit4]   2> 713286 INFO  (solrHandlerExecutor-1508-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler Time elapsed : 0 secs, maxWait 30
   [junit4]   2> 713297 INFO  (Thread-693) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/testRepFactor1LeaderStartup.AUTOCREATED
   [junit4]   2> 713297 INFO  (Thread-693) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/testRepFactor1LeaderStartup.AUTOCREATED/managed-schema
   [junit4]   2> 713315 INFO  (Thread-693) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 713315 INFO  (Thread-693) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 713315 INFO  (Thread-693) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.s.DirectSolrSpellChecker init: {name=default, field=_text_, classname=solr.DirectSolrSpellChecker, distanceMeasure=internal, accuracy=0.5, maxEdits=2, minPrefix=1, maxInspections=5, minQueryLength=4, maxQueryFrequency=0.01}
   [junit4]   2> 713316 INFO  (Thread-693) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 713316 INFO  (Thread-693) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1658942569148579840
   [junit4]   2> 713317 INFO  (searcherExecutor-1509-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.QuerySenderListener QuerySenderListener sending requests to Searcher@4f6a016f[testRepFactor1LeaderStartup_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 713317 INFO  (searcherExecutor-1509-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.QuerySenderListener QuerySenderListener done.
   [junit4]   2> 713317 INFO  (searcherExecutor-1509-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 713321 INFO  (searcherExecutor-1509-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.SolrCore [testRepFactor1LeaderStartup_shard1_replica_n1] Registered new searcher Searcher@4f6a016f[testRepFactor1LeaderStartup_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 713388 INFO  (Thread-693) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 713390 INFO  (Thread-693) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@ef78e6b[testRepFactor1LeaderStartup_shard1_replica_n1] main]
   [junit4]   2> 713392 INFO  (searcherExecutor-1509-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.QuerySenderListener QuerySenderListener sending requests to Searcher@ef78e6b[testRepFactor1LeaderStartup_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 713392 INFO  (searcherExecutor-1509-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.QuerySenderListener QuerySenderListener done.
   [junit4]   2> 713393 INFO  (qtp1560085160-5040) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler I already have the expected version 0 of config
   [junit4]   2> 713393 INFO  (qtp1560085160-5040) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler isStale false , resourceloader org.apache.solr.cloud.ZkSolrResourceLoader
   [junit4]   2> 713393 INFO  (qtp1560085160-5040) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.S.Request [testRepFactor1LeaderStartup_shard1_replica_n1]  webapp=/solr path=/config/znodeVersion params={overlay=0&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 713394 INFO  (qtp1560085160-5038) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.h.SolrConfigHandler Took 1050.0ms to set the property overlay to be of version 0 for collection testRepFactor1LeaderStartup
   [junit4]   2> 713394 INFO  (qtp1560085160-5038) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.S.Request [testRepFactor1LeaderStartup_shard1_replica_n1]  webapp=/solr path=/config params={wt=javabin&version=2} status=0 QTime=1062
   [junit4]   2> 713395 INFO  (qtp1560085160-5038) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.SolrCore [testRepFactor1LeaderStartup_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@5a2fb652
   [junit4]   2> 713395 INFO  (qtp1560085160-5038) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testRepFactor1LeaderStartup.shard1.replica_n1, tag=SolrCore@5a2fb652
   [junit4]   2> 713395 INFO  (qtp1560085160-5038) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@66ee5bd9: rootName = solr_52098, domain = solr.core.testRepFactor1LeaderStartup.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.testRepFactor1LeaderStartup.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@55c22491
   [junit4]   2> 713399 INFO  (searcherExecutor-1509-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.SolrCore [testRepFactor1LeaderStartup_shard1_replica_n1] Registered new searcher Searcher@ef78e6b[testRepFactor1LeaderStartup_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 713412 INFO  (qtp1560085160-5038) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testRepFactor1LeaderStartup.shard1.leader, tag=SolrCore@5a2fb652
   [junit4]   2> 713445 INFO  (qtp1560085160-5040) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testRepFactor1LeaderStartup/terms/shard1 to Terms{values={core_node2=1}, version=1}
   [junit4]   2> 713445 INFO  (qtp1560085160-5040) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [testRepFactor1LeaderStartup_shard1_replica_n1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[1 (1658942569275457536)]} 0 17
   [junit4]   2> 713461 INFO  (qtp1560085160-5039) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1658942569300623360,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 713472 INFO  (qtp1560085160-5039) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@3ee7730f commitCommandVersion:1658942569300623360
   [junit4]   2> 713679 INFO  (qtp1560085160-5039) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@795c9257[testRepFactor1LeaderStartup_shard1_replica_n1] main]
   [junit4]   2> 713681 INFO  (qtp1560085160-5039) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 713681 INFO  (searcherExecutor-1509-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.QuerySenderListener QuerySenderListener sending requests to Searcher@795c9257[testRepFactor1LeaderStartup_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(9.0.0):C1:[diagnostics={lucene.version=9.0.0, java.vm.version=13.0.2+8, java.version=13.0.2, timestamp=1582090920759, java.vendor=AdoptOpenJDK, os=Mac OS X, os.version=10.14.6, java.runtime.version=13.0.2+8, os.arch=x86_64, source=flush}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}])))}
   [junit4]   2> 713681 INFO  (searcherExecutor-1509-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.QuerySenderListener QuerySenderListener done.
   [junit4]   2> 713685 INFO  (searcherExecutor-1509-thread-1-processing-n:127.0.0.1:52098_solr x:testRepFactor1LeaderStartup_shard1_replica_n1 c:testRepFactor1LeaderStartup s:shard1 r:core_node2) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.SolrCore [testRepFactor1LeaderStartup_shard1_replica_n1] Registered new searcher Searcher@795c9257[testRepFactor1LeaderStartup_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(9.0.0):C1:[diagnostics={lucene.version=9.0.0, java.vm.version=13.0.2+8, java.version=13.0.2, timestamp=1582090920759, java.vendor=AdoptOpenJDK, os=Mac OS X, os.version=10.14.6, java.runtime.version=13.0.2+8, os.arch=x86_64, source=flush}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}])))}
   [junit4]   2> 713686 INFO  (qtp1560085160-5039) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [testRepFactor1LeaderStartup_shard1_replica_n1]  webapp=/solr path=/update params={_stateVer_=testRepFactor1LeaderStartup:4&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 239
   [junit4]   2> 713697 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=451719380
   [junit4]   2> 713697 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:52098_solr
   [junit4]   2> 713699 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.ZkController Publish this node as DOWN...
   [junit4]   2> 713699 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.ZkController Publish node=127.0.0.1:52098_solr as DOWN
   [junit4]   2> 713714 INFO  (coreCloseExecutor-1513-thread-1) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.c.SolrCore [testRepFactor1LeaderStartup_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@2d835b9a
   [junit4]   2> 713714 INFO  (coreCloseExecutor-1513-thread-1) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testRepFactor1LeaderStartup.shard1.replica_n1, tag=SolrCore@2d835b9a
   [junit4]   2> 713715 INFO  (coreCloseExecutor-1513-thread-1) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7a446f8c: rootName = solr_52098, domain = solr.core.testRepFactor1LeaderStartup.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.testRepFactor1LeaderStartup.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@55c22491
   [junit4]   2> 713730 INFO  (coreCloseExecutor-1513-thread-1) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testRepFactor1LeaderStartup.shard1.leader, tag=SolrCore@2d835b9a
   [junit4]   2> 713742 INFO  (coreCloseExecutor-1513-thread-1) [n:127.0.0.1:52098_solr c:testRepFactor1LeaderStartup s:shard1 r:core_node2 x:testRepFactor1LeaderStartup_shard1_replica_n1 ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 713769 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 713769 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@78763042: rootName = solr_52098, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@331da69c
   [junit4]   2> 713777 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 713778 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@440e512b: rootName = solr_52098, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@ebee2ba
   [junit4]   2> 713781 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 713781 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@20f65d2d: rootName = solr_52098, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@392ffe1e
   [junit4]   2> 713781 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 713787 INFO  (closeThreadPool-1792-thread-2) [     ] o.a.s.c.Overseer Overseer (id=72090344619245573-127.0.0.1:52098_solr-n_0000000000) closing
   [junit4]   2> 713788 INFO  (OverseerStateUpdate-72090344619245573-127.0.0.1:52098_solr-n_0000000000) [n:127.0.0.1:52098_solr     ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:52098_solr
   [junit4]   2> 713790 INFO  (OverseerAutoScalingTriggerThread-72090344619245573-127.0.0.1:52098_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 713830 INFO  (closeThreadPool-1792-thread-1) [     ] o.a.s.c.Overseer Overseer (id=72090344619245573-127.0.0.1:52098_solr-n_0000000000) closing
   [junit4]   2> 713833 INFO  (zkCallback-1776-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 713988 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.Overseer Overseer (id=72090344619245573-127.0.0.1:52098_solr-n_0000000000) closing
   [junit4]   2> 714003 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@523af747{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
   [junit4]   2> 714007 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@52669523{/solr,null,UNAVAILABLE}
   [junit4]   2> 714013 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 714033 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.MiniSolrCloudCluster waitForJettyToStop: 52098
   [junit4]   2> 714035 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.SolrCloudTestCase waitForState (testRepFactor1LeaderStartup): jetty count:1
   [junit4]   2> 714038 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
   [junit4]   2> 714038 INFO  (watches-1774-thread-1) [     ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
   [junit4]   2> 714040 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
   [junit4]   2> 714041 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
   [junit4]   2> 714041 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=52098)
   [junit4]   2> 714041 WARN  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
   [junit4]   2> 714041 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 52098 try number 1 ...
   [junit4]   2> 714042 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 13.0.2+8
   [junit4]   2> 714051 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 714051 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 714051 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 714054 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2eca763a{/solr,null,AVAILABLE}
   [junit4]   2> 714086 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.e.j.s.AbstractConnector Started ServerConnector@619f04e9{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:52098}
   [junit4]   2> 714086 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.e.j.s.Server Started @714151ms
   [junit4]   2> 714086 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=52098}
   [junit4]   2> 714087 ERROR (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 714087 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 714087 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 9.0.0
   [junit4]   2> 714087 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 714087 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
   [junit4]   2> 714087 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2020-02-19T05:42:01.361285Z
   [junit4]   2> 714094 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 714120 INFO  (zkConnectionManagerCallback-1794-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 714122 INFO  (TEST-TestCloudSearcherWarming.testRepFactor1LeaderStartup-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 714129 INFO  (TEST-TestCloudSearcherWarming.

[...truncated too long message...]

 Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 771608 INFO  (closeThreadPool-1902-thread-2) [     ] o.a.s.c.Overseer Overseer (id=72090345903620105-127.0.0.1:52212_solr-n_0000000001) closing
   [junit4]   2> 771608 INFO  (OverseerStateUpdate-72090345903620105-127.0.0.1:52212_solr-n_0000000001) [n:127.0.0.1:52212_solr     ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:52212_solr
   [junit4]   2> 771610 INFO  (OverseerAutoScalingTriggerThread-72090345903620105-127.0.0.1:52212_solr-n_0000000001) [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 771646 INFO  (closeThreadPool-1902-thread-1) [     ] o.a.s.c.Overseer Overseer (id=72090345903620105-127.0.0.1:52212_solr-n_0000000001) closing
   [junit4]   2> 771767 INFO  (jetty-closer-1898-thread-1) [     ] o.a.s.c.Overseer Overseer (id=72090345903620105-127.0.0.1:52212_solr-n_0000000001) closing
   [junit4]   2> 771797 INFO  (jetty-closer-1898-thread-1) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@6310f553{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
   [junit4]   2> 771803 INFO  (jetty-closer-1898-thread-1) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1ed8b5f5{/solr,null,UNAVAILABLE}
   [junit4]   2> 771805 INFO  (jetty-closer-1898-thread-1) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 771815 INFO  (TEST-TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 772056 WARN  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	11	/solr/collections/testPeersyncFailureReplicationSuccess/terms/shard1
   [junit4]   2> 	5	/solr/collections/testPeersyncFailureReplicationSuccess/state.json
   [junit4]   2> 	4	/solr/clusterprops.json
   [junit4]   2> 	4	/solr/aliases.json
   [junit4]   2> 	3	/solr/configs/testPeersyncFailureReplicationSuccess.AUTOCREATED
   [junit4]   2> 	3	/solr/configs/testPeersyncFailureReplicationSuccess.AUTOCREATED/managed-schema
   [junit4]   2> 	2	/solr/packages.json
   [junit4]   2> 	2	/solr/security.json
   [junit4]   2> 	2	/solr/collections/testPeersyncFailureReplicationSuccess/collectionprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	56	/solr/collections/testPeersyncFailureReplicationSuccess/state.json
   [junit4]   2> 	4	/solr/clusterstate.json
   [junit4]   2> 	3	/solr/aliases.json
   [junit4]   2> 	2	/solr/autoscaling.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	31	/solr/overseer/queue
   [junit4]   2> 	18	/solr/overseer/collection-queue-work
   [junit4]   2> 	10	/solr/live_nodes
   [junit4]   2> 	9	/solr/collections
   [junit4]   2> 	2	/solr/autoscaling/events/.scheduled_maintenance
   [junit4]   2> 	2	/solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 	2	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> 772062 INFO  (TEST-TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:52167
   [junit4]   2> 772062 INFO  (TEST-TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:52167
   [junit4]   2> 772062 INFO  (TEST-TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 52167
   [junit4]   2> 772063 INFO  (TEST-TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess-seed#[E66EF1E9351B9DF6]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testPeersyncFailureReplicationSuccess
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestCloudSearcherWarming -Dtests.method=testPeersyncFailureReplicationSuccess -Dtests.seed=E66EF1E9351B9DF6 -Dtests.slow=true -Dtests.locale=lv-LV -Dtests.timezone=Africa/Conakry -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   45.2s J4 | TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess <<<
   [junit4]    > Throwable #1: org.apache.solr.common.SolrException: No registered leader was found after waiting for 4000ms , collection: testPeersyncFailureReplicationSuccess slice: shard1 saw state=DocCollection(testPeersyncFailureReplicationSuccess//collections/testPeersyncFailureReplicationSuccess/state.json/10)={
   [junit4]    >   "pullReplicas":"0",
   [junit4]    >   "replicationFactor":"1",
   [junit4]    >   "shards":{"shard1":{
   [junit4]    >       "range":"80000000-7fffffff",
   [junit4]    >       "state":"active",
   [junit4]    >       "replicas":{
   [junit4]    >         "core_node2":{
   [junit4]    >           "core":"testPeersyncFailureReplicationSuccess_shard1_replica_n1",
   [junit4]    >           "base_url":"http://127.0.0.1:52172/solr",
   [junit4]    >           "node_name":"127.0.0.1:52172_solr",
   [junit4]    >           "state":"down",
   [junit4]    >           "type":"NRT",
   [junit4]    >           "force_set_state":"false"},
   [junit4]    >         "core_node4":{
   [junit4]    >           "core":"testPeersyncFailureReplicationSuccess_shard1_replica_n3",
   [junit4]    >           "base_url":"http://127.0.0.1:52212/solr",
   [junit4]    >           "node_name":"127.0.0.1:52212_solr",
   [junit4]    >           "state":"active",
   [junit4]    >           "type":"NRT",
   [junit4]    >           "force_set_state":"false"}}}},
   [junit4]    >   "router":{"name":"compositeId"},
   [junit4]    >   "maxShardsPerNode":"2",
   [junit4]    >   "autoAddReplicas":"false",
   [junit4]    >   "nrtReplicas":"1",
   [junit4]    >   "tlogReplicas":"0"} with live_nodes=[127.0.0.1:52212_solr]
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([E66EF1E9351B9DF6:323F92A6E4A5AA95]:0)
   [junit4]    > 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:979)
   [junit4]    > 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:956)
   [junit4]    > 	at org.apache.solr.cloud.TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess(TestCloudSearcherWarming.java:205)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.base/java.lang.reflect.Method.invoke(Method.java:567)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:830)
   [junit4]   2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.TestCloudSearcherWarming_E66EF1E9351B9DF6-001
   [junit4]   2> Feb 19, 2020 5:42:59 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene84), sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@614ac4d4), locale=lv-LV, timezone=Africa/Conakry
   [junit4]   2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 13.0.2 (64-bit)/cpus=6,threads=1,free=166984176,total=402653184
   [junit4]   2> NOTE: All tests run in this JVM: [CollectionPropsTest, RangeFacetCloudTest, TestBlendedInfixSuggestions, HdfsLockFactoryTest, ExitableDirectoryReaderTest, TestMacroExpander, SpatialFilterTest, HDFSCollectionsAPITest, TestLogWatcher, AddSchemaFieldsUpdateProcessorFactoryTest, QueryParsingTest, ClassificationUpdateProcessorFactoryTest, ReindexCollectionTest, SimpleCollectionCreateDeleteTest, TestBackupRepositoryFactory, TestLRUStatsCacheCloud, TestHighlightDedupGrouping, Tagger2Test, GraphQueryTest, DocumentAnalysisRequestHandlerTest, TestInPlaceUpdatesDistrib, DimensionalRoutedAliasUpdateProcessorTest, TestCryptoKeys, TestManagedSchemaAPI, TestCloudSearcherWarming]
   [junit4] Completed [162/904 (1!)] on J4 in 65.12s, 2 tests, 1 error <<< FAILURES!

[...truncated 54724 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/build.xml:635: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/build.xml:101: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build.xml:625: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build.xml:157: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/solr-ref-guide/build.xml:289: Java returned: 255

Total time: 81 minutes 11 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-MacOSX (64bit/jdk-12.0.2) - Build # 5680 - Failure!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/5680/
Java: 64bit/jdk-12.0.2 -XX:+UseCompressedOops -XX:+UseSerialGC

All tests passed

Build Log:
[...truncated 67990 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/build.xml:635: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/build.xml:101: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build.xml:625: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build.xml:157: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/solr-ref-guide/build.xml:289: Java returned: 255

Total time: 62 minutes 2 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2