You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2020/03/03 09:39:23 UTC

[JENKINS] Lucene-Solr-8.x-MacOSX (64bit/jdk-12.0.2) - Build # 707 - Still Unstable!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-MacOSX/707/
Java: 64bit/jdk-12.0.2 -XX:+UseCompressedOops -XX:+UseG1GC

1 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestSnapshotCloudManager

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.autoscaling.sim.TestSnapshotCloudManager:     1) Thread[id=19351, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestSnapshotCloudManager]         at java.base@12.0.2/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.autoscaling.sim.TestSnapshotCloudManager: 
   1) Thread[id=19351, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestSnapshotCloudManager]
        at java.base@12.0.2/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
	at __randomizedtesting.SeedInfo.seed([B80D2BDE30B54AAF]:0)




Build Log:
[...truncated 15315 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestSnapshotCloudManager
   [junit4]   2> 1725048 INFO  (SUITE-TestSnapshotCloudManager-seed#[B80D2BDE30B54AAF]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 1725048 INFO  (SUITE-TestSnapshotCloudManager-seed#[B80D2BDE30B54AAF]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1725051 INFO  (SUITE-TestSnapshotCloudManager-seed#[B80D2BDE30B54AAF]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestSnapshotCloudManager_B80D2BDE30B54AAF-001/data-dir-127-001
   [junit4]   2> 1725051 INFO  (SUITE-TestSnapshotCloudManager-seed#[B80D2BDE30B54AAF]-worker) [     ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1725052 INFO  (SUITE-TestSnapshotCloudManager-seed#[B80D2BDE30B54AAF]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
   [junit4]   2> 1725053 INFO  (SUITE-TestSnapshotCloudManager-seed#[B80D2BDE30B54AAF]-worker) [     ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestSnapshotCloudManager_B80D2BDE30B54AAF-001/tempDir-001
   [junit4]   2> 1725053 INFO  (SUITE-TestSnapshotCloudManager-seed#[B80D2BDE30B54AAF]-worker) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1725054 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1725054 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1725158 INFO  (SUITE-TestSnapshotCloudManager-seed#[B80D2BDE30B54AAF]-worker) [     ] o.a.s.c.ZkTestServer start zk server on port:54441
   [junit4]   2> 1725158 INFO  (SUITE-TestSnapshotCloudManager-seed#[B80D2BDE30B54AAF]-worker) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:54441
   [junit4]   2> 1725158 INFO  (SUITE-TestSnapshotCloudManager-seed#[B80D2BDE30B54AAF]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:54441
   [junit4]   2> 1725158 INFO  (SUITE-TestSnapshotCloudManager-seed#[B80D2BDE30B54AAF]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 54441
   [junit4]   2> 1725162 INFO  (SUITE-TestSnapshotCloudManager-seed#[B80D2BDE30B54AAF]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1725169 INFO  (zkConnectionManagerCallback-6488-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1725169 INFO  (SUITE-TestSnapshotCloudManager-seed#[B80D2BDE30B54AAF]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1725174 INFO  (SUITE-TestSnapshotCloudManager-seed#[B80D2BDE30B54AAF]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1725177 INFO  (zkConnectionManagerCallback-6490-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1725177 INFO  (SUITE-TestSnapshotCloudManager-seed#[B80D2BDE30B54AAF]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1725179 INFO  (SUITE-TestSnapshotCloudManager-seed#[B80D2BDE30B54AAF]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1725183 INFO  (zkConnectionManagerCallback-6492-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1725184 INFO  (SUITE-TestSnapshotCloudManager-seed#[B80D2BDE30B54AAF]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1725306 WARN  (jetty-launcher-6493-thread-1) [     ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
   [junit4]   2> 1725307 INFO  (jetty-launcher-6493-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1725307 INFO  (jetty-launcher-6493-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 1725307 INFO  (jetty-launcher-6493-thread-1) [     ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 12.0.2+10
   [junit4]   2> 1725307 WARN  (jetty-launcher-6493-thread-2) [     ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
   [junit4]   2> 1725307 INFO  (jetty-launcher-6493-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1725307 INFO  (jetty-launcher-6493-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 1725307 INFO  (jetty-launcher-6493-thread-2) [     ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 12.0.2+10
   [junit4]   2> 1725311 WARN  (jetty-launcher-6493-thread-3) [     ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
   [junit4]   2> 1725311 INFO  (jetty-launcher-6493-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1725311 INFO  (jetty-launcher-6493-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 1725311 INFO  (jetty-launcher-6493-thread-3) [     ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 12.0.2+10
   [junit4]   2> 1725313 INFO  (jetty-launcher-6493-thread-2) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1725313 INFO  (jetty-launcher-6493-thread-2) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1725313 INFO  (jetty-launcher-6493-thread-2) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1725314 INFO  (jetty-launcher-6493-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1725314 INFO  (jetty-launcher-6493-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1725314 INFO  (jetty-launcher-6493-thread-1) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1725315 INFO  (jetty-launcher-6493-thread-2) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@58fceadc{/solr,null,AVAILABLE}
   [junit4]   2> 1725317 INFO  (jetty-launcher-6493-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@32eb132e{/solr,null,AVAILABLE}
   [junit4]   2> 1725318 INFO  (jetty-launcher-6493-thread-3) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1725318 INFO  (jetty-launcher-6493-thread-3) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1725318 INFO  (jetty-launcher-6493-thread-3) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1725319 INFO  (jetty-launcher-6493-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@58c55ed8{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:54448}
   [junit4]   2> 1725319 INFO  (jetty-launcher-6493-thread-1) [     ] o.e.j.s.Server Started @1725662ms
   [junit4]   2> 1725319 INFO  (jetty-launcher-6493-thread-3) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7ece020f{/solr,null,AVAILABLE}
   [junit4]   2> 1725319 INFO  (jetty-launcher-6493-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=54448}
   [junit4]   2> 1725319 ERROR (jetty-launcher-6493-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1725319 INFO  (jetty-launcher-6493-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1725319 INFO  (jetty-launcher-6493-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.5.0
   [junit4]   2> 1725319 INFO  (jetty-launcher-6493-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1725319 INFO  (jetty-launcher-6493-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr
   [junit4]   2> 1725319 INFO  (jetty-launcher-6493-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2020-03-03T09:09:26.285532Z
   [junit4]   2> 1725320 INFO  (jetty-launcher-6493-thread-3) [     ] o.e.j.s.AbstractConnector Started ServerConnector@56becc50{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:54449}
   [junit4]   2> 1725320 INFO  (jetty-launcher-6493-thread-3) [     ] o.e.j.s.Server Started @1725664ms
   [junit4]   2> 1725320 INFO  (jetty-launcher-6493-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=54449}
   [junit4]   2> 1725320 ERROR (jetty-launcher-6493-thread-3) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1725321 INFO  (jetty-launcher-6493-thread-3) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1725321 INFO  (jetty-launcher-6493-thread-3) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.5.0
   [junit4]   2> 1725321 INFO  (jetty-launcher-6493-thread-3) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1725321 INFO  (jetty-launcher-6493-thread-3) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr
   [junit4]   2> 1725321 INFO  (jetty-launcher-6493-thread-3) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2020-03-03T09:09:26.287195Z
   [junit4]   2> 1725322 INFO  (jetty-launcher-6493-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1725322 INFO  (jetty-launcher-6493-thread-3) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1725337 INFO  (jetty-launcher-6493-thread-2) [     ] o.e.j.s.AbstractConnector Started ServerConnector@3f3ccbd1{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:54447}
   [junit4]   2> 1725337 INFO  (jetty-launcher-6493-thread-2) [     ] o.e.j.s.Server Started @1725680ms
   [junit4]   2> 1725337 INFO  (jetty-launcher-6493-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=54447}
   [junit4]   2> 1725337 ERROR (jetty-launcher-6493-thread-2) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1725338 INFO  (jetty-launcher-6493-thread-2) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1725338 INFO  (jetty-launcher-6493-thread-2) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.5.0
   [junit4]   2> 1725338 INFO  (jetty-launcher-6493-thread-2) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1725338 INFO  (jetty-launcher-6493-thread-2) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr
   [junit4]   2> 1725338 INFO  (jetty-launcher-6493-thread-2) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2020-03-03T09:09:26.304190Z
   [junit4]   2> 1725339 INFO  (jetty-launcher-6493-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1725343 INFO  (zkConnectionManagerCallback-6497-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1725344 INFO  (jetty-launcher-6493-thread-3) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1725345 INFO  (zkConnectionManagerCallback-6495-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1725345 INFO  (jetty-launcher-6493-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1725353 INFO  (jetty-launcher-6493-thread-1) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1725355 INFO  (jetty-launcher-6493-thread-3) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1725356 INFO  (zkConnectionManagerCallback-6499-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1725356 INFO  (jetty-launcher-6493-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1725361 INFO  (jetty-launcher-6493-thread-2) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1725671 INFO  (jetty-launcher-6493-thread-2) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1725674 WARN  (jetty-launcher-6493-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@6a305b76[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1725674 WARN  (jetty-launcher-6493-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@6a305b76[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1725685 WARN  (jetty-launcher-6493-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@154e12e3[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1725685 WARN  (jetty-launcher-6493-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@154e12e3[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1725688 INFO  (jetty-launcher-6493-thread-2) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54441/solr
   [junit4]   2> 1725698 INFO  (jetty-launcher-6493-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1725702 INFO  (zkConnectionManagerCallback-6508-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1725703 INFO  (jetty-launcher-6493-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1725706 INFO  (jetty-launcher-6493-thread-1) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1725707 WARN  (jetty-launcher-6493-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@632537b3[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1725707 WARN  (jetty-launcher-6493-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@632537b3[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1725715 WARN  (jetty-launcher-6493-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@46e03291[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1725715 WARN  (jetty-launcher-6493-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@46e03291[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1725717 INFO  (jetty-launcher-6493-thread-1) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54441/solr
   [junit4]   2> 1725718 INFO  (jetty-launcher-6493-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1725722 INFO  (zkConnectionManagerCallback-6514-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1725722 INFO  (jetty-launcher-6493-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1725809 INFO  (jetty-launcher-6493-thread-2) [n:127.0.0.1:54447_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1725813 INFO  (zkConnectionManagerCallback-6516-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1725814 INFO  (jetty-launcher-6493-thread-2) [n:127.0.0.1:54447_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1725845 INFO  (jetty-launcher-6493-thread-1) [n:127.0.0.1:54448_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1725849 INFO  (zkConnectionManagerCallback-6518-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1725849 INFO  (jetty-launcher-6493-thread-1) [n:127.0.0.1:54448_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1725872 INFO  (jetty-launcher-6493-thread-3) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1725881 WARN  (jetty-launcher-6493-thread-3) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3e132500[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1725881 WARN  (jetty-launcher-6493-thread-3) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3e132500[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1725895 WARN  (jetty-launcher-6493-thread-3) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@503ad822[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1725895 WARN  (jetty-launcher-6493-thread-3) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@503ad822[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1725898 INFO  (jetty-launcher-6493-thread-3) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54441/solr
   [junit4]   2> 1725906 INFO  (jetty-launcher-6493-thread-3) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1725914 INFO  (zkConnectionManagerCallback-6528-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1725914 INFO  (jetty-launcher-6493-thread-3) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1726024 INFO  (jetty-launcher-6493-thread-3) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1726074 INFO  (zkConnectionManagerCallback-6530-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1726075 INFO  (jetty-launcher-6493-thread-3) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1726189 INFO  (jetty-launcher-6493-thread-3) [n:127.0.0.1:54449_solr     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:54449_solr
   [junit4]   2> 1726194 INFO  (jetty-launcher-6493-thread-3) [n:127.0.0.1:54449_solr     ] o.a.s.c.Overseer Overseer (id=72071428572381195-127.0.0.1:54449_solr-n_0000000000) starting
   [junit4]   2> 1726387 INFO  (OverseerStateUpdate-72071428572381195-127.0.0.1:54449_solr-n_0000000000) [n:127.0.0.1:54449_solr     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:54449_solr
   [junit4]   2> 1726388 INFO  (jetty-launcher-6493-thread-3) [n:127.0.0.1:54449_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54449_solr
   [junit4]   2> 1726394 INFO  (OverseerStateUpdate-72071428572381195-127.0.0.1:54449_solr-n_0000000000) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1726424 INFO  (jetty-launcher-6493-thread-3) [n:127.0.0.1:54449_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1726424 WARN  (jetty-launcher-6493-thread-3) [n:127.0.0.1:54449_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1726469 INFO  (jetty-launcher-6493-thread-3) [n:127.0.0.1:54449_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1726529 INFO  (jetty-launcher-6493-thread-3) [n:127.0.0.1:54449_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54449.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e8b3157
   [junit4]   2> 1726550 INFO  (jetty-launcher-6493-thread-3) [n:127.0.0.1:54449_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54449.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e8b3157
   [junit4]   2> 1726550 INFO  (jetty-launcher-6493-thread-3) [n:127.0.0.1:54449_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54449.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e8b3157
   [junit4]   2> 1726552 INFO  (jetty-launcher-6493-thread-3) [n:127.0.0.1:54449_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestSnapshotCloudManager_B80D2BDE30B54AAF-001/tempDir-001/node3/.
   [junit4]   2> 1726657 INFO  (jetty-launcher-6493-thread-2) [n:127.0.0.1:54447_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1726673 INFO  (jetty-launcher-6493-thread-2) [n:127.0.0.1:54447_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:54447_solr as DOWN
   [junit4]   2> 1726675 INFO  (jetty-launcher-6493-thread-2) [n:127.0.0.1:54447_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1726675 INFO  (jetty-launcher-6493-thread-2) [n:127.0.0.1:54447_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54447_solr
   [junit4]   2> 1726680 INFO  (zkCallback-6529-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1726680 INFO  (zkCallback-6515-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1726684 INFO  (jetty-launcher-6493-thread-2) [n:127.0.0.1:54447_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1726684 WARN  (jetty-launcher-6493-thread-2) [n:127.0.0.1:54447_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1726705 INFO  (jetty-launcher-6493-thread-2) [n:127.0.0.1:54447_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1726729 INFO  (jetty-launcher-6493-thread-1) [n:127.0.0.1:54448_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1726739 INFO  (jetty-launcher-6493-thread-1) [n:127.0.0.1:54448_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:54448_solr as DOWN
   [junit4]   2> 1726740 INFO  (jetty-launcher-6493-thread-2) [n:127.0.0.1:54447_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54447.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e8b3157
   [junit4]   2> 1726742 INFO  (jetty-launcher-6493-thread-1) [n:127.0.0.1:54448_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1726742 INFO  (jetty-launcher-6493-thread-1) [n:127.0.0.1:54448_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54448_solr
   [junit4]   2> 1726744 INFO  (zkCallback-6515-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1726744 INFO  (zkCallback-6517-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1726744 INFO  (zkCallback-6529-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1726747 INFO  (jetty-launcher-6493-thread-1) [n:127.0.0.1:54448_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1726747 WARN  (jetty-launcher-6493-thread-1) [n:127.0.0.1:54448_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1726752 INFO  (jetty-launcher-6493-thread-2) [n:127.0.0.1:54447_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54447.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e8b3157
   [junit4]   2> 1726752 INFO  (jetty-launcher-6493-thread-2) [n:127.0.0.1:54447_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54447.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e8b3157
   [junit4]   2> 1726754 INFO  (jetty-launcher-6493-thread-2) [n:127.0.0.1:54447_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestSnapshotCloudManager_B80D2BDE30B54AAF-001/tempDir-001/node2/.
   [junit4]   2> 1726767 INFO  (jetty-launcher-6493-thread-1) [n:127.0.0.1:54448_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1726801 INFO  (jetty-launcher-6493-thread-1) [n:127.0.0.1:54448_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54448.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e8b3157
   [junit4]   2> 1726815 INFO  (jetty-launcher-6493-thread-1) [n:127.0.0.1:54448_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54448.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e8b3157
   [junit4]   2> 1726816 INFO  (jetty-launcher-6493-thread-1) [n:127.0.0.1:54448_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54448.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e8b3157
   [junit4]   2> 1726829 INFO  (jetty-launcher-6493-thread-1) [n:127.0.0.1:54448_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestSnapshotCloudManager_B80D2BDE30B54AAF-001/tempDir-001/node1/.
   [junit4]   2> 1726888 INFO  (SUITE-TestSnapshotCloudManager-seed#[B80D2BDE30B54AAF]-worker) [     ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=3
   [junit4]   2> 1726889 INFO  (SUITE-TestSnapshotCloudManager-seed#[B80D2BDE30B54AAF]-worker) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1726893 INFO  (zkConnectionManagerCallback-6543-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1726893 INFO  (SUITE-TestSnapshotCloudManager-seed#[B80D2BDE30B54AAF]-worker) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1726896 INFO  (SUITE-TestSnapshotCloudManager-seed#[B80D2BDE30B54AAF]-worker) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 1726900 INFO  (SUITE-TestSnapshotCloudManager-seed#[B80D2BDE30B54AAF]-worker) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:54441/solr ready
   [junit4]   2> 1726928 INFO  (qtp902078625-19392) [n:127.0.0.1:54447_solr     ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=1&name=.system&nrtReplicas=2&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1726956 INFO  (OverseerThreadFactory-6240-thread-1-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.a.c.CreateCollectionCmd Create collection .system
   [junit4]   2> 1727093 INFO  (OverseerStateUpdate-72071428572381195-127.0.0.1:54449_solr-n_0000000000) [n:127.0.0.1:54449_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":".system_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:54448/solr",
   [junit4]   2>   "node_name":"127.0.0.1:54448_solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1727104 INFO  (OverseerStateUpdate-72071428572381195-127.0.0.1:54449_solr-n_0000000000) [n:127.0.0.1:54449_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":".system_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:54447/solr",
   [junit4]   2>   "node_name":"127.0.0.1:54447_solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1727115 INFO  (OverseerStateUpdate-72071428572381195-127.0.0.1:54449_solr-n_0000000000) [n:127.0.0.1:54449_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":".system",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":".system_shard1_replica_p4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:54449/solr",
   [junit4]   2>   "node_name":"127.0.0.1:54449_solr",
   [junit4]   2>   "type":"PULL",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1727349 INFO  (qtp902078625-19389) [n:127.0.0.1:54447_solr    x:.system_shard1_replica_n2 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n2&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1727355 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr    x:.system_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n1&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1727361 INFO  (qtp1548134176-19402) [n:127.0.0.1:54449_solr    x:.system_shard1_replica_p4 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=.system&newCollection=true&name=.system_shard1_replica_p4&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=PULL
   [junit4]   2> 1727361 INFO  (qtp1548134176-19402) [n:127.0.0.1:54449_solr    x:.system_shard1_replica_p4 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1727466 INFO  (qtp902078625-19389) [n:127.0.0.1:54447_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.5.0
   [junit4]   2> 1727472 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.5.0
   [junit4]   2> 1727478 INFO  (qtp902078625-19389) [n:127.0.0.1:54447_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
   [junit4]   2> 1727481 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
   [junit4]   2> 1727495 INFO  (qtp1548134176-19402) [n:127.0.0.1:54449_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.5.0
   [junit4]   2> 1727501 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.IndexSchema [.system_shard1_replica_n1] Schema name=_system collection or core
   [junit4]   2> 1727503 INFO  (qtp1548134176-19402) [n:127.0.0.1:54449_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
   [junit4]   2> 1727504 INFO  (qtp902078625-19389) [n:127.0.0.1:54447_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.s.IndexSchema [.system_shard1_replica_n2] Schema name=_system collection or core
   [junit4]   2> 1727505 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
   [junit4]   2> 1727509 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchema Created and persisted managed schema znode at /configs/.system/managed-schema
   [junit4]   2> 1727539 INFO  (qtp1548134176-19402) [n:127.0.0.1:54449_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.s.IndexSchema [.system_shard1_replica_p4] Schema name=_system collection or core
   [junit4]   2> 1727546 INFO  (qtp1548134176-19402) [n:127.0.0.1:54449_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
   [junit4]   2> 1727547 INFO  (qtp902078625-19389) [n:127.0.0.1:54447_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
   [junit4]   2> 1727550 INFO  (qtp902078625-19389) [n:127.0.0.1:54447_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.s.ManagedIndexSchema Managed schema znode at /configs/.system/managed-schema already exists - no need to create it
   [junit4]   2> 1727550 INFO  (qtp1548134176-19402) [n:127.0.0.1:54449_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.s.ManagedIndexSchema Managed schema znode at /configs/.system/managed-schema already exists - no need to create it
   [junit4]   2> 1727555 INFO  (qtp902078625-19389) [n:127.0.0.1:54447_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_n2' using configuration from configset .system, trusted=true
   [junit4]   2> 1727556 INFO  (qtp902078625-19389) [n:127.0.0.1:54447_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54447.solr.core..system.shard1.replica_n2' (registry 'solr.core..system.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e8b3157
   [junit4]   2> 1727556 INFO  (qtp902078625-19389) [n:127.0.0.1:54447_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.c.SolrCore [[.system_shard1_replica_n2] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestSnapshotCloudManager_B80D2BDE30B54AAF-001/tempDir-001/node2/.system_shard1_replica_n2], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestSnapshotCloudManager_B80D2BDE30B54AAF-001/tempDir-001/node2/./.system_shard1_replica_n2/data/]
   [junit4]   2> 1727557 INFO  (qtp1548134176-19402) [n:127.0.0.1:54449_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_p4' using configuration from configset .system, trusted=true
   [junit4]   2> 1727557 INFO  (qtp1548134176-19402) [n:127.0.0.1:54449_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54449.solr.core..system.shard1.replica_p4' (registry 'solr.core..system.shard1.replica_p4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e8b3157
   [junit4]   2> 1727557 INFO  (qtp1548134176-19402) [n:127.0.0.1:54449_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.c.SolrCore [[.system_shard1_replica_p4] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestSnapshotCloudManager_B80D2BDE30B54AAF-001/tempDir-001/node3/.system_shard1_replica_p4], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestSnapshotCloudManager_B80D2BDE30B54AAF-001/tempDir-001/node3/./.system_shard1_replica_p4/data/]
   [junit4]   2> 1727562 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, renamed the non-managed schema /configs/.system/schema.xml to /configs/.system/schema.xml.bak
   [junit4]   2> 1727567 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_n1' using configuration from configset .system, trusted=true
   [junit4]   2> 1727568 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54448.solr.core..system.shard1.replica_n1' (registry 'solr.core..system.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e8b3157
   [junit4]   2> 1727568 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SolrCore [[.system_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestSnapshotCloudManager_B80D2BDE30B54AAF-001/tempDir-001/node1/.system_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestSnapshotCloudManager_B80D2BDE30B54AAF-001/tempDir-001/node1/./.system_shard1_replica_n1/data/]
   [junit4]   2> 1727737 INFO  (qtp902078625-19389) [n:127.0.0.1:54447_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1727737 INFO  (qtp902078625-19389) [n:127.0.0.1:54447_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1727740 INFO  (qtp902078625-19389) [n:127.0.0.1:54447_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommitted docs; 
   [junit4]   2> 1727740 INFO  (qtp902078625-19389) [n:127.0.0.1:54447_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1727745 INFO  (qtp902078625-19389) [n:127.0.0.1:54447_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@5a8e7dae[.system_shard1_replica_n2] main]
   [junit4]   2> 1727746 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1727746 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1727748 INFO  (qtp902078625-19389) [n:127.0.0.1:54447_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
   [junit4]   2> 1727749 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommitted docs; 
   [junit4]   2> 1727749 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1727749 INFO  (qtp902078625-19389) [n:127.0.0.1:54447_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
   [junit4]   2> 1727749 INFO  (qtp902078625-19389) [n:127.0.0.1:54447_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
   [junit4]   2> 1727751 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@5570dc9f[.system_shard1_replica_n1] main]
   [junit4]   2> 1727751 INFO  (qtp1548134176-19402) [n:127.0.0.1:54449_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommitted docs; 
   [junit4]   2> 1727751 INFO  (qtp902078625-19389) [n:127.0.0.1:54447_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 0 from ZooKeeper
   [junit4]   2> 1727752 INFO  (qtp1548134176-19402) [n:127.0.0.1:54449_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1727754 INFO  (qtp1548134176-19402) [n:127.0.0.1:54449_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@8f5f34b[.system_shard1_replica_p4] main]
   [junit4]   2> 1727755 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
   [junit4]   2> 1727755 INFO  (qtp902078625-19389) [n:127.0.0.1:54447_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.s.IndexSchema [.system_shard1_replica_n2] Schema name=_system collection or core
   [junit4]   2> 1727756 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
   [junit4]   2> 1727756 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
   [junit4]   2> 1727764 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 1727767 INFO  (qtp1548134176-19402) [n:127.0.0.1:54449_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
   [junit4]   2> 1727767 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1727768 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1660133382536822784
   [junit4]   2> 1727769 INFO  (qtp1548134176-19402) [n:127.0.0.1:54449_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
   [junit4]   2> 1727769 INFO  (qtp1548134176-19402) [n:127.0.0.1:54449_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
   [junit4]   2> 1727771 INFO  (qtp1548134176-19402) [n:127.0.0.1:54449_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 0 from ZooKeeper
   [junit4]   2> 1727772 INFO  (qtp902078625-19389) [n:127.0.0.1:54447_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
   [junit4]   2> 1727773 INFO  (qtp902078625-19389) [n:127.0.0.1:54447_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 21 ms
   [junit4]   2> 1727774 INFO  (qtp902078625-19389) [n:127.0.0.1:54447_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1727774 INFO  (searcherExecutor-6255-thread-1-processing-n:127.0.0.1:54448_solr x:.system_shard1_replica_n1 c:.system s:shard1 r:core_node3) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SolrCore [.system_shard1_replica_n1] Registered new searcher Searcher@5570dc9f[.system_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1727774 INFO  (qtp902078625-19389) [n:127.0.0.1:54447_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1660133382543114240
   [junit4]   2> 1727776 INFO  (qtp1548134176-19402) [n:127.0.0.1:54449_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.s.IndexSchema [.system_shard1_replica_p4] Schema name=_system collection or core
   [junit4]   2> 1727780 INFO  (searcherExecutor-6253-thread-1-processing-n:127.0.0.1:54447_solr x:.system_shard1_replica_n2 c:.system s:shard1 r:core_node5) [n:127.0.0.1:54447_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.c.SolrCore [.system_shard1_replica_n2] Registered new searcher Searcher@5a8e7dae[.system_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1727782 INFO  (qtp1548134176-19402) [n:127.0.0.1:54449_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
   [junit4]   2> 1727782 INFO  (qtp1548134176-19402) [n:127.0.0.1:54449_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 10 ms
   [junit4]   2> 1727783 INFO  (qtp1548134176-19402) [n:127.0.0.1:54449_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1727786 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/.system/terms/shard1 to Terms{values={core_node3=0}, version=0}
   [junit4]   2> 1727786 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/.system/leaders/shard1
   [junit4]   2> 1727790 INFO  (searcherExecutor-6254-thread-1-processing-n:127.0.0.1:54449_solr x:.system_shard1_replica_p4 c:.system s:shard1 r:core_node6) [n:127.0.0.1:54449_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.c.SolrCore [.system_shard1_replica_p4] Registered new searcher Searcher@8f5f34b[.system_shard1_replica_p4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1727794 INFO  (qtp902078625-19389) [n:127.0.0.1:54447_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/.system/terms/shard1 to Terms{values={core_node3=0, core_node5=0}, version=1}
   [junit4]   2> 1727794 INFO  (qtp902078625-19389) [n:127.0.0.1:54447_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/.system/leaders/shard1
   [junit4]   2> 1727806 INFO  (qtp1548134176-19402) [n:127.0.0.1:54449_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.c.ZkController .system_shard1_replica_p4 starting background replication from leader
   [junit4]   2> 1727806 INFO  (qtp1548134176-19402) [n:127.0.0.1:54449_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:01
   [junit4]   2> 1727812 INFO  (qtp1548134176-19402) [n:127.0.0.1:54449_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms
   [junit4]   2> 1727812 INFO  (qtp1548134176-19402) [n:127.0.0.1:54449_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1727813 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1727813 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1727813 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:54448/solr/.system_shard1_replica_n1/
   [junit4]   2> 1727815 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.PeerSync PeerSync: core=.system_shard1_replica_n1 url=https://127.0.0.1:54448/solr START replicas=[https://127.0.0.1:54447/solr/.system_shard1_replica_n2/] nUpdates=100
   [junit4]   2> 1727816 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.u.PeerSync PeerSync: core=.system_shard1_replica_n1 url=https://127.0.0.1:54448/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 1727835 INFO  (qtp902078625-19391) [n:127.0.0.1:54447_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.c.S.Request [.system_shard1_replica_n2]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1727835 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 1727836 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1727836 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/.system/leaders/shard1/leader after winning as /collections/.system/leader_elect/shard1/election/72071428572381193-core_node3-n_0000000000
   [junit4]   2> 1727846 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:54448/solr/.system_shard1_replica_n1/ shard1
   [junit4]   2> 1727995 INFO  (zkCallback-6517-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1727996 INFO  (zkCallback-6517-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1727998 INFO  (zkCallback-6529-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1727998 INFO  (zkCallback-6529-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1728004 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Replica core_node3 is leader but it's state is down, skipping replication
   [junit4]   2> 1728036 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1728080 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n1&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=725
   [junit4]   2> 1728182 INFO  (zkCallback-6517-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1728182 INFO  (zkCallback-6517-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1728182 INFO  (zkCallback-6517-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1728811 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Last replication failed, so I'll force replication
   [junit4]   2> 1728816 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Updated masterUrl to https://127.0.0.1:54448/solr/.system_shard1_replica_n1/
   [junit4]   2> 1728853 INFO  (qtp1379743144-19383) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1728853 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 1728853 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 1728853 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Slave's generation: 1
   [junit4]   2> 1728853 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Slave's version: 0
   [junit4]   2> 1728853 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
   [junit4]   2> 1728854 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1728854 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@412102e commitCommandVersion:0
   [junit4]   2> 1728889 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.s.SolrIndexSearcher Opening [Searcher@6d75266a[.system_shard1_replica_p4] main]
   [junit4]   2> 1728891 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1728893 INFO  (searcherExecutor-6254-thread-1) [     ] o.a.s.c.SolrCore [.system_shard1_replica_p4] Registered new searcher Searcher@6d75266a[.system_shard1_replica_p4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1728951 INFO  (qtp1548134176-19402) [n:127.0.0.1:54449_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_p4 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node6&collection.configName=.system&newCollection=true&name=.system_shard1_replica_p4&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=PULL} status=0 QTime=1591
   [junit4]   2> 1728984 INFO  (qtp902078625-19389) [n:127.0.0.1:54447_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n2&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1635
   [junit4]   2> 1729017 INFO  (qtp902078625-19392) [n:127.0.0.1:54447_solr     ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
   [junit4]   2> 1729105 INFO  (zkCallback-6515-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1729105 INFO  (zkCallback-6517-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1729105 INFO  (zkCallback-6517-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1729105 INFO  (zkCallback-6515-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1729106 INFO  (zkCallback-6517-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1729107 INFO  (zkCallback-6529-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1729107 INFO  (zkCallback-6529-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1729108 INFO  (zkCallback-6529-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1729109 INFO  (qtp902078625-19392) [n:127.0.0.1:54447_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=1&name=.system&nrtReplicas=2&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2} status=0 QTime=2181
   [junit4]   2> 1729110 INFO  (qtp902078625-19390) [n:127.0.0.1:54447_solr     ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params name=coll1&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1729177 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.a.c.CreateCollectionCmd Create collection coll1
   [junit4]   2> 1729178 INFO  (OverseerCollectionConfigSetProcessor-72071428572381195-127.0.0.1:54449_solr-n_0000000000) [n:127.0.0.1:54449_solr     ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1729213 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/managed-schema to /configs/coll1.AUTOCREATED/managed-schema
   [junit4]   2> 1729320 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/protwords.txt to /configs/coll1.AUTOCREATED/protwords.txt
   [junit4]   2> 1729397 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_it.txt to /configs/coll1.AUTOCREATED/lang/contractions_it.txt
   [junit4]   2> 1729479 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ca.txt to /configs/coll1.AUTOCREATED/lang/contractions_ca.txt
   [junit4]   2> 1729545 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stemdict_nl.txt to /configs/coll1.AUTOCREATED/lang/stemdict_nl.txt
   [junit4]   2> 1729632 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_no.txt to /configs/coll1.AUTOCREATED/lang/stopwords_no.txt
   [junit4]   2> 1729720 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hy.txt to /configs/coll1.AUTOCREATED/lang/stopwords_hy.txt
   [junit4]   2> 1729794 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_id.txt to /configs/coll1.AUTOCREATED/lang/stopwords_id.txt
   [junit4]   2> 1729822 INFO  (qtp1379743144-19386) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1729824 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 1729824 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 1729824 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Slave's generation: 2
   [junit4]   2> 1729824 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Slave's version: 1583226569820
   [junit4]   2> 1729824 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
   [junit4]   2> 1729824 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1729824 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@412102e commitCommandVersion:0
   [junit4]   2> 1729825 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.s.SolrIndexSearcher Opening [Searcher@6ea03abc[.system_shard1_replica_p4] main]
   [junit4]   2> 1729856 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_et.txt to /configs/coll1.AUTOCREATED/lang/stopwords_et.txt
   [junit4]   2> 1729865 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1729867 INFO  (searcherExecutor-6254-thread-1) [     ] o.a.s.c.SolrCore [.system_shard1_replica_p4] Registered new searcher Searcher@6ea03abc[.system_shard1_replica_p4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1729966 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_da.txt to /configs/coll1.AUTOCREATED/lang/stopwords_da.txt
   [junit4]   2> 1730013 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hi.txt to /configs/coll1.AUTOCREATED/lang/stopwords_hi.txt
   [junit4]   2> 1730090 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ga.txt to /configs/coll1.AUTOCREATED/lang/stopwords_ga.txt
   [junit4]   2> 1730118 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_pt.txt to /configs/coll1.AUTOCREATED/lang/stopwords_pt.txt
   [junit4]   2> 1730133 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ja.txt to /configs/coll1.AUTOCREATED/lang/stopwords_ja.txt
   [junit4]   2> 1730153 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hu.txt to /configs/coll1.AUTOCREATED/lang/stopwords_hu.txt
   [junit4]   2> 1730167 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_el.txt to /configs/coll1.AUTOCREATED/lang/stopwords_el.txt
   [junit4]   2> 1730201 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ru.txt to /configs/coll1.AUTOCREATED/lang/stopwords_ru.txt
   [junit4]   2> 1730206 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_tr.txt to /configs/coll1.AUTOCREATED/lang/stopwords_tr.txt
   [junit4]   2> 1730211 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ar.txt to /configs/coll1.AUTOCREATED/lang/stopwords_ar.txt
   [junit4]   2> 1730216 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/userdict_ja.txt to /configs/coll1.AUTOCREATED/lang/userdict_ja.txt
   [junit4]   2> 1730222 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_eu.txt to /configs/coll1.AUTOCREATED/lang/stopwords_eu.txt
   [junit4]   2> 1730231 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_it.txt to /configs/coll1.AUTOCREATED/lang/stopwords_it.txt
   [junit4]   2> 1730240 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_cz.txt to /configs/coll1.AUTOCREATED/lang/stopwords_cz.txt
   [junit4]   2> 1730246 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stoptags_ja.txt to /configs/coll1.AUTOCREATED/lang/stoptags_ja.txt
   [junit4]   2> 1730251 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_fr.txt to /configs/coll1.AUTOCREATED/lang/contractions_fr.txt
   [junit4]   2> 1730260 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_de.txt to /configs/coll1.AUTOCREATED/lang/stopwords_de.txt
   [junit4]   2> 1730263 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fa.txt to /configs/coll1.AUTOCREATED/lang/stopwords_fa.txt
   [junit4]   2> 1730268 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ga.txt to /configs/coll1.AUTOCREATED/lang/contractions_ga.txt
   [junit4]   2> 1730272 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ca.txt to /configs/coll1.AUTOCREATED/lang/stopwords_ca.txt
   [junit4]   2> 1730277 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_nl.txt to /configs/coll1.AUTOCREATED/lang/stopwords_nl.txt
   [junit4]   2> 1730304 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_bg.txt to /configs/coll1.AUTOCREATED/lang/stopwords_bg.txt
   [junit4]   2> 1730355 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_es.txt to /configs/coll1.AUTOCREATED/lang/stopwords_es.txt
   [junit4]   2> 1730382 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_lv.txt to /configs/coll1.AUTOCREATED/lang/stopwords_lv.txt
   [junit4]   2> 1730444 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_en.txt to /configs/coll1.AUTOCREATED/lang/stopwords_en.txt
   [junit4]   2> 1730541 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ro.txt to /configs/coll1.AUTOCREATED/lang/stopwords_ro.txt
   [junit4]   2> 1730583 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_th.txt to /configs/coll1.AUTOCREATED/lang/stopwords_th.txt
   [junit4]   2> 1730604 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fr.txt to /configs/coll1.AUTOCREATED/lang/stopwords_fr.txt
   [junit4]   2> 1730648 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_sv.txt to /configs/coll1.AUTOCREATED/lang/stopwords_sv.txt
   [junit4]   2> 1730712 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fi.txt to /configs/coll1.AUTOCREATED/lang/stopwords_fi.txt
   [junit4]   2> 1730767 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/hyphenations_ga.txt to /configs/coll1.AUTOCREATED/lang/hyphenations_ga.txt
   [junit4]   2> 1730824 INFO  (qtp1379743144-19394) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1730826 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 1730827 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 1730827 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Slave's generation: 3
   [junit4]   2> 1730827 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Slave's version: 1583226570790
   [junit4]   2> 1730827 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
   [junit4]   2> 1730827 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1730827 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@412102e commitCommandVersion:0
   [junit4]   2> 1730836 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_gl.txt to /configs/coll1.AUTOCREATED/lang/stopwords_gl.txt
   [junit4]   2> 1730840 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.s.SolrIndexSearcher Opening [Searcher@60dbbbd[.system_shard1_replica_p4] main]
   [junit4]   2> 1730840 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1730842 INFO  (searcherExecutor-6254-thread-1) [     ] o.a.s.c.SolrCore [.system_shard1_replica_p4] Registered new searcher Searcher@60dbbbd[.system_shard1_replica_p4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1730913 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/solrconfig.xml to /configs/coll1.AUTOCREATED/solrconfig.xml
   [junit4]   2> 1730941 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/synonyms.txt to /configs/coll1.AUTOCREATED/synonyms.txt
   [junit4]   2> 1730975 INFO  (OverseerThreadFactory-6240-thread-2-processing-n:127.0.0.1:54449_solr) [n:127.0.0.1:54449_solr     ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/stopwords.txt to /configs/coll1.AUTOCREATED/stopwords.txt
   [junit4]   2> 1731423 INFO  (OverseerStateUpdate-72071428572381195-127.0.0.1:54449_solr-n_0000000000) [n:127.0.0.1:54449_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"coll1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"coll1_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:54447/solr",
   [junit4]   2>   "node_name":"127.0.0.1:54447_solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1731718 INFO  (qtp902078625-19391) [n:127.0.0.1:54447_solr    x:coll1_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=coll1.AUTOCREATED&newCollection=true&name=coll1_shard1_replica_n1&action=CREATE&numShards=1&collection=coll1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1731845 INFO  (qtp1379743144-19395) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1731848 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 1731848 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 1731848 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Slave's generation: 4
   [junit4]   2> 1731848 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Slave's version: 1583226571793
   [junit4]   2> 1731848 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
   [junit4]   2> 1731849 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1731849 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@412102e commitCommandVersion:0
   [junit4]   2> 1731867 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.s.SolrIndexSearcher Opening [Searcher@63d37ff1[.system_shard1_replica_p4] main]
   [junit4]   2> 1731867 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1731875 INFO  (searcherExecutor-6254-thread-1) [     ] o.a.s.c.SolrCore [.system_shard1_replica_p4] Registered new searcher Searcher@63d37ff1[.system_shard1_replica_p4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1732103 INFO  (qtp902078625-19391) [n:127.0.0.1:54447_solr c:coll1 s:shard1 r:core_node2 x:coll1_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.5.0
   [junit4]   2> 1732144 INFO  (qtp902078625-19391) [n:127.0.0.1:54447_solr c:coll1 s:shard1 r:core_node2 x:coll1_shard1_replica_n1 ] o.a.s.s.IndexSchema [coll1_shard1_replica_n1] Schema name=default-config
   [junit4]   2> 1732819 INFO  (qtp1379743144-19383) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=4
   [junit4]   2> 1732821 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 1732821 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 1732821 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Slave's generation: 5
   [junit4]   2> 1732821 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Slave's version: 1583226572815
   [junit4]   2> 1732821 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
   [junit4]   2> 1732821 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1732822 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@412102e commitCommandVersion:0
   [junit4]   2> 1732822 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.s.SolrIndexSearcher Opening [Searcher@770bbde8[.system_shard1_replica_p4] main]
   [junit4]   2> 1732838 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1732900 INFO  (searcherExecutor-6254-thread-1) [     ] o.a.s.c.SolrCore [.system_shard1_replica_p4] Registered new searcher Searcher@770bbde8[.system_shard1_replica_p4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1733435 INFO  (qtp902078625-19391) [n:127.0.0.1:54447_solr c:coll1 s:shard1 r:core_node2 x:coll1_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema default-config/1.6 with uniqueid field id
   [junit4]   2> 1733817 INFO  (qtp1379743144-19386) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=1
   [junit4]   2> 1733817 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 1733817 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 1733817 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Slave's generation: 6
   [junit4]   2> 1733817 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Slave's version: 1583226573788
   [junit4]   2> 1733817 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
   [junit4]   2> 1733817 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1733817 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@412102e commitCommandVersion:0
   [junit4]   2> 1733829 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.s.SolrIndexSearcher Opening [Searcher@55ceed98[.system_shard1_replica_p4] main]
   [junit4]   2> 1733829 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1733831 INFO  (searcherExecutor-6254-thread-1) [     ] o.a.s.c.SolrCore [.system_shard1_replica_p4] Registered new searcher Searcher@55ceed98[.system_shard1_replica_p4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1734556 INFO  (qtp902078625-19391) [n:127.0.0.1:54447_solr c:coll1 s:shard1 r:core_node2 x:coll1_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'coll1_shard1_replica_n1' using configuration from configset coll1.AUTOCREATED, trusted=true
   [junit4]   2> 1734558 INFO  (qtp902078625-19391) [n:127.0.0.1:54447_solr c:coll1 s:shard1 r:core_node2 x:coll1_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54447.solr.core.coll1.shard1.replica_n1' (registry 'solr.core.coll1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e8b3157
   [junit4]   2> 1734559 INFO  (qtp902078625-19391) [n:127.0.0.1:54447_solr c:coll1 s:shard1 r:core_node2 x:coll1_shard1_replica_n1 ] o.a.s.c.SolrCore [[coll1_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestSnapshotCloudManager_B80D2BDE30B54AAF-001/tempDir-001/node2/coll1_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestSnapshotCloudManager_B80D2BDE30B54AAF-001/tempDir-001/node2/./coll1_shard1_replica_n1/data/]
   [junit4]   2> 1734824 INFO  (qtp1379743144-19394) [n:127.0.0.1:54448_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1 ] o.a.s.c.S.Request [.system_shard1_replica_n1]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1734830 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 1734830 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 1734830 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Slave's generation: 7
   [junit4]   2> 1734830 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher Slave's version: 1583226574783
   [junit4]   2> 1734830 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
   [junit4]   2> 1734830 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1734830 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@412102e commitCommandVersion:0
   [junit4]   2> 1734846 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.s.SolrIndexSearcher Opening [Searcher@293d468[.system_shard1_replica_p4] main]
   [junit4]   2> 1734855 INFO  (indexFetcher-6268-thread-1) [     ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1734888 INFO  (searcherExecutor-6254-thread-1) [     ] o.a.s.c.SolrCore [.system_shard1_replica_p4] Registered new searcher Searcher@293d468[.system_shard1_replica_p4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1735026 INFO  (qtp902078625-19391) [n:127.

[...truncated too long message...]

pped ServerConnector@3f3ccbd1{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:0}
   [junit4]   2> 1745693 INFO  (jetty-closer-6549-thread-2) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@58fceadc{/solr,null,UNAVAILABLE}
   [junit4]   2> 1745693 INFO  (jetty-closer-6549-thread-2) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1745797 INFO  (jetty-closer-6549-thread-3) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@58c55ed8{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:0}
   [junit4]   2> 1745798 INFO  (jetty-closer-6549-thread-3) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@32eb132e{/solr,null,UNAVAILABLE}
   [junit4]   2> 1745798 INFO  (jetty-closer-6549-thread-3) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1745801 INFO  (SUITE-TestSnapshotCloudManager-seed#[B80D2BDE30B54AAF]-worker) [     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 1746023 WARN  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/collections/.system/terms/shard1
   [junit4]   2> 	4	/solr/aliases.json
   [junit4]   2> 	3	/solr/configs/.system
   [junit4]   2> 	3	/solr/packages.json
   [junit4]   2> 	3	/solr/security.json
   [junit4]   2> 	3	/solr/configs/.system/managed-schema
   [junit4]   2> 	2	/solr/collections/coll1/terms/shard1
   [junit4]   2> 	2	/solr/collections/coll10/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	45	/solr/collections/.system/state.json
   [junit4]   2> 	12	/solr/collections/coll10/state.json
   [junit4]   2> 	12	/solr/collections/coll1/state.json
   [junit4]   2> 	4	/solr/clusterstate.json
   [junit4]   2> 	4	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/autoscaling.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	43	/solr/overseer/queue
   [junit4]   2> 	16	/solr/collections
   [junit4]   2> 	12	/solr/live_nodes
   [junit4]   2> 	12	/solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> 1746028 INFO  (SUITE-TestSnapshotCloudManager-seed#[B80D2BDE30B54AAF]-worker) [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:54441
   [junit4]   2> 1746028 INFO  (SUITE-TestSnapshotCloudManager-seed#[B80D2BDE30B54AAF]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:54441
   [junit4]   2> 1746028 INFO  (SUITE-TestSnapshotCloudManager-seed#[B80D2BDE30B54AAF]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 54441
   [junit4]   2> 1746029 INFO  (SUITE-TestSnapshotCloudManager-seed#[B80D2BDE30B54AAF]-worker) [     ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> Mar 03, 2020 9:09:47 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> Mar 03, 2020 9:09:57 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.cloud.autoscaling.sim.TestSnapshotCloudManager: 
   [junit4]   2>    1) Thread[id=19351, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestSnapshotCloudManager]
   [junit4]   2>         at java.base@12.0.2/java.lang.Thread.sleep(Native Method)
   [junit4]   2>         at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
   [junit4]   2> Mar 03, 2020 9:09:57 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=19351, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestSnapshotCloudManager]
   [junit4]   2> 1756113 ERROR (SessionTracker) [     ] o.a.z.s.ZooKeeperCriticalThread Severe unrecoverable error, from thread : SessionTracker
   [junit4]   2>           => java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 	at java.base/java.lang.Thread.sleep(Native Method)
   [junit4]   2> java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 	at java.lang.Thread.sleep(Native Method) [?:?]
   [junit4]   2> 	at org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) ~[zookeeper-3.5.5.jar:3.5.5]
   [junit4]   2> Mar 03, 2020 9:09:57 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: All leaked threads terminated.
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@33a9c8b0), locale=pt-AO, timezone=America/Anguilla
   [junit4]   2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 12.0.2 (64-bit)/cpus=6,threads=1,free=97752224,total=534773760
   [junit4]   2> NOTE: All tests run in this JVM: [DirectSolrConnectionTest, DistributedFacetPivotLargeTest, SharedFSAutoReplicaFailoverTest, BasicDistributedZk2Test, MoreLikeThisHandlerTest, TestSafeXMLParsing, SpellCheckCollatorWithCollapseTest, HdfsRestartWhileUpdatingTest, PreAnalyzedFieldTest, PhrasesIdentificationComponentTest, TestDistributedMap, CustomTermsComponentTest, V2ApiIntegrationTest, TestShortCircuitedRequests, TestExportTool, TestCoreAdminApis, TestTlogReplica, TestPartialUpdateDeduplication, TestGraphMLResponseWriter, TestNestedUpdateProcessor, UniqFieldsUpdateProcessorFactoryTest, SolrJmxReporterCloudTest, BasicFunctionalityTest, CategoryRoutedAliasUpdateProcessorTest, ZkStateWriterTest, TestCoreContainer, CoreMergeIndexesAdminHandlerTest, TestFoldingMultitermQuery, ZkShardTermsTest, OverriddenZkACLAndCredentialsProvidersTest, TestRawTransformer, TermVectorComponentDistributedTest, TestPayloadScoreQParserPlugin, EmbeddedSolrNoSerializeTest, SuggesterFSTTest, TestSimpleQParserPlugin, TestTolerantSearch, MultiSolrCloudTestCaseTest, TestSchemaField, TestComplexPhraseQParserPlugin, DistributedSuggestComponentTest, CurrencyRangeFacetCloudTest, ReplaceNodeNoTargetTest, StatsReloadRaceTest, TestWithCollection, ConnectionReuseTest, HdfsCollectionsAPIDistributedZkTest, TestPerFieldSimilarity, TestRandomRequestDistribution, CdcrBidirectionalTest, LeaderTragicEventTest, HdfsChaosMonkeyNothingIsSafeTest, SplitShardTest, TestUseDocValuesAsStored, TestManagedSchema, TestDistributedSearch, TestStandardQParsers, JWTAuthPluginTest, TestCollectionsAPIViaSolrCloudCluster, TestManagedResourceStorage, PeerSyncWithLeaderTest, DateFieldTest, PreAnalyzedUpdateProcessorTest, DeleteShardTest, HdfsDirectoryTest, TestCloudManagedSchema, LeaderElectionContextKeyTest, TestCSVLoader, TestDynamicFieldResource, TestQuerySenderListener, BinaryUpdateRequestHandlerTest, DistributedQueueTest, TestRandomDVFaceting, TestDeprecatedFilters, SolrCoreCheckLockOnStartupTest, DefaultValueUpdateProcessorTest, BlobRepositoryCloudTest, SimpleMLTQParserTest, SpatialFilterTest, TestFacetMethods, TestFieldCacheReopen, TestDelegationWithHadoopAuth, SolrRrdBackendFactoryTest, TestSimGenericDistributedQueue, TestExplainDocTransformer, VersionInfoTest, AutoscalingHistoryHandlerTest, FullSolrCloudDistribCmdsTest, MigrateRouteKeyTest, PeerSyncReplicationTest, TestCloudPivotFacet, TestCloudSearcherWarming, TestLockTree, TestMiniSolrCloudClusterSSL, TestStressInPlaceUpdates, ZkNodePropsTest, CollectionReloadTest, CollectionsAPIAsyncDistributedZkTest, AutoScalingHandlerTest, HdfsAutoAddReplicasIntegrationTest, HttpTriggerListenerTest, IndexSizeTriggerSizeEstimationTest, NodeLostTriggerTest, TriggerCooldownIntegrationTest, TestSnapshotCloudManager]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSnapshotCloudManager -Dtests.seed=B80D2BDE30B54AAF -Dtests.slow=true -Dtests.locale=pt-AO -Dtests.timezone=America/Anguilla -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J1 | TestSnapshotCloudManager (suite) <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.autoscaling.sim.TestSnapshotCloudManager: 
   [junit4]    >    1) Thread[id=19351, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestSnapshotCloudManager]
   [junit4]    >         at java.base@12.0.2/java.lang.Thread.sleep(Native Method)
   [junit4]    >         at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([B80D2BDE30B54AAF]:0)
   [junit4] Completed [596/901 (1!)] on J1 in 31.36s, 5 tests, 1 error <<< FAILURES!

[...truncated 49010 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-MacOSX/707/consoleText

[repro] Revision: b8bfccebf6dde5d2ee38f42a2509629564ae9b0f

[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseG1GC"
[repro] Repro line:  ant test  -Dtestcase=TestSnapshotCloudManager -Dtests.seed=B80D2BDE30B54AAF -Dtests.slow=true -Dtests.locale=pt-AO -Dtests.timezone=America/Anguilla -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       TestSnapshotCloudManager
[repro] ant compile-test

[...truncated 3445 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestSnapshotCloudManager" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseG1GC" -Dtests.seed=B80D2BDE30B54AAF -Dtests.slow=true -Dtests.locale=pt-AO -Dtests.timezone=America/Anguilla -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[...truncated 101 lines...]
[repro] Failures w/original seeds:
[repro]   0/5 failed: org.apache.solr.cloud.autoscaling.sim.TestSnapshotCloudManager
[repro] Exiting with code 0

[...truncated 73 lines...]

[JENKINS] Lucene-Solr-8.x-MacOSX (64bit/jdk-13.0.2) - Build # 708 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-MacOSX/708/
Java: 64bit/jdk-13.0.2 -XX:+UseCompressedOops -XX:+UseG1GC

1 tests failed.
FAILED:  org.apache.solr.cloud.autoscaling.SearchRateTriggerTest.testWaitForElapsed

Error Message:
[{   "id":"cf42aee3e697Tcom9jur2v5r0fx81am7ix4u3n",   "source":"search_rate_trigger2",   "eventTime":227885308962455,   "eventType":"SEARCHRATE",   "properties":{     "hotReplicas":[       {"core_node7":{           "core":"SearchRateTriggerTest-collection1_shard2_replica_n4",           "shard":"shard2",           "collection":"SearchRateTriggerTest-collection1",           "node_name":"127.0.0.1:49740_solr",           "type":"NRT",           "rate":2.0,           "base_url":"http://127.0.0.1:49740/solr",           "state":"active",           "force_set_state":"false"}},       {"core_node8":{           "core":"SearchRateTriggerTest-collection1_shard2_replica_n6",           "shard":"shard2",           "collection":"SearchRateTriggerTest-collection1",           "node_name":"127.0.0.1:49741_solr",           "type":"NRT",           "leader":"true",           "rate":2.0,           "base_url":"http://127.0.0.1:49741/solr",           "state":"active",           "force_set_state":"false"}},       {"core_node3":{           "core":"SearchRateTriggerTest-collection1_shard1_replica_n1",           "shard":"shard1",           "collection":"SearchRateTriggerTest-collection1",           "node_name":"127.0.0.1:49739_solr",           "type":"NRT",           "rate":2.0,           "base_url":"http://127.0.0.1:49739/solr",           "state":"active",           "force_set_state":"false"}},       {"core_node5":{           "core":"SearchRateTriggerTest-collection1_shard1_replica_n2",           "shard":"shard1",           "collection":"SearchRateTriggerTest-collection1",           "node_name":"127.0.0.1:49744_solr",           "type":"NRT",           "leader":"true",           "rate":2.0,           "base_url":"http://127.0.0.1:49744/solr",           "state":"active",           "force_set_state":"false"}}],     "coldNodes":{},     "coldShards":{},     "coldReplicas":[],     "violationType":["hotShards"],     "coldCollections":{},     "hotShards":{"SearchRateTriggerTest-collection1":{         "shard2":2.0,         "shard1":2.0}},     "hotCollections":{"SearchRateTriggerTest-collection1":8.0},     "hotNodes":{},     "requestedOps":[       {         "action":"ADDREPLICA",         "hints":{"COLL_SHARD":[{               "first":"SearchRateTriggerTest-collection1",               "second":"shard2"}]}},       {         "action":"ADDREPLICA",         "hints":{"COLL_SHARD":[{               "first":"SearchRateTriggerTest-collection1",               "second":"shard1"}]}}]}}]

Stack Trace:
java.lang.AssertionError: [{
  "id":"cf42aee3e697Tcom9jur2v5r0fx81am7ix4u3n",
  "source":"search_rate_trigger2",
  "eventTime":227885308962455,
  "eventType":"SEARCHRATE",
  "properties":{
    "hotReplicas":[
      {"core_node7":{
          "core":"SearchRateTriggerTest-collection1_shard2_replica_n4",
          "shard":"shard2",
          "collection":"SearchRateTriggerTest-collection1",
          "node_name":"127.0.0.1:49740_solr",
          "type":"NRT",
          "rate":2.0,
          "base_url":"http://127.0.0.1:49740/solr",
          "state":"active",
          "force_set_state":"false"}},
      {"core_node8":{
          "core":"SearchRateTriggerTest-collection1_shard2_replica_n6",
          "shard":"shard2",
          "collection":"SearchRateTriggerTest-collection1",
          "node_name":"127.0.0.1:49741_solr",
          "type":"NRT",
          "leader":"true",
          "rate":2.0,
          "base_url":"http://127.0.0.1:49741/solr",
          "state":"active",
          "force_set_state":"false"}},
      {"core_node3":{
          "core":"SearchRateTriggerTest-collection1_shard1_replica_n1",
          "shard":"shard1",
          "collection":"SearchRateTriggerTest-collection1",
          "node_name":"127.0.0.1:49739_solr",
          "type":"NRT",
          "rate":2.0,
          "base_url":"http://127.0.0.1:49739/solr",
          "state":"active",
          "force_set_state":"false"}},
      {"core_node5":{
          "core":"SearchRateTriggerTest-collection1_shard1_replica_n2",
          "shard":"shard1",
          "collection":"SearchRateTriggerTest-collection1",
          "node_name":"127.0.0.1:49744_solr",
          "type":"NRT",
          "leader":"true",
          "rate":2.0,
          "base_url":"http://127.0.0.1:49744/solr",
          "state":"active",
          "force_set_state":"false"}}],
    "coldNodes":{},
    "coldShards":{},
    "coldReplicas":[],
    "violationType":["hotShards"],
    "coldCollections":{},
    "hotShards":{"SearchRateTriggerTest-collection1":{
        "shard2":2.0,
        "shard1":2.0}},
    "hotCollections":{"SearchRateTriggerTest-collection1":8.0},
    "hotNodes":{},
    "requestedOps":[
      {
        "action":"ADDREPLICA",
        "hints":{"COLL_SHARD":[{
              "first":"SearchRateTriggerTest-collection1",
              "second":"shard2"}]}},
      {
        "action":"ADDREPLICA",
        "hints":{"COLL_SHARD":[{
              "first":"SearchRateTriggerTest-collection1",
              "second":"shard1"}]}}]}}]
	at __randomizedtesting.SeedInfo.seed([1B1B1646B6012EC6:F3172457277D1CC4]:0)
	at org.junit.Assert.fail(Assert.java:88)
	at org.junit.Assert.assertTrue(Assert.java:41)
	at org.apache.solr.cloud.autoscaling.SearchRateTriggerTest.testWaitForElapsed(SearchRateTriggerTest.java:294)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:567)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:830)




Build Log:
[...truncated 15201 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.SearchRateTriggerTest
   [junit4]   2> 1834486 INFO  (SUITE-SearchRateTriggerTest-seed#[1B1B1646B6012EC6]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 1834487 INFO  (SUITE-SearchRateTriggerTest-seed#[1B1B1646B6012EC6]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1B1B1646B6012EC6-001/data-dir-123-001
   [junit4] IGNOR/A 0.00s J2 | SearchRateTriggerTest.testTrigger
   [junit4]    > Assumption #1: 'awaitsfix' test group is disabled (@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028"))
   [junit4]   2> 1834487 INFO  (SUITE-SearchRateTriggerTest-seed#[1B1B1646B6012EC6]-worker) [     ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 1834488 INFO  (SUITE-SearchRateTriggerTest-seed#[1B1B1646B6012EC6]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
   [junit4]   2> 1834488 INFO  (SUITE-SearchRateTriggerTest-seed#[1B1B1646B6012EC6]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1834495 INFO  (TEST-SearchRateTriggerTest.testWaitForElapsed-seed#[1B1B1646B6012EC6]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testWaitForElapsed
   [junit4]   2> 1834495 INFO  (TEST-SearchRateTriggerTest.testWaitForElapsed-seed#[1B1B1646B6012EC6]) [     ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1B1B1646B6012EC6-001/tempDir-001
   [junit4]   2> 1834496 INFO  (TEST-SearchRateTriggerTest.testWaitForElapsed-seed#[1B1B1646B6012EC6]) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1834496 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1834496 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1834598 INFO  (TEST-SearchRateTriggerTest.testWaitForElapsed-seed#[1B1B1646B6012EC6]) [     ] o.a.s.c.ZkTestServer start zk server on port:49734
   [junit4]   2> 1834598 INFO  (TEST-SearchRateTriggerTest.testWaitForElapsed-seed#[1B1B1646B6012EC6]) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:49734
   [junit4]   2> 1834598 INFO  (TEST-SearchRateTriggerTest.testWaitForElapsed-seed#[1B1B1646B6012EC6]) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:49734
   [junit4]   2> 1834598 INFO  (TEST-SearchRateTriggerTest.testWaitForElapsed-seed#[1B1B1646B6012EC6]) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 49734
   [junit4]   2> 1834609 INFO  (TEST-SearchRateTriggerTest.testWaitForElapsed-seed#[1B1B1646B6012EC6]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1834618 INFO  (zkConnectionManagerCallback-12555-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1834618 INFO  (TEST-SearchRateTriggerTest.testWaitForElapsed-seed#[1B1B1646B6012EC6]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1834624 INFO  (TEST-SearchRateTriggerTest.testWaitForElapsed-seed#[1B1B1646B6012EC6]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1834629 INFO  (zkConnectionManagerCallback-12557-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1834629 INFO  (TEST-SearchRateTriggerTest.testWaitForElapsed-seed#[1B1B1646B6012EC6]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1834630 INFO  (TEST-SearchRateTriggerTest.testWaitForElapsed-seed#[1B1B1646B6012EC6]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1834635 INFO  (zkConnectionManagerCallback-12559-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1834635 INFO  (TEST-SearchRateTriggerTest.testWaitForElapsed-seed#[1B1B1646B6012EC6]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1834746 WARN  (jetty-launcher-12560-thread-2) [     ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
   [junit4]   2> 1834746 WARN  (jetty-launcher-12560-thread-1) [     ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
   [junit4]   2> 1834746 WARN  (jetty-launcher-12560-thread-3) [     ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
   [junit4]   2> 1834746 INFO  (jetty-launcher-12560-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1834746 INFO  (jetty-launcher-12560-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 1834746 INFO  (jetty-launcher-12560-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1834746 INFO  (jetty-launcher-12560-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1834746 INFO  (jetty-launcher-12560-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 1834746 INFO  (jetty-launcher-12560-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 1834746 INFO  (jetty-launcher-12560-thread-1) [     ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 13.0.2+8
   [junit4]   2> 1834746 WARN  (jetty-launcher-12560-thread-4) [     ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
   [junit4]   2> 1834746 INFO  (jetty-launcher-12560-thread-2) [     ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 13.0.2+8
   [junit4]   2> 1834746 INFO  (jetty-launcher-12560-thread-4) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1834746 INFO  (jetty-launcher-12560-thread-4) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 1834746 INFO  (jetty-launcher-12560-thread-4) [     ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 13.0.2+8
   [junit4]   2> 1834746 INFO  (jetty-launcher-12560-thread-3) [     ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 13.0.2+8
   [junit4]   2> 1834753 INFO  (jetty-launcher-12560-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1834753 INFO  (jetty-launcher-12560-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1834753 INFO  (jetty-launcher-12560-thread-1) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1834754 INFO  (jetty-launcher-12560-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@715335f7{/solr,null,AVAILABLE}
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-2) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-2) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-2) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@51353533{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:49739}
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-1) [     ] o.e.j.s.Server Started @1834810ms
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-3) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-3) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-3) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=49739}
   [junit4]   2> 1834755 ERROR (jetty-launcher-12560-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-3) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@490f6307{/solr,null,AVAILABLE}
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.5.0
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-2) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@511cf1b1{/solr,null,AVAILABLE}
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2020-03-03T13:48:58.723297Z
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-3) [     ] o.e.j.s.AbstractConnector Started ServerConnector@2c2cd0fe{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:49740}
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-3) [     ] o.e.j.s.Server Started @1834810ms
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=49740}
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-2) [     ] o.e.j.s.AbstractConnector Started ServerConnector@58aee7a5{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:49741}
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-2) [     ] o.e.j.s.Server Started @1834810ms
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=49741}
   [junit4]   2> 1834755 ERROR (jetty-launcher-12560-thread-2) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1834755 ERROR (jetty-launcher-12560-thread-3) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-2) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-3) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-3) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.5.0
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-2) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.5.0
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-2) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-2) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-2) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2020-03-03T13:48:58.723299Z
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-4) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-4) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-4) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-3) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-3) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr
   [junit4]   2> 1834755 INFO  (jetty-launcher-12560-thread-3) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2020-03-03T13:48:58.723299Z
   [junit4]   2> 1834759 INFO  (jetty-launcher-12560-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1834760 INFO  (jetty-launcher-12560-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1834760 INFO  (jetty-launcher-12560-thread-3) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1834764 INFO  (jetty-launcher-12560-thread-4) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@33420f62{/solr,null,AVAILABLE}
   [junit4]   2> 1834770 INFO  (jetty-launcher-12560-thread-4) [     ] o.e.j.s.AbstractConnector Started ServerConnector@495bc799{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:49744}
   [junit4]   2> 1834770 INFO  (jetty-launcher-12560-thread-4) [     ] o.e.j.s.Server Started @1834825ms
   [junit4]   2> 1834770 INFO  (jetty-launcher-12560-thread-4) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=49744}
   [junit4]   2> 1834770 ERROR (jetty-launcher-12560-thread-4) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1834770 INFO  (jetty-launcher-12560-thread-4) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1834770 INFO  (zkConnectionManagerCallback-12562-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1834770 INFO  (jetty-launcher-12560-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1834770 INFO  (jetty-launcher-12560-thread-4) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.5.0
   [junit4]   2> 1834770 INFO  (jetty-launcher-12560-thread-4) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1834770 INFO  (jetty-launcher-12560-thread-4) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr
   [junit4]   2> 1834771 INFO  (jetty-launcher-12560-thread-4) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2020-03-03T13:48:58.738983Z
   [junit4]   2> 1834773 INFO  (jetty-launcher-12560-thread-4) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1834774 INFO  (zkConnectionManagerCallback-12564-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1834774 INFO  (jetty-launcher-12560-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1834775 INFO  (jetty-launcher-12560-thread-1) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1834777 INFO  (jetty-launcher-12560-thread-2) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1834778 INFO  (zkConnectionManagerCallback-12566-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1834778 INFO  (jetty-launcher-12560-thread-3) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1834780 INFO  (jetty-launcher-12560-thread-3) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1834781 INFO  (zkConnectionManagerCallback-12568-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1834782 INFO  (jetty-launcher-12560-thread-4) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1834784 INFO  (jetty-launcher-12560-thread-4) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1834970 INFO  (jetty-launcher-12560-thread-1) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1834972 WARN  (jetty-launcher-12560-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3c44525c[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1834972 WARN  (jetty-launcher-12560-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3c44525c[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1834976 WARN  (jetty-launcher-12560-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@f9e60be[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1834976 WARN  (jetty-launcher-12560-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@f9e60be[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1834978 INFO  (jetty-launcher-12560-thread-1) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:49734/solr
   [junit4]   2> 1834979 INFO  (jetty-launcher-12560-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1834984 INFO  (zkConnectionManagerCallback-12575-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1834984 INFO  (jetty-launcher-12560-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1835056 INFO  (jetty-launcher-12560-thread-3) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1835058 WARN  (jetty-launcher-12560-thread-3) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@61084aa2[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1835058 WARN  (jetty-launcher-12560-thread-3) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@61084aa2[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1835059 WARN  (jetty-launcher-12560-thread-3) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@655753d3[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1835059 WARN  (jetty-launcher-12560-thread-3) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@655753d3[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1835064 INFO  (jetty-launcher-12560-thread-3) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:49734/solr
   [junit4]   2> 1835065 INFO  (jetty-launcher-12560-thread-3) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1835069 INFO  (zkConnectionManagerCallback-12583-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1835069 INFO  (jetty-launcher-12560-thread-3) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1835085 INFO  (jetty-launcher-12560-thread-4) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1835087 WARN  (jetty-launcher-12560-thread-4) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@2207afa5[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1835087 WARN  (jetty-launcher-12560-thread-4) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@2207afa5[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1835096 WARN  (jetty-launcher-12560-thread-4) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5ab0be20[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1835096 WARN  (jetty-launcher-12560-thread-4) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5ab0be20[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1835097 INFO  (jetty-launcher-12560-thread-4) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:49734/solr
   [junit4]   2> 1835100 INFO  (jetty-launcher-12560-thread-4) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1835105 INFO  (zkConnectionManagerCallback-12590-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1835105 INFO  (jetty-launcher-12560-thread-4) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1835202 INFO  (jetty-launcher-12560-thread-1) [n:127.0.0.1:49739_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1835206 INFO  (zkConnectionManagerCallback-12592-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1835206 INFO  (jetty-launcher-12560-thread-1) [n:127.0.0.1:49739_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1835307 INFO  (jetty-launcher-12560-thread-4) [n:127.0.0.1:49744_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1835310 INFO  (zkConnectionManagerCallback-12596-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1835310 INFO  (jetty-launcher-12560-thread-4) [n:127.0.0.1:49744_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1835347 INFO  (jetty-launcher-12560-thread-4) [n:127.0.0.1:49744_solr     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:49744_solr
   [junit4]   2> 1835349 INFO  (jetty-launcher-12560-thread-4) [n:127.0.0.1:49744_solr     ] o.a.s.c.Overseer Overseer (id=72072527771664395-127.0.0.1:49744_solr-n_0000000000) starting
   [junit4]   2> 1835354 INFO  (jetty-launcher-12560-thread-2) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1835357 WARN  (jetty-launcher-12560-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@45d87b18[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1835357 WARN  (jetty-launcher-12560-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@45d87b18[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1835366 WARN  (jetty-launcher-12560-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@2af71078[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1835366 WARN  (jetty-launcher-12560-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@2af71078[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1835368 INFO  (jetty-launcher-12560-thread-2) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:49734/solr
   [junit4]   2> 1835370 INFO  (jetty-launcher-12560-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1835374 INFO  (OverseerStateUpdate-72072527771664395-127.0.0.1:49744_solr-n_0000000000) [n:127.0.0.1:49744_solr     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:49744_solr
   [junit4]   2> 1835377 INFO  (jetty-launcher-12560-thread-4) [n:127.0.0.1:49744_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49744_solr
   [junit4]   2> 1835378 INFO  (zkConnectionManagerCallback-12604-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1835378 INFO  (jetty-launcher-12560-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1835385 INFO  (zkCallback-12595-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1835391 INFO  (jetty-launcher-12560-thread-4) [n:127.0.0.1:49744_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1835393 WARN  (jetty-launcher-12560-thread-4) [n:127.0.0.1:49744_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1835408 INFO  (jetty-launcher-12560-thread-3) [n:127.0.0.1:49740_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1835412 INFO  (zkConnectionManagerCallback-12607-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1835412 INFO  (jetty-launcher-12560-thread-3) [n:127.0.0.1:49740_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1835456 INFO  (jetty-launcher-12560-thread-3) [n:127.0.0.1:49740_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1835472 INFO  (jetty-launcher-12560-thread-1) [n:127.0.0.1:49739_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1835524 INFO  (jetty-launcher-12560-thread-2) [n:127.0.0.1:49741_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1835527 INFO  (jetty-launcher-12560-thread-1) [n:127.0.0.1:49739_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:49739_solr as DOWN
   [junit4]   2> 1835529 INFO  (jetty-launcher-12560-thread-4) [n:127.0.0.1:49744_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1835560 INFO  (jetty-launcher-12560-thread-3) [n:127.0.0.1:49740_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:49740_solr as DOWN
   [junit4]   2> 1835563 INFO  (zkConnectionManagerCallback-12611-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1835565 INFO  (jetty-launcher-12560-thread-1) [n:127.0.0.1:49739_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1835565 INFO  (jetty-launcher-12560-thread-1) [n:127.0.0.1:49739_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49739_solr
   [junit4]   2> 1835565 INFO  (jetty-launcher-12560-thread-2) [n:127.0.0.1:49741_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1835574 INFO  (jetty-launcher-12560-thread-3) [n:127.0.0.1:49740_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1835574 INFO  (jetty-launcher-12560-thread-3) [n:127.0.0.1:49740_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49740_solr
   [junit4]   2> 1835583 INFO  (zkCallback-12591-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1835585 INFO  (zkCallback-12595-thread-2) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1835586 INFO  (zkCallback-12606-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1835590 INFO  (zkCallback-12595-thread-2) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1835591 INFO  (zkCallback-12591-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1835592 INFO  (zkCallback-12606-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1835593 INFO  (jetty-launcher-12560-thread-4) [n:127.0.0.1:49744_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49744.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@54090fcb
   [junit4]   2> 1835606 INFO  (jetty-launcher-12560-thread-1) [n:127.0.0.1:49739_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1835607 WARN  (jetty-launcher-12560-thread-1) [n:127.0.0.1:49739_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1835616 INFO  (jetty-launcher-12560-thread-4) [n:127.0.0.1:49744_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49744.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@54090fcb
   [junit4]   2> 1835616 INFO  (jetty-launcher-12560-thread-4) [n:127.0.0.1:49744_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49744.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@54090fcb
   [junit4]   2> 1835617 INFO  (jetty-launcher-12560-thread-3) [n:127.0.0.1:49740_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1835618 WARN  (jetty-launcher-12560-thread-3) [n:127.0.0.1:49740_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1835618 INFO  (jetty-launcher-12560-thread-4) [n:127.0.0.1:49744_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1B1B1646B6012EC6-001/tempDir-001/node4/.
   [junit4]   2> 1835653 INFO  (jetty-launcher-12560-thread-1) [n:127.0.0.1:49739_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1835684 INFO  (jetty-launcher-12560-thread-3) [n:127.0.0.1:49740_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1835693 INFO  (jetty-launcher-12560-thread-2) [n:127.0.0.1:49741_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 1835726 INFO  (jetty-launcher-12560-thread-1) [n:127.0.0.1:49739_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49739.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@54090fcb
   [junit4]   2> 1835738 INFO  (jetty-launcher-12560-thread-2) [n:127.0.0.1:49741_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:49741_solr as DOWN
   [junit4]   2> 1835757 INFO  (jetty-launcher-12560-thread-2) [n:127.0.0.1:49741_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1835757 INFO  (jetty-launcher-12560-thread-2) [n:127.0.0.1:49741_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49741_solr
   [junit4]   2> 1835761 INFO  (zkCallback-12591-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1835761 INFO  (zkCallback-12610-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1835761 INFO  (zkCallback-12606-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1835761 INFO  (zkCallback-12595-thread-2) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1835765 INFO  (jetty-launcher-12560-thread-2) [n:127.0.0.1:49741_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1835765 WARN  (jetty-launcher-12560-thread-2) [n:127.0.0.1:49741_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1835765 INFO  (jetty-launcher-12560-thread-1) [n:127.0.0.1:49739_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49739.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@54090fcb
   [junit4]   2> 1835765 INFO  (jetty-launcher-12560-thread-1) [n:127.0.0.1:49739_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49739.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@54090fcb
   [junit4]   2> 1835767 INFO  (jetty-launcher-12560-thread-1) [n:127.0.0.1:49739_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1B1B1646B6012EC6-001/tempDir-001/node1/.
   [junit4]   2> 1835772 INFO  (jetty-launcher-12560-thread-3) [n:127.0.0.1:49740_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49740.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@54090fcb
   [junit4]   2> 1835784 INFO  (jetty-launcher-12560-thread-2) [n:127.0.0.1:49741_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1835823 INFO  (jetty-launcher-12560-thread-3) [n:127.0.0.1:49740_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49740.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@54090fcb
   [junit4]   2> 1835823 INFO  (jetty-launcher-12560-thread-3) [n:127.0.0.1:49740_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49740.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@54090fcb
   [junit4]   2> 1835827 INFO  (jetty-launcher-12560-thread-3) [n:127.0.0.1:49740_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1B1B1646B6012EC6-001/tempDir-001/node3/.
   [junit4]   2> 1835852 INFO  (jetty-launcher-12560-thread-2) [n:127.0.0.1:49741_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49741.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@54090fcb
   [junit4]   2> 1835867 WARN  (jetty-launcher-12560-thread-2) [n:127.0.0.1:49741_solr     ] o.a.s.m.r.j.JmxMetricsReporter Unable to register gauge
   [junit4]   2>           => javax.management.InstanceNotFoundException: solr_49741:dom1=solr,dom2=jvm,name0=system,name=properties
   [junit4]   2> 	at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1083)
   [junit4]   2> javax.management.InstanceNotFoundException: solr_49741:dom1=solr,dom2=jvm,name0=system,name=properties
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1083) ~[?:?]
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:423) ~[?:?]
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:411) ~[?:?]
   [junit4]   2> 	at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546) ~[?:?]
   [junit4]   2> 	at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter$JmxListener.registerMBean(JmxMetricsReporter.java:530) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter$JmxListener.onGaugeAdded(JmxMetricsReporter.java:566) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter.lambda$start$0(JmxMetricsReporter.java:741) ~[java/:?]
   [junit4]   2> 	at java.util.HashMap.forEach(HashMap.java:1338) ~[?:?]
   [junit4]   2> 	at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter.start(JmxMetricsReporter.java:731) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.reporters.SolrJmxReporter.doInit(SolrJmxReporter.java:109) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.SolrMetricReporter.init(SolrMetricReporter.java:70) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.SolrMetricManager.loadReporter(SolrMetricManager.java:964) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.metrics.SolrMetricManager.loadReporters(SolrMetricManager.java:890) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.load(CoreContainer.java:711) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:263) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:183) ~[java/:?]
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:134) ~[jetty-servlet-9.4.24.v20191120.jar:9.4.24.v20191120]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.lambda$initialize$0(ServletHandler.java:751) ~[jetty-servlet-9.4.24.v20191120.jar:9.4.24.v20191120]
   [junit4]   2> 	at java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948) ~[?:?]
   [junit4]   2> 	at java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:734) ~[?:?]
   [junit4]   2> 	at java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:734) ~[?:?]
   [junit4]   2> 	at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:658) ~[?:?]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:744) ~[jetty-servlet-9.4.24.v20191120.jar:9.4.24.v20191120]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1448) ~[jetty-servlet-9.4.24.v20191120.jar:9.4.24.v20191120]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1507) ~[jetty-servlet-9.4.24.v20191120.jar:9.4.24.v20191120]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1164) ~[jetty-servlet-9.4.24.v20191120.jar:9.4.24.v20191120]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1003) ~[jetty-servlet-9.4.24.v20191120.jar:9.4.24.v20191120]
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:459) ~[jetty-servlet-9.4.24.v20191120.jar:9.4.24.v20191120]
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:382) ~[java/:?]
   [junit4]   2> 	at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:193) ~[jetty-util-9.4.24.v20191120.jar:9.4.24.v20191120]
   [junit4]   2> 	at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73) ~[jetty-util-9.4.24.v20191120.jar:9.4.24.v20191120]
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner.retryOnPortBindFailure(JettySolrRunner.java:565) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:504) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:472) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:469) ~[java/:?]
   [junit4]   2> 	at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:300) ~[java/:?]
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:210) ~[java/:?]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:830) [?:?]
   [junit4]   2> 1835870 INFO  (jetty-launcher-12560-thread-2) [n:127.0.0.1:49741_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49741.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@54090fcb
   [junit4]   2> 1835870 INFO  (jetty-launcher-12560-thread-2) [n:127.0.0.1:49741_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49741.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@54090fcb
   [junit4]   2> 1835871 INFO  (jetty-launcher-12560-thread-2) [n:127.0.0.1:49741_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1B1B1646B6012EC6-001/tempDir-001/node2/.
   [junit4]   2> 1835943 INFO  (TEST-SearchRateTriggerTest.testWaitForElapsed-seed#[1B1B1646B6012EC6]) [     ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=4
   [junit4]   2> 1835944 INFO  (TEST-SearchRateTriggerTest.testWaitForElapsed-seed#[1B1B1646B6012EC6]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1835948 INFO  (zkConnectionManagerCallback-12625-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1835948 INFO  (TEST-SearchRateTriggerTest.testWaitForElapsed-seed#[1B1B1646B6012EC6]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1835951 INFO  (TEST-SearchRateTriggerTest.testWaitForElapsed-seed#[1B1B1646B6012EC6]) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1835954 INFO  (TEST-SearchRateTriggerTest.testWaitForElapsed-seed#[1B1B1646B6012EC6]) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:49734/solr ready
   [junit4]   2> 1835972 INFO  (qtp1609748669-32071) [n:127.0.0.1:49739_solr     ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf&maxShardsPerNode=1&name=SearchRateTriggerTest-collection1&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1835981 INFO  (OverseerThreadFactory-7354-thread-1-processing-n:127.0.0.1:49744_solr) [n:127.0.0.1:49744_solr     ] o.a.s.c.a.c.CreateCollectionCmd Create collection SearchRateTriggerTest-collection1
   [junit4]   2> 1836106 INFO  (OverseerStateUpdate-72072527771664395-127.0.0.1:49744_solr-n_0000000000) [n:127.0.0.1:49744_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"SearchRateTriggerTest-collection1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"SearchRateTriggerTest-collection1_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:49739/solr",
   [junit4]   2>   "node_name":"127.0.0.1:49739_solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1836112 INFO  (OverseerStateUpdate-72072527771664395-127.0.0.1:49744_solr-n_0000000000) [n:127.0.0.1:49744_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"SearchRateTriggerTest-collection1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"SearchRateTriggerTest-collection1_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:49744/solr",
   [junit4]   2>   "node_name":"127.0.0.1:49744_solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1836120 INFO  (OverseerStateUpdate-72072527771664395-127.0.0.1:49744_solr-n_0000000000) [n:127.0.0.1:49744_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"SearchRateTriggerTest-collection1",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"SearchRateTriggerTest-collection1_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:49740/solr",
   [junit4]   2>   "node_name":"127.0.0.1:49740_solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1836127 INFO  (OverseerStateUpdate-72072527771664395-127.0.0.1:49744_solr-n_0000000000) [n:127.0.0.1:49744_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"SearchRateTriggerTest-collection1",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"SearchRateTriggerTest-collection1_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:49741/solr",
   [junit4]   2>   "node_name":"127.0.0.1:49741_solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1836346 INFO  (qtp1609748669-32073) [n:127.0.0.1:49739_solr    x:SearchRateTriggerTest-collection1_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=SearchRateTriggerTest-collection1_shard1_replica_n1&action=CREATE&numShards=2&collection=SearchRateTriggerTest-collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1836346 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr    x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=SearchRateTriggerTest-collection1_shard1_replica_n2&action=CREATE&numShards=2&collection=SearchRateTriggerTest-collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1836346 INFO  (qtp585837267-32076) [n:127.0.0.1:49740_solr    x:SearchRateTriggerTest-collection1_shard2_replica_n4 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=SearchRateTriggerTest-collection1_shard2_replica_n4&action=CREATE&numShards=2&collection=SearchRateTriggerTest-collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1836346 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr    x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1836347 INFO  (qtp1449726744-32066) [n:127.0.0.1:49741_solr    x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=SearchRateTriggerTest-collection1_shard2_replica_n6&action=CREATE&numShards=2&collection=SearchRateTriggerTest-collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1836388 INFO  (qtp1609748669-32073) [n:127.0.0.1:49739_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.5.0
   [junit4]   2> 1836388 INFO  (qtp1449726744-32066) [n:127.0.0.1:49741_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.5.0
   [junit4]   2> 1836388 INFO  (qtp585837267-32076) [n:127.0.0.1:49740_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.5.0
   [junit4]   2> 1836389 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.5.0
   [junit4]   2> 1836427 INFO  (qtp585837267-32076) [n:127.0.0.1:49740_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4 ] o.a.s.s.IndexSchema [SearchRateTriggerTest-collection1_shard2_replica_n4] Schema name=minimal
   [junit4]   2> 1836427 INFO  (qtp1609748669-32073) [n:127.0.0.1:49739_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1 ] o.a.s.s.IndexSchema [SearchRateTriggerTest-collection1_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 1836427 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.s.IndexSchema [SearchRateTriggerTest-collection1_shard1_replica_n2] Schema name=minimal
   [junit4]   2> 1836427 INFO  (qtp1449726744-32066) [n:127.0.0.1:49741_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.s.IndexSchema [SearchRateTriggerTest-collection1_shard2_replica_n6] Schema name=minimal
   [junit4]   2> 1836431 INFO  (qtp1609748669-32073) [n:127.0.0.1:49739_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1836431 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1836431 INFO  (qtp1449726744-32066) [n:127.0.0.1:49741_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1836431 INFO  (qtp585837267-32076) [n:127.0.0.1:49740_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1836431 INFO  (qtp585837267-32076) [n:127.0.0.1:49740_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4 ] o.a.s.c.CoreContainer Creating SolrCore 'SearchRateTriggerTest-collection1_shard2_replica_n4' using configuration from configset conf, trusted=true
   [junit4]   2> 1836431 INFO  (qtp1609748669-32073) [n:127.0.0.1:49739_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'SearchRateTriggerTest-collection1_shard1_replica_n1' using configuration from configset conf, trusted=true
   [junit4]   2> 1836431 INFO  (qtp1449726744-32066) [n:127.0.0.1:49741_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.c.CoreContainer Creating SolrCore 'SearchRateTriggerTest-collection1_shard2_replica_n6' using configuration from configset conf, trusted=true
   [junit4]   2> 1836431 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.c.CoreContainer Creating SolrCore 'SearchRateTriggerTest-collection1_shard1_replica_n2' using configuration from configset conf, trusted=true
   [junit4]   2> 1836432 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49744.solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2' (registry 'solr.core.SearchRateTriggerTest-collection1.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@54090fcb
   [junit4]   2> 1836432 INFO  (qtp1609748669-32073) [n:127.0.0.1:49739_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49739.solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1' (registry 'solr.core.SearchRateTriggerTest-collection1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@54090fcb
   [junit4]   2> 1836432 INFO  (qtp1449726744-32066) [n:127.0.0.1:49741_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49741.solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6' (registry 'solr.core.SearchRateTriggerTest-collection1.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@54090fcb
   [junit4]   2> 1836432 INFO  (qtp585837267-32076) [n:127.0.0.1:49740_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49740.solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4' (registry 'solr.core.SearchRateTriggerTest-collection1.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@54090fcb
   [junit4]   2> 1836432 INFO  (qtp1449726744-32066) [n:127.0.0.1:49741_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.c.SolrCore [[SearchRateTriggerTest-collection1_shard2_replica_n6] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1B1B1646B6012EC6-001/tempDir-001/node2/SearchRateTriggerTest-collection1_shard2_replica_n6], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1B1B1646B6012EC6-001/tempDir-001/node2/./SearchRateTriggerTest-collection1_shard2_replica_n6/data/]
   [junit4]   2> 1836432 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.c.SolrCore [[SearchRateTriggerTest-collection1_shard1_replica_n2] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1B1B1646B6012EC6-001/tempDir-001/node4/SearchRateTriggerTest-collection1_shard1_replica_n2], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1B1B1646B6012EC6-001/tempDir-001/node4/./SearchRateTriggerTest-collection1_shard1_replica_n2/data/]
   [junit4]   2> 1836432 INFO  (qtp1609748669-32073) [n:127.0.0.1:49739_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1 ] o.a.s.c.SolrCore [[SearchRateTriggerTest-collection1_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1B1B1646B6012EC6-001/tempDir-001/node1/SearchRateTriggerTest-collection1_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1B1B1646B6012EC6-001/tempDir-001/node1/./SearchRateTriggerTest-collection1_shard1_replica_n1/data/]
   [junit4]   2> 1836432 INFO  (qtp585837267-32076) [n:127.0.0.1:49740_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4 ] o.a.s.c.SolrCore [[SearchRateTriggerTest-collection1_shard2_replica_n4] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1B1B1646B6012EC6-001/tempDir-001/node3/SearchRateTriggerTest-collection1_shard2_replica_n4], dataDir=[/Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1B1B1646B6012EC6-001/tempDir-001/node3/./SearchRateTriggerTest-collection1_shard2_replica_n4/data/]
   [junit4]   2> 1836593 INFO  (qtp1449726744-32066) [n:127.0.0.1:49741_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1836593 INFO  (qtp1449726744-32066) [n:127.0.0.1:49741_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1836597 INFO  (qtp1449726744-32066) [n:127.0.0.1:49741_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1836597 INFO  (qtp1449726744-32066) [n:127.0.0.1:49741_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1836602 INFO  (qtp1449726744-32066) [n:127.0.0.1:49741_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@2e66425d[SearchRateTriggerTest-collection1_shard2_replica_n6] main]
   [junit4]   2> 1836605 INFO  (qtp585837267-32076) [n:127.0.0.1:49740_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1836605 INFO  (qtp585837267-32076) [n:127.0.0.1:49740_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1836606 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1836606 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1836608 INFO  (qtp585837267-32076) [n:127.0.0.1:49740_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1836608 INFO  (qtp585837267-32076) [n:127.0.0.1:49740_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1836608 INFO  (qtp1609748669-32073) [n:127.0.0.1:49739_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1836608 INFO  (qtp1609748669-32073) [n:127.0.0.1:49739_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1836608 INFO  (qtp1449726744-32066) [n:127.0.0.1:49741_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 1836609 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1836609 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1836609 INFO  (qtp585837267-32076) [n:127.0.0.1:49740_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@163b2f49[SearchRateTriggerTest-collection1_shard2_replica_n4] main]
   [junit4]   2> 1836610 INFO  (qtp1449726744-32066) [n:127.0.0.1:49741_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1836610 INFO  (qtp1449726744-32066) [n:127.0.0.1:49741_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1836611 INFO  (qtp1449726744-32066) [n:127.0.0.1:49741_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1660150969090965504
   [junit4]   2> 1836611 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@700daec0[SearchRateTriggerTest-collection1_shard1_replica_n2] main]
   [junit4]   2> 1836612 INFO  (qtp1609748669-32073) [n:127.0.0.1:49739_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1836612 INFO  (qtp1609748669-32073) [n:127.0.0.1:49739_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1836614 INFO  (qtp1609748669-32073) [n:127.0.0.1:49739_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@5b1e58d[SearchRateTriggerTest-collection1_shard1_replica_n1] main]
   [junit4]   2> 1836614 INFO  (qtp585837267-32076) [n:127.0.0.1:49740_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 1836616 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 1836618 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1836618 INFO  (qtp585837267-32076) [n:127.0.0.1:49740_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1836618 INFO  (qtp1609748669-32073) [n:127.0.0.1:49739_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 1836618 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1836619 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1660150969099354112
   [junit4]   2> 1836619 INFO  (qtp585837267-32076) [n:127.0.0.1:49740_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1836619 INFO  (qtp585837267-32076) [n:127.0.0.1:49740_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1660150969099354112
   [junit4]   2> 1836623 INFO  (qtp1609748669-32073) [n:127.0.0.1:49739_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1836624 INFO  (qtp1609748669-32073) [n:127.0.0.1:49739_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1836625 INFO  (qtp1609748669-32073) [n:127.0.0.1:49739_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1660150969105645568
   [junit4]   2> 1836625 INFO  (searcherExecutor-7373-thread-1-processing-n:127.0.0.1:49741_solr x:SearchRateTriggerTest-collection1_shard2_replica_n6 c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8) [n:127.0.0.1:49741_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.c.SolrCore [SearchRateTriggerTest-collection1_shard2_replica_n6] Registered new searcher Searcher@2e66425d[SearchRateTriggerTest-collection1_shard2_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1836628 INFO  (searcherExecutor-7374-thread-1-processing-n:127.0.0.1:49744_solr x:SearchRateTriggerTest-collection1_shard1_replica_n2 c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5) [n:127.0.0.1:49744_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.c.SolrCore [SearchRateTriggerTest-collection1_shard1_replica_n2] Registered new searcher Searcher@700daec0[SearchRateTriggerTest-collection1_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1836629 INFO  (searcherExecutor-7371-thread-1-processing-n:127.0.0.1:49740_solr x:SearchRateTriggerTest-collection1_shard2_replica_n4 c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7) [n:127.0.0.1:49740_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4 ] o.a.s.c.SolrCore [SearchRateTriggerTest-collection1_shard2_replica_n4] Registered new searcher Searcher@163b2f49[SearchRateTriggerTest-collection1_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1836649 INFO  (searcherExecutor-7372-thread-1-processing-n:127.0.0.1:49739_solr x:SearchRateTriggerTest-collection1_shard1_replica_n1 c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3) [n:127.0.0.1:49739_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1 ] o.a.s.c.SolrCore [SearchRateTriggerTest-collection1_shard1_replica_n1] Registered new searcher Searcher@5b1e58d[SearchRateTriggerTest-collection1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1836662 INFO  (qtp1449726744-32066) [n:127.0.0.1:49741_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/SearchRateTriggerTest-collection1/terms/shard2 to Terms{values={core_node8=0}, version=0}
   [junit4]   2> 1836663 INFO  (qtp1449726744-32066) [n:127.0.0.1:49741_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/SearchRateTriggerTest-collection1/leaders/shard2
   [junit4]   2> 1836665 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/SearchRateTriggerTest-collection1/terms/shard1 to Terms{values={core_node5=0}, version=0}
   [junit4]   2> 1836665 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/SearchRateTriggerTest-collection1/leaders/shard1
   [junit4]   2> 1836673 INFO  (qtp585837267-32076) [n:127.0.0.1:49740_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/SearchRateTriggerTest-collection1/terms/shard2 to Terms{values={core_node7=0, core_node8=0}, version=1}
   [junit4]   2> 1836674 INFO  (qtp585837267-32076) [n:127.0.0.1:49740_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/SearchRateTriggerTest-collection1/leaders/shard2
   [junit4]   2> 1836678 INFO  (qtp1609748669-32073) [n:127.0.0.1:49739_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/SearchRateTriggerTest-collection1/terms/shard1 to Terms{values={core_node3=0, core_node5=0}, version=1}
   [junit4]   2> 1836678 INFO  (qtp1609748669-32073) [n:127.0.0.1:49739_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/SearchRateTriggerTest-collection1/leaders/shard1
   [junit4]   2> 1836709 INFO  (qtp1449726744-32066) [n:127.0.0.1:49741_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1836709 INFO  (qtp1449726744-32066) [n:127.0.0.1:49741_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1836710 INFO  (qtp1449726744-32066) [n:127.0.0.1:49741_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:49741/solr/SearchRateTriggerTest-collection1_shard2_replica_n6/
   [junit4]   2> 1836711 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1836711 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1836711 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:49744/solr/SearchRateTriggerTest-collection1_shard1_replica_n2/
   [junit4]   2> 1836713 INFO  (qtp1449726744-32066) [n:127.0.0.1:49741_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.u.PeerSync PeerSync: core=SearchRateTriggerTest-collection1_shard2_replica_n6 url=http://127.0.0.1:49741/solr START replicas=[http://127.0.0.1:49740/solr/SearchRateTriggerTest-collection1_shard2_replica_n4/] nUpdates=100
   [junit4]   2> 1836714 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.u.PeerSync PeerSync: core=SearchRateTriggerTest-collection1_shard1_replica_n2 url=http://127.0.0.1:49744/solr START replicas=[http://127.0.0.1:49739/solr/SearchRateTriggerTest-collection1_shard1_replica_n1/] nUpdates=100
   [junit4]   2> 1836715 INFO  (qtp1449726744-32066) [n:127.0.0.1:49741_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.u.PeerSync PeerSync: core=SearchRateTriggerTest-collection1_shard2_replica_n6 url=http://127.0.0.1:49741/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 1836715 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.u.PeerSync PeerSync: core=SearchRateTriggerTest-collection1_shard1_replica_n2 url=http://127.0.0.1:49744/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 1836719 INFO  (qtp585837267-32082) [n:127.0.0.1:49740_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node7 x:SearchRateTriggerTest-collection1_shard2_replica_n4 ] o.a.s.c.S.Request [SearchRateTriggerTest-collection1_shard2_replica_n4]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=2
   [junit4]   2> 1836719 INFO  (qtp1609748669-32072) [n:127.0.0.1:49739_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node3 x:SearchRateTriggerTest-collection1_shard1_replica_n1 ] o.a.s.c.S.Request [SearchRateTriggerTest-collection1_shard1_replica_n1]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 1836721 INFO  (qtp1449726744-32066) [n:127.0.0.1:49741_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 1836721 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 1836721 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1836721 INFO  (qtp1449726744-32066) [n:127.0.0.1:49741_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1836721 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/SearchRateTriggerTest-collection1/leaders/shard1/leader after winning as /collections/SearchRateTriggerTest-collection1/leader_elect/shard1/election/72072527771664395-core_node5-n_0000000000
   [junit4]   2> 1836721 INFO  (qtp1449726744-32066) [n:127.0.0.1:49741_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/SearchRateTriggerTest-collection1/leaders/shard2/leader after winning as /collections/SearchRateTriggerTest-collection1/leader_elect/shard2/election/72072527771664398-core_node8-n_0000000000
   [junit4]   2> 1836729 INFO  (qtp1449726744-32066) [n:127.0.0.1:49741_solr c:SearchRateTriggerTest-collection1 s:shard2 r:core_node8 x:SearchRateTriggerTest-collection1_shard2_replica_n6 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:49741/solr/SearchRateTriggerTest-collection1_shard2_replica_n6/ shard2
   [junit4]   2> 1836729 INFO  (qtp1201414426-32081) [n:127.0.0.1:49744_solr c:SearchRateTriggerTest-collection1 s:shard1 r:core_node5 x:SearchRateTriggerTest-collection1_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:49744/solr/SearchRateTriggerTest-collection1_shard1_replica_n2/ shard1
   [junit4]   2> 1836846 INFO  (zkCallback-12610-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SearchRateTriggerTest-collection1/state.json] for collection [SearchRateTriggerTest-collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1836846 INFO  (zkCallback-12595-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SearchRateTriggerTest-collection1/state.json] for collection [SearchRateTriggerTest-collection1] has occurred - updating... (live nodes size:

[...truncated too long message...]

d-3) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 1866110 INFO  (jetty-closer-12719-thread-3) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@19a0b28: rootName = solr_49874, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@1245824e
   [junit4]   2> 1866110 INFO  (jetty-closer-12719-thread-3) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 1866111 INFO  (jetty-closer-12719-thread-2) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 1866111 INFO  (jetty-closer-12719-thread-2) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2fcb186e: rootName = solr_49877, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@1245824e
   [junit4]   2> 1866111 INFO  (jetty-closer-12719-thread-4) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 1866111 INFO  (jetty-closer-12719-thread-4) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3faf647e: rootName = solr_49875, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@1245824e
   [junit4]   2> 1866111 INFO  (jetty-closer-12719-thread-2) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 1866111 INFO  (jetty-closer-12719-thread-4) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 1866218 INFO  (zkCallback-12696-thread-2) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 1866224 INFO  (jetty-closer-12719-thread-3) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@26199aec{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
   [junit4]   2> 1866224 INFO  (jetty-closer-12719-thread-3) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@60dd7479{/solr,null,UNAVAILABLE}
   [junit4]   2> 1866224 INFO  (jetty-closer-12719-thread-3) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1866324 INFO  (jetty-closer-12719-thread-4) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@f2fa0d2{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
   [junit4]   2> 1866324 INFO  (jetty-closer-12719-thread-4) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5b1368b0{/solr,null,UNAVAILABLE}
   [junit4]   2> 1866324 INFO  (jetty-closer-12719-thread-4) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1866425 INFO  (jetty-closer-12719-thread-2) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@2de6f565{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
   [junit4]   2> 1866425 INFO  (jetty-closer-12719-thread-2) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7d5324bd{/solr,null,UNAVAILABLE}
   [junit4]   2> 1866425 INFO  (jetty-closer-12719-thread-2) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1866426 INFO  (TEST-SearchRateTriggerTest.testDefaultsAndBackcompat-seed#[1B1B1646B6012EC6]) [     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 1866644 WARN  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/aliases.json
   [junit4]   2> 	5	/solr/clusterprops.json
   [junit4]   2> 	4	/solr/packages.json
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	21	/solr/live_nodes
   [junit4]   2> 	7	/solr/overseer/queue
   [junit4]   2> 	5	/solr/collections
   [junit4]   2> 
   [junit4]   2> 1866648 INFO  (TEST-SearchRateTriggerTest.testDefaultsAndBackcompat-seed#[1B1B1646B6012EC6]) [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:49869
   [junit4]   2> 1866648 INFO  (TEST-SearchRateTriggerTest.testDefaultsAndBackcompat-seed#[1B1B1646B6012EC6]) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:49869
   [junit4]   2> 1866648 INFO  (TEST-SearchRateTriggerTest.testDefaultsAndBackcompat-seed#[1B1B1646B6012EC6]) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 49869
   [junit4]   2> 1866649 INFO  (TEST-SearchRateTriggerTest.testDefaultsAndBackcompat-seed#[1B1B1646B6012EC6]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testDefaultsAndBackcompat
   [junit4]   2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-8.x-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SearchRateTriggerTest_1B1B1646B6012EC6-001
   [junit4]   2> Mar 03, 2020 1:49:30 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene84): {}, docValues:{}, maxPointsInLeafNode=1476, maxMBSortInHeap=6.922195617752885, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@6ffdff8), locale=kk, timezone=Europe/Minsk
   [junit4]   2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 13.0.2 (64-bit)/cpus=6,threads=1,free=126739872,total=304087040
   [junit4]   2> NOTE: All tests run in this JVM: [DimensionalRoutedAliasUpdateProcessorTest, TestLeaderElectionZkExpiry, TestLuceneMatchVersion, DateMathParserTest, TestPerFieldSimilarityWithDefaultOverride, BooleanFieldTest, TestConfigReload, DirectSolrSpellCheckerTest, ShardSplitTest, MetricTriggerTest, TestSimTriggerIntegration, SolrMetricManagerTest, TestFieldCacheSort, UpdateRequestProcessorFactoryTest, BasicDistributedZkTest, TestCloudInspectUtil, GraphQueryTest, ZkSolrClientTest, StatelessScriptUpdateProcessorFactoryTest, TestNumericTerms32, ImplicitSnitchTest, TestSubQueryTransformer, ChaosMonkeySafeLeaderWithPullReplicasTest, ConvertedLegacyTest, ConcurrentCreateRoutedAliasTest, TestPullReplica, WrapperMergePolicyFactoryTest, TestReload, ClassificationUpdateProcessorFactoryTest, ClusterStateTest, TestGraphTermsQParserPlugin, TestBM25SimilarityFactory, SolrJmxReporterTest, TestConfigSetsAPIZkFailure, PeerSyncTest, MultiThreadedOCPTest, TestWriterPerf, TestJavabinTupleStreamParser, ZkCLITest, CdcrWithNodesRestartsTest, CursorMarkTest, TestDynamicLoadingUrl, AutoAddReplicasPlanActionTest, DistanceFunctionTest, TriggerEventQueueTest, TestLegacyNumericUtils, XCJFQueryTest, TestMultiWordSynonyms, ReplaceNodeTest, TestPostingsSolrHighlighter, SparseHLLTest, ZookeeperStatusHandlerTest, TestExactSharedStatsCache, SSLMigrationTest, DistributedFacetPivotLongTailTest, RandomizedTaggerTest, SolrIndexSplitterTest, SegmentsInfoRequestHandlerTest, TestUpdate, SpellPossibilityIteratorTest, TestSolrConfigHandlerCloud, TestSmileRequest, TestReplicationHandlerDiskOverFlow, LeaderElectionIntegrationTest, HdfsChaosMonkeySafeLeaderTest, ActionThrottleTest, PrimUtilsTest, TestXmlQParserPlugin, TestQuerySenderNoQuery, TestCloudRecovery2, TestFastLRUCache, TestCloudJSONFacetSKG, NumericFieldsTest, HealthCheckHandlerTest, SystemInfoHandlerTest, QueryElevationComponentTest, DateRangeFieldTest, SpatialRPTFieldTypeTest, TestNumericTokenStream, FastVectorHighlighterTest, DeleteStatusTest, TestAddFieldRealTimeGet, MinimalSchemaTest, TestFieldCollectionResource, TestStressLucene, TestManagedStopFilterFactory, DistributedVersionInfoTest, TimeZoneUtilsTest, TestUseDocValuesAsStored2, DeleteLastCustomShardedReplicaTest, DeleteNodeTest, DistribJoinFromCollectionTest, LeaderTragicEventTest, LeaderVoteWaitTimeoutTest, MoveReplicaHDFSFailoverTest, MoveReplicaHDFSTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverseerCollectionConfigSetProcessorTest, OverseerModifyCollectionTest, OverseerTest, RecoveryAfterSoftCommitTest, SolrXmlInZkTest, SyncSliceTest, TestDynamicFieldNamesIndexCorrectly, TestSSLRandomization, TestSkipOverseerOperations, TestTolerantUpdateProcessorCloud, TlogReplayBufferedWhileIndexingTest, TriLevelCompositeIdRoutingTest, CollectionTooManyReplicasTest, CollectionsAPIDistributedZkTest, NodeLostTriggerTest, ScheduledTriggerTest, SearchRateTriggerIntegrationTest, SearchRateTriggerTest]
   [junit4] Completed [566/901 (1!)] on J2 in 32.47s, 3 tests, 1 failure, 1 skipped <<< FAILURES!

[...truncated 49201 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-MacOSX/708/consoleText

[repro] Revision: 2044f8c83ebb0775d76b1e96c168ca936701abd4

[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseG1GC"
[repro] Repro line:  ant test  -Dtestcase=SearchRateTriggerTest -Dtests.method=testWaitForElapsed -Dtests.seed=1B1B1646B6012EC6 -Dtests.slow=true -Dtests.locale=kk -Dtests.timezone=Europe/Minsk -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       SearchRateTriggerTest
[repro] ant compile-test

[...truncated 3445 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.SearchRateTriggerTest" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseG1GC" -Dtests.seed=1B1B1646B6012EC6 -Dtests.slow=true -Dtests.locale=kk -Dtests.timezone=Europe/Minsk -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[...truncated 96 lines...]
[repro] Failures w/original seeds:
[repro]   0/5 failed: org.apache.solr.cloud.autoscaling.SearchRateTriggerTest
[repro] Exiting with code 0

[...truncated 73 lines...]