You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2020/06/24 18:28:31 UTC

[JENKINS-Experimental-GC] Lucene-Solr-master-MacOSX (64bit/jdk-14.0.1) - Build # 6209 - Unstable!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/6209/
Java: 64bit/jdk-14.0.1 -XX:-UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseZGC

1 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ClusterStateUpdateTest

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.ClusterStateUpdateTest:     1) Thread[id=13198, name=SessionTracker, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]         at java.base@14.0.1/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.ClusterStateUpdateTest: 
   1) Thread[id=13198, name=SessionTracker, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
        at java.base@14.0.1/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
	at __randomizedtesting.SeedInfo.seed([7A9EF75B3B9A68B1]:0)




Build Log:
[...truncated 13691 lines...]
   [junit4] Suite: org.apache.solr.cloud.ClusterStateUpdateTest
   [junit4]   2> 1123513 INFO  (SUITE-ClusterStateUpdateTest-seed#[7A9EF75B3B9A68B1]-worker) [     ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 1123514 INFO  (SUITE-ClusterStateUpdateTest-seed#[7A9EF75B3B9A68B1]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.ClusterStateUpdateTest_7A9EF75B3B9A68B1-001/data-dir-94-001
   [junit4]   2> 1123514 INFO  (SUITE-ClusterStateUpdateTest-seed#[7A9EF75B3B9A68B1]-worker) [     ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 1123515 INFO  (SUITE-ClusterStateUpdateTest-seed#[7A9EF75B3B9A68B1]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
   [junit4]   2> 1123515 INFO  (SUITE-ClusterStateUpdateTest-seed#[7A9EF75B3B9A68B1]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1123518 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testCoreRegistration
   [junit4]   2> 1123519 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.ClusterStateUpdateTest_7A9EF75B3B9A68B1-001/tempDir-001
   [junit4]   2> 1123519 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1123520 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
   [junit4]   2> 1123520 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1123621 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.ZkTestServer start zk server on port: 51789
   [junit4]   2> 1123621 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:51789
   [junit4]   2> 1123621 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:51789
   [junit4]   2> 1123621 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 51789
   [junit4]   2> 1123624 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1123629 INFO  (zkConnectionManagerCallback-8422-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1123629 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1123634 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1123645 INFO  (zkConnectionManagerCallback-8424-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1123646 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1123647 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1123650 INFO  (zkConnectionManagerCallback-8426-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1123650 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1123767 INFO  (jetty-launcher-8427-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1123767 INFO  (jetty-launcher-8427-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1123767 INFO  (jetty-launcher-8427-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1123767 INFO  (jetty-launcher-8427-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 1123767 INFO  (jetty-launcher-8427-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1123767 INFO  (jetty-launcher-8427-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
   [junit4]   2> 1123767 INFO  (jetty-launcher-8427-thread-1) [     ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14.0.1+7
   [junit4]   2> 1123767 INFO  (jetty-launcher-8427-thread-2) [     ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14.0.1+7
   [junit4]   2> 1123767 INFO  (jetty-launcher-8427-thread-3) [     ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14.0.1+7
   [junit4]   2> 1123773 INFO  (jetty-launcher-8427-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1123773 INFO  (jetty-launcher-8427-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1123773 INFO  (jetty-launcher-8427-thread-1) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1123774 INFO  (jetty-launcher-8427-thread-2) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1123774 INFO  (jetty-launcher-8427-thread-2) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1123774 INFO  (jetty-launcher-8427-thread-2) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1123775 INFO  (jetty-launcher-8427-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@10a3a276{/solr,null,AVAILABLE}
   [junit4]   2> 1123776 INFO  (jetty-launcher-8427-thread-2) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@51470e4d{/solr,null,AVAILABLE}
   [junit4]   2> 1123777 INFO  (jetty-launcher-8427-thread-3) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1123777 INFO  (jetty-launcher-8427-thread-3) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1123777 INFO  (jetty-launcher-8427-thread-3) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1123777 INFO  (jetty-launcher-8427-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@5a2d5545{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:51795}
   [junit4]   2> 1123777 INFO  (jetty-launcher-8427-thread-1) [     ] o.e.j.s.Server Started @1123924ms
   [junit4]   2> 1123777 INFO  (jetty-launcher-8427-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=51795}
   [junit4]   2> 1123778 INFO  (jetty-launcher-8427-thread-2) [     ] o.e.j.s.AbstractConnector Started ServerConnector@618efdae{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:51796}
   [junit4]   2> 1123778 INFO  (jetty-launcher-8427-thread-2) [     ] o.e.j.s.Server Started @1123924ms
   [junit4]   2> 1123778 INFO  (jetty-launcher-8427-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=51796}
   [junit4]   2> 1123778 ERROR (jetty-launcher-8427-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1123778 INFO  (jetty-launcher-8427-thread-3) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@ce8f882{/solr,null,AVAILABLE}
   [junit4]   2> 1123778 INFO  (jetty-launcher-8427-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1123778 ERROR (jetty-launcher-8427-thread-2) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1123778 INFO  (jetty-launcher-8427-thread-2) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1123778 INFO  (jetty-launcher-8427-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 9.0.0
   [junit4]   2> 1123778 INFO  (jetty-launcher-8427-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1123778 INFO  (jetty-launcher-8427-thread-2) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 9.0.0
   [junit4]   2> 1123778 INFO  (jetty-launcher-8427-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
   [junit4]   2> 1123778 INFO  (jetty-launcher-8427-thread-2) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1123778 INFO  (jetty-launcher-8427-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2020-06-24T17:57:43.242418Z
   [junit4]   2> 1123778 INFO  (jetty-launcher-8427-thread-2) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
   [junit4]   2> 1123778 INFO  (jetty-launcher-8427-thread-2) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2020-06-24T17:57:43.242463Z
   [junit4]   2> 1123779 INFO  (jetty-launcher-8427-thread-3) [     ] o.e.j.s.AbstractConnector Started ServerConnector@4fac170{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:51797}
   [junit4]   2> 1123779 INFO  (jetty-launcher-8427-thread-3) [     ] o.e.j.s.Server Started @1123925ms
   [junit4]   2> 1123779 INFO  (jetty-launcher-8427-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=51797}
   [junit4]   2> 1123779 ERROR (jetty-launcher-8427-thread-3) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1123779 INFO  (jetty-launcher-8427-thread-3) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1123779 INFO  (jetty-launcher-8427-thread-3) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 9.0.0
   [junit4]   2> 1123779 INFO  (jetty-launcher-8427-thread-3) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1123779 INFO  (jetty-launcher-8427-thread-3) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
   [junit4]   2> 1123779 INFO  (jetty-launcher-8427-thread-3) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2020-06-24T17:57:43.243533Z
   [junit4]   2> 1123779 INFO  (jetty-launcher-8427-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1123780 INFO  (jetty-launcher-8427-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1123780 INFO  (jetty-launcher-8427-thread-3) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1123784 INFO  (zkConnectionManagerCallback-8431-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1123784 INFO  (jetty-launcher-8427-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1123784 INFO  (zkConnectionManagerCallback-8433-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1123785 INFO  (jetty-launcher-8427-thread-3) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1123786 INFO  (jetty-launcher-8427-thread-2) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1123787 INFO  (jetty-launcher-8427-thread-3) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1123787 INFO  (zkConnectionManagerCallback-8429-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1123787 INFO  (jetty-launcher-8427-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1123788 INFO  (jetty-launcher-8427-thread-1) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1123902 INFO  (jetty-launcher-8427-thread-3) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1123903 WARN  (jetty-launcher-8427-thread-3) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@4b649e2f[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1123903 WARN  (jetty-launcher-8427-thread-3) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@4b649e2f[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1123906 INFO  (jetty-launcher-8427-thread-1) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1123907 WARN  (jetty-launcher-8427-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@6f7188a3[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1123907 WARN  (jetty-launcher-8427-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@6f7188a3[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1123908 WARN  (jetty-launcher-8427-thread-3) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@2ce02e1c[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1123908 WARN  (jetty-launcher-8427-thread-3) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@2ce02e1c[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1123909 WARN  (jetty-launcher-8427-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5b724b93[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1123909 WARN  (jetty-launcher-8427-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5b724b93[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1123910 INFO  (jetty-launcher-8427-thread-3) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51789/solr
   [junit4]   2> 1123910 INFO  (jetty-launcher-8427-thread-1) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51789/solr
   [junit4]   2> 1123911 INFO  (jetty-launcher-8427-thread-3) [n:127.0.0.1:51797_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1123911 INFO  (jetty-launcher-8427-thread-1) [n:127.0.0.1:51795_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1123915 INFO  (zkConnectionManagerCallback-8455-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1123916 INFO  (jetty-launcher-8427-thread-1) [n:127.0.0.1:51795_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1123916 INFO  (zkConnectionManagerCallback-8453-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1123916 INFO  (jetty-launcher-8427-thread-3) [n:127.0.0.1:51797_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1124000 INFO  (jetty-launcher-8427-thread-2) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1124002 WARN  (jetty-launcher-8427-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@11e2d16e[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1124002 WARN  (jetty-launcher-8427-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@11e2d16e[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1124005 WARN  (jetty-launcher-8427-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@51493cdd[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1124005 WARN  (jetty-launcher-8427-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@51493cdd[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1124006 INFO  (jetty-launcher-8427-thread-2) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51789/solr
   [junit4]   2> 1124007 INFO  (jetty-launcher-8427-thread-2) [n:127.0.0.1:51796_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1124011 INFO  (zkConnectionManagerCallback-8466-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1124011 INFO  (jetty-launcher-8427-thread-2) [n:127.0.0.1:51796_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1124466 INFO  (jetty-launcher-8427-thread-2) [n:127.0.0.1:51796_solr     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:51796_solr
   [junit4]   2> 1124470 INFO  (jetty-launcher-8427-thread-2) [n:127.0.0.1:51796_solr     ] o.a.s.c.Overseer Overseer (id=72161115607859208-127.0.0.1:51796_solr-n_0000000000) starting
   [junit4]   2> 1124500 INFO  (OverseerStateUpdate-72161115607859208-127.0.0.1:51796_solr-n_0000000000) [n:127.0.0.1:51796_solr     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:51796_solr
   [junit4]   2> 1124500 INFO  (jetty-launcher-8427-thread-2) [n:127.0.0.1:51796_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51796_solr
   [junit4]   2> 1124514 INFO  (OverseerStateUpdate-72161115607859208-127.0.0.1:51796_solr-n_0000000000) [n:127.0.0.1:51796_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1124525 INFO  (jetty-launcher-8427-thread-2) [n:127.0.0.1:51796_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1124525 WARN  (jetty-launcher-8427-thread-2) [n:127.0.0.1:51796_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1124547 INFO  (jetty-launcher-8427-thread-2) [n:127.0.0.1:51796_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1124556 INFO  (jetty-launcher-8427-thread-3) [n:127.0.0.1:51797_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1124562 INFO  (jetty-launcher-8427-thread-1) [n:127.0.0.1:51795_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1124566 INFO  (jetty-launcher-8427-thread-3) [n:127.0.0.1:51797_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:51797_solr as DOWN
   [junit4]   2> 1124569 INFO  (jetty-launcher-8427-thread-3) [n:127.0.0.1:51797_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 1000 transient cores
   [junit4]   2> 1124569 INFO  (jetty-launcher-8427-thread-3) [n:127.0.0.1:51797_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51797_solr
   [junit4]   2> 1124574 INFO  (zkCallback-8465-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1124574 INFO  (zkCallback-8452-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1124576 INFO  (zkCallback-8454-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1124580 INFO  (jetty-launcher-8427-thread-1) [n:127.0.0.1:51795_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:51795_solr as DOWN
   [junit4]   2> 1124584 INFO  (jetty-launcher-8427-thread-3) [n:127.0.0.1:51797_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1124585 WARN  (jetty-launcher-8427-thread-3) [n:127.0.0.1:51797_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1124585 INFO  (jetty-launcher-8427-thread-2) [n:127.0.0.1:51796_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51796.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c5b2cfa
   [junit4]   2> 1124590 INFO  (jetty-launcher-8427-thread-1) [n:127.0.0.1:51795_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 1000 transient cores
   [junit4]   2> 1124590 INFO  (jetty-launcher-8427-thread-1) [n:127.0.0.1:51795_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51795_solr
   [junit4]   2> 1124592 INFO  (jetty-launcher-8427-thread-2) [n:127.0.0.1:51796_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51796.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c5b2cfa
   [junit4]   2> 1124592 INFO  (jetty-launcher-8427-thread-2) [n:127.0.0.1:51796_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51796.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c5b2cfa
   [junit4]   2> 1124596 INFO  (zkCallback-8465-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1124596 INFO  (jetty-launcher-8427-thread-2) [n:127.0.0.1:51796_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.ClusterStateUpdateTest_7A9EF75B3B9A68B1-001/tempDir-001/node2
   [junit4]   2> 1124597 INFO  (zkCallback-8452-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1124597 INFO  (zkCallback-8454-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1124604 INFO  (jetty-launcher-8427-thread-1) [n:127.0.0.1:51795_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1124604 WARN  (jetty-launcher-8427-thread-1) [n:127.0.0.1:51795_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1124607 INFO  (jetty-launcher-8427-thread-3) [n:127.0.0.1:51797_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1124642 INFO  (jetty-launcher-8427-thread-3) [n:127.0.0.1:51797_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51797.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c5b2cfa
   [junit4]   2> 1124646 INFO  (jetty-launcher-8427-thread-1) [n:127.0.0.1:51795_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1124671 INFO  (jetty-launcher-8427-thread-3) [n:127.0.0.1:51797_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51797.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c5b2cfa
   [junit4]   2> 1124671 INFO  (jetty-launcher-8427-thread-3) [n:127.0.0.1:51797_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51797.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c5b2cfa
   [junit4]   2> 1124673 INFO  (jetty-launcher-8427-thread-3) [n:127.0.0.1:51797_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.ClusterStateUpdateTest_7A9EF75B3B9A68B1-001/tempDir-001/node3
   [junit4]   2> 1124682 INFO  (jetty-launcher-8427-thread-1) [n:127.0.0.1:51795_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51795.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c5b2cfa
   [junit4]   2> 1124690 INFO  (jetty-launcher-8427-thread-1) [n:127.0.0.1:51795_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51795.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c5b2cfa
   [junit4]   2> 1124691 INFO  (jetty-launcher-8427-thread-1) [n:127.0.0.1:51795_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51795.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c5b2cfa
   [junit4]   2> 1124693 INFO  (jetty-launcher-8427-thread-1) [n:127.0.0.1:51795_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.ClusterStateUpdateTest_7A9EF75B3B9A68B1-001/tempDir-001/node1
   [junit4]   2> 1124710 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=3
   [junit4]   2> 1124711 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1124715 INFO  (zkConnectionManagerCallback-8499-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1124716 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1124727 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 1124736 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:51789/solr ready
   [junit4]   2> 1124752 INFO  (qtp1424667048-13239) [n:127.0.0.1:51795_solr     ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf&name=testcore&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:51796_solr&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1124775 INFO  (OverseerThreadFactory-8477-thread-1-processing-n:127.0.0.1:51796_solr) [n:127.0.0.1:51796_solr     ] o.a.s.c.a.c.CreateCollectionCmd Create collection testcore
   [junit4]   2> 1124927 INFO  (qtp1424667048-13243) [n:127.0.0.1:51795_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=1
   [junit4]   2> 1124929 INFO  (qtp1867062839-13236) [n:127.0.0.1:51796_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 1000 transient cores
   [junit4]   2> 1124929 INFO  (qtp1867062839-13236) [n:127.0.0.1:51796_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
   [junit4]   2> 1124932 INFO  (qtp171785799-13246) [n:127.0.0.1:51797_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
   [junit4]   2> 1124982 INFO  (OverseerStateUpdate-72161115607859208-127.0.0.1:51796_solr-n_0000000000) [n:127.0.0.1:51796_solr     ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testcore",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testcore_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:51796/solr",
   [junit4]   2>   "node_name":"127.0.0.1:51796_solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1125198 INFO  (qtp1867062839-13244) [n:127.0.0.1:51796_solr    x:testcore_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=testcore_shard1_replica_n1&action=CREATE&numShards=1&collection=testcore&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1125214 INFO  (qtp1867062839-13244) [n:127.0.0.1:51796_solr c:testcore s:shard1 r:core_node2 x:testcore_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
   [junit4]   2> 1125222 INFO  (qtp1867062839-13244) [n:127.0.0.1:51796_solr c:testcore s:shard1 r:core_node2 x:testcore_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=minimal
   [junit4]   2> 1125224 INFO  (qtp1867062839-13244) [n:127.0.0.1:51796_solr c:testcore s:shard1 r:core_node2 x:testcore_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1125224 INFO  (qtp1867062839-13244) [n:127.0.0.1:51796_solr c:testcore s:shard1 r:core_node2 x:testcore_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'testcore_shard1_replica_n1' using configuration from configset conf, trusted=true
   [junit4]   2> 1125234 INFO  (qtp1867062839-13244) [n:127.0.0.1:51796_solr c:testcore s:shard1 r:core_node2 x:testcore_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51796.solr.core.testcore.shard1.replica_n1' (registry 'solr.core.testcore.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c5b2cfa
   [junit4]   2> 1125234 INFO  (qtp1867062839-13244) [n:127.0.0.1:51796_solr c:testcore s:shard1 r:core_node2 x:testcore_shard1_replica_n1 ] o.a.s.c.SolrCore [[testcore_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.ClusterStateUpdateTest_7A9EF75B3B9A68B1-001/tempDir-001/node2/testcore_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.ClusterStateUpdateTest_7A9EF75B3B9A68B1-001/tempDir-001/node2/testcore_shard1_replica_n1/data/]
   [junit4]   2> 1125342 INFO  (qtp1867062839-13244) [n:127.0.0.1:51796_solr c:testcore s:shard1 r:core_node2 x:testcore_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1125342 INFO  (qtp1867062839-13244) [n:127.0.0.1:51796_solr c:testcore s:shard1 r:core_node2 x:testcore_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1125347 INFO  (qtp1867062839-13244) [n:127.0.0.1:51796_solr c:testcore s:shard1 r:core_node2 x:testcore_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1125347 INFO  (qtp1867062839-13244) [n:127.0.0.1:51796_solr c:testcore s:shard1 r:core_node2 x:testcore_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1125353 INFO  (qtp1867062839-13244) [n:127.0.0.1:51796_solr c:testcore s:shard1 r:core_node2 x:testcore_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 1125355 INFO  (qtp1867062839-13244) [n:127.0.0.1:51796_solr c:testcore s:shard1 r:core_node2 x:testcore_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1125355 INFO  (qtp1867062839-13244) [n:127.0.0.1:51796_solr c:testcore s:shard1 r:core_node2 x:testcore_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
   [junit4]   2> 1125355 INFO  (qtp1867062839-13244) [n:127.0.0.1:51796_solr c:testcore s:shard1 r:core_node2 x:testcore_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1670404075494047744
   [junit4]   2> 1125365 INFO  (searcherExecutor-8501-thread-1-processing-n:127.0.0.1:51796_solr x:testcore_shard1_replica_n1 c:testcore s:shard1 r:core_node2) [n:127.0.0.1:51796_solr c:testcore s:shard1 r:core_node2 x:testcore_shard1_replica_n1 ] o.a.s.c.SolrCore [testcore_shard1_replica_n1]  Registered new searcher autowarm time: 0 ms
   [junit4]   2> 1125394 INFO  (qtp1867062839-13244) [n:127.0.0.1:51796_solr c:testcore s:shard1 r:core_node2 x:testcore_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testcore/terms/shard1 to Terms{values={core_node2=0}, version=0}
   [junit4]   2> 1125394 INFO  (qtp1867062839-13244) [n:127.0.0.1:51796_solr c:testcore s:shard1 r:core_node2 x:testcore_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testcore/leaders/shard1
   [junit4]   2> 1125419 INFO  (qtp1867062839-13244) [n:127.0.0.1:51796_solr c:testcore s:shard1 r:core_node2 x:testcore_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1125419 INFO  (qtp1867062839-13244) [n:127.0.0.1:51796_solr c:testcore s:shard1 r:core_node2 x:testcore_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1125420 INFO  (qtp1867062839-13244) [n:127.0.0.1:51796_solr c:testcore s:shard1 r:core_node2 x:testcore_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/testcore/leaders/shard1/leader after winning as /collections/testcore/leader_elect/shard1/election/72161115607859208-core_node2-n_0000000000
   [junit4]   2> 1125439 INFO  (qtp1867062839-13244) [n:127.0.0.1:51796_solr c:testcore s:shard1 r:core_node2 x:testcore_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:51796/solr/testcore_shard1_replica_n1/ shard1
   [junit4]   2> 1125547 INFO  (zkCallback-8465-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcore/state.json] for collection [testcore] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1125548 INFO  (zkCallback-8465-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcore/state.json] for collection [testcore] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1125556 WARN  (qtp1867062839-13244) [n:127.0.0.1:51796_solr c:testcore s:shard1 r:core_node2 x:testcore_shard1_replica_n1 ] o.a.s.c.ZkController Skipping recovery according to sys prop solrcloud.skip.autorecovery
   [junit4]   2> 1125563 INFO  (qtp1867062839-13244) [n:127.0.0.1:51796_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=testcore_shard1_replica_n1&action=CREATE&numShards=1&collection=testcore&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=365
   [junit4]   2> 1125570 INFO  (qtp1424667048-13239) [n:127.0.0.1:51795_solr     ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
   [junit4]   2> 1125667 INFO  (zkCallback-8454-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcore/state.json] for collection [testcore] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1125667 INFO  (zkCallback-8465-thread-2) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcore/state.json] for collection [testcore] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1125667 INFO  (zkCallback-8465-thread-1) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcore/state.json] for collection [testcore] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1125668 INFO  (zkCallback-8465-thread-3) [     ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcore/state.json] for collection [testcore] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1125671 INFO  (qtp1424667048-13239) [n:127.0.0.1:51795_solr     ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf&name=testcore&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:51796_solr&wt=javabin&version=2} status=0 QTime=919
   [junit4]   2> 1125677 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=639827548
   [junit4]   2> 1125677 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:51795_solr
   [junit4]   2> 1125684 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.ZkController Publish this node as DOWN...
   [junit4]   2> 1125684 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.ZkController Publish node=127.0.0.1:51795_solr as DOWN
   [junit4]   2> 1125693 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 1125693 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@d212ff7: rootName = solr_51795, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@753590de
   [junit4]   2> 1125701 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 1125701 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@16e9b5f8: rootName = solr_51795, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@2240299e
   [junit4]   2> 1125704 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 1125704 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7d2085a1: rootName = solr_51795, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@63ceca2
   [junit4]   2> 1125705 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
   [junit4]   2> 1125818 INFO  (zkCallback-8498-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 1125818 INFO  (zkCallback-8465-thread-3) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 1125819 INFO  (zkCallback-8452-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 1125826 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@5a2d5545{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
   [junit4]   2> 1125826 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@10a3a276{/solr,null,UNAVAILABLE}
   [junit4]   2> 1125826 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1125828 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.MiniSolrCloudCluster waitForJettyToStop: 51795
   [junit4]   2> 1125828 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1816893201
   [junit4]   2> 1125828 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:51797_solr
   [junit4]   2> 1125830 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.ZkController Publish this node as DOWN...
   [junit4]   2> 1125830 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.ZkController Publish node=127.0.0.1:51797_solr as DOWN
   [junit4]   2> 1125840 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 1125840 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2578579a: rootName = solr_51797, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@386a2074
   [junit4]   2> 1125855 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 1125855 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1a292eb6: rootName = solr_51797, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@2240299e
   [junit4]   2> 1125866 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 1125867 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7d8a6eee: rootName = solr_51797, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@63ceca2
   [junit4]   2> 1125867 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
   [junit4]   2> 1125882 INFO  (zkCallback-8465-thread-3) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 1125882 INFO  (zkCallback-8498-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 1125998 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@4fac170{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
   [junit4]   2> 1125999 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@ce8f882{/solr,null,UNAVAILABLE}
   [junit4]   2> 1125999 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1126002 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=51797)
   [junit4]   2> 1126006 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 51797 try number 2 ...
   [junit4]   2> 1126006 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14.0.1+7
   [junit4]   2> 1126009 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1126009 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1126009 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1126010 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5e077812{/solr,null,AVAILABLE}
   [junit4]   2> 1126011 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.e.j.s.AbstractConnector Started ServerConnector@5aa87e7a{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:51797}
   [junit4]   2> 1126011 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.e.j.s.Server Started @1126158ms
   [junit4]   2> 1126011 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=51797}
   [junit4]   2> 1126012 ERROR (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1126012 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1126012 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 9.0.0
   [junit4]   2> 1126012 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1126012 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
   [junit4]   2> 1126012 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2020-06-24T17:57:45.476910Z
   [junit4]   2> 1126015 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1126019 INFO  (zkConnectionManagerCallback-8517-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1126020 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1126021 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1126151 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1126154 WARN  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@ee89008[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1126154 WARN  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@ee89008[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1126170 WARN  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@48bb87df[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1126170 WARN  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@48bb87df[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1126174 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51789/solr
   [junit4]   2> 1126176 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [n:127.0.0.1:51797_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1126180 INFO  (zkConnectionManagerCallback-8528-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1126180 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [n:127.0.0.1:51797_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1126220 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [n:127.0.0.1:51797_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1126241 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [n:127.0.0.1:51797_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:51797_solr as DOWN
   [junit4]   2> 1126248 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [n:127.0.0.1:51797_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 1000 transient cores
   [junit4]   2> 1126248 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [n:127.0.0.1:51797_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51797_solr
   [junit4]   2> 1126254 INFO  (zkCallback-8498-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1126254 INFO  (zkCallback-8465-thread-3) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1126255 INFO  (zkCallback-8527-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1126259 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [n:127.0.0.1:51797_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 1126260 WARN  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [n:127.0.0.1:51797_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 1126287 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [n:127.0.0.1:51797_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1126313 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [n:127.0.0.1:51797_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51797.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c5b2cfa
   [junit4]   2> 1126327 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [n:127.0.0.1:51797_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51797.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c5b2cfa
   [junit4]   2> 1126327 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [n:127.0.0.1:51797_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51797.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c5b2cfa
   [junit4]   2> 1126330 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [n:127.0.0.1:51797_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.ClusterStateUpdateTest_7A9EF75B3B9A68B1-001/tempDir-001/node3
   [junit4]   2> 1126340 INFO  (TEST-ClusterStateUpdateTest.testCoreRegistration-seed#[7A9EF75B3B9A68B1]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testCoreRegistration
   [junit4]   2> 1126448 INFO  (jetty-closer-8537-thread-1) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2097332388
   [junit4]   2> 1126448 INFO  (jetty-closer-8537-thread-1) [     ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:51796_solr
   [junit4]   2> 1126449 INFO  (jetty-closer-8537-thread-1) [     ] o.a.s.c.ZkController Publish this node as DOWN...
   [junit4]   2> 1126449 INFO  (jetty-closer-8537-thread-1) [     ] o.a.s.c.ZkController Publish node=127.0.0.1:51796_solr as DOWN
   [junit4]   2> 1126449 INFO  (jetty-closer-8537-thread-2) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1143726295
   [junit4]   2> 1126449 INFO  (jetty-closer-8537-thread-2) [     ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:51797_solr
   [junit4]   2> 1126452 INFO  (jetty-closer-8537-thread-2) [     ] o.a.s.c.ZkController Publish this node as DOWN...
   [junit4]   2> 1126452 INFO  (jetty-closer-8537-thread-2) [     ] o.a.s.c.ZkController Publish node=127.0.0.1:51797_solr as DOWN
   [junit4]   2> 1126459 INFO  (coreCloseExecutor-8543-thread-1) [n:127.0.0.1:51796_solr     ] o.a.s.c.SolrCore [testcore_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@3444c9e5
   [junit4]   2> 1126459 INFO  (coreCloseExecutor-8543-thread-1) [n:127.0.0.1:51796_solr     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testcore.shard1.replica_n1 tag=SolrCore@3444c9e5
   [junit4]   2> 1126459 INFO  (coreCloseExecutor-8543-thread-1) [n:127.0.0.1:51796_solr     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3d598c2e: rootName = solr_51796, domain = solr.core.testcore.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.testcore.shard1.replica_n1/com.codahale.metrics.MetricRegistry@220b87d4
   [junit4]   2> 1126461 INFO  (jetty-closer-8537-thread-2) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 1126461 INFO  (jetty-closer-8537-thread-2) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@64fa2665: rootName = solr_51797, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@53bbac80
   [junit4]   2> 1126482 INFO  (jetty-closer-8537-thread-2) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 1126482 INFO  (jetty-closer-8537-thread-2) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@17fb8b93: rootName = solr_51797, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@2240299e
   [junit4]   2> 1126485 INFO  (jetty-closer-8537-thread-2) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 1126485 INFO  (jetty-closer-8537-thread-2) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@426f5821: rootName = solr_51797, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@63ceca2
   [junit4]   2> 1126485 INFO  (jetty-closer-8537-thread-2) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
   [junit4]   2> 1126488 INFO  (coreCloseExecutor-8543-thread-1) [n:127.0.0.1:51796_solr     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testcore.shard1.leader tag=SolrCore@3444c9e5
   [junit4]   2> 1126489 INFO  (coreCloseExecutor-8543-thread-1) [n:127.0.0.1:51796_solr     ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 1126492 INFO  (jetty-closer-8537-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
   [junit4]   2> 1126492 INFO  (jetty-closer-8537-thread-1) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@a9ae569: rootName = solr_51796, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@ffa8215
   [junit4]   2> 1126496 INFO  (jetty-closer-8537-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
   [junit4]   2> 1126496 INFO  (jetty-closer-8537-thread-1) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2cc920aa: rootName = solr_51796, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@2240299e
   [junit4]   2> 1126498 INFO  (jetty-closer-8537-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
   [junit4]   2> 1126499 INFO  (jetty-closer-8537-thread-1) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7aa14837: rootName = solr_51796, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@63ceca2
   [junit4]   2> 1126499 INFO  (jetty-closer-8537-thread-1) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
   [junit4]   2> 1126500 INFO  (closeThreadPool-8548-thread-1) [     ] o.a.s.c.Overseer Overseer (id=72161115607859208-127.0.0.1:51796_solr-n_0000000000) closing
   [junit4]   2> 1126500 INFO  (OverseerStateUpdate-72161115607859208-127.0.0.1:51796_solr-n_0000000000) [n:127.0.0.1:51796_solr     ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:51796_solr
   [junit4]   2> 1126500 INFO  (OverseerAutoScalingTriggerThread-72161115607859208-127.0.0.1:51796_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 1126504 INFO  (closeThreadPool-8548-thread-2) [     ] o.a.s.c.Overseer Overseer (id=72161115607859208-127.0.0.1:51796_solr-n_0000000000) closing
   [junit4]   2> 1126595 INFO  (zkCallback-8465-thread-3) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 1126600 INFO  (jetty-closer-8537-thread-2) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@5aa87e7a{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:51797}
   [junit4]   2> 1126601 INFO  (jetty-closer-8537-thread-2) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5e077812{/solr,null,UNAVAILABLE}
   [junit4]   2> 1126601 INFO  (jetty-closer-8537-thread-2) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1126700 INFO  (jetty-closer-8537-thread-1) [     ] o.a.s.c.Overseer Overseer (id=72161115607859208-127.0.0.1:51796_solr-n_0000000000) closing
   [junit4]   2> 1126703 INFO  (jetty-closer-8537-thread-1) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@618efdae{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
   [junit4]   2> 1126704 INFO  (jetty-closer-8537-thread-1) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@51470e4d{/solr,null,UNAVAILABLE}
   [junit4]   2> 1126704 INFO  (jetty-closer-8537-thread-1) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 1126706 INFO  (SUITE-ClusterStateUpdateTest-seed#[7A9EF75B3B9A68B1]-worker) [     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 1126916 WARN  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/aliases.json
   [junit4]   2> 	5	/solr/clusterprops.json
   [junit4]   2> 	4	/solr/packages.json
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 	2	/solr/collections/testcore/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	11	/solr/collections/testcore/state.json
   [junit4]   2> 	2	/solr/overseer_elect/election/72161115607859208-127.0.0.1:51796_solr-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	22	/solr/overseer/queue
   [junit4]   2> 	21	/solr/live_nodes
   [junit4]   2> 	9	/solr/collections
   [junit4]   2> 	5	/solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> 1126926 INFO  (SUITE-ClusterStateUpdateTest-seed#[7A9EF75B3B9A68B1]-worker) [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:51789
   [junit4]   2> 1126926 INFO  (SUITE-ClusterStateUpdateTest-seed#[7A9EF75B3B9A68B1]-worker) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:51789
   [junit4]   2> 1126926 INFO  (SUITE-ClusterStateUpdateTest-seed#[7A9EF75B3B9A68B1]-worker) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 51789
   [junit4]   2> 1126926 INFO  (SUITE-ClusterStateUpdateTest-seed#[7A9EF75B3B9A68B1]-worker) [     ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> Jun 24, 2020 5:57:46 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> Jun 24, 2020 5:57:56 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.cloud.ClusterStateUpdateTest: 
   [junit4]   2>    1) Thread[id=13198, name=SessionTracker, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
   [junit4]   2>         at java.base@14.0.1/java.lang.Thread.sleep(Native Method)
   [junit4]   2>         at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
   [junit4]   2> Jun 24, 2020 5:57:56 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=13198, name=SessionTracker, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
   [junit4]   2> 1136971 ERROR (SessionTracker) [     ] o.a.z.s.ZooKeeperCriticalThread Severe unrecoverable error, from thread : SessionTracker
   [junit4]   2>           => java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 	at java.base/java.lang.Thread.sleep(Native Method)
   [junit4]   2> java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 	at java.lang.Thread.sleep(Native Method) ~[?:?]
   [junit4]   2> 	at org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) [zookeeper-3.5.7.jar:3.5.7]
   [junit4]   2> Jun 24, 2020 5:57:56 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: All leaked threads terminated.
   [junit4]   2> NOTE: test params are: codec=FastCompressingStoredFieldsData(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=16208, maxDocsPerChunk=679, blockShift=3), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=16208, blockSize=3)), sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=pt-AO, timezone=Africa/Harare
   [junit4]   2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 14.0.1 (64-bit)/cpus=6,threads=1,free=295698432,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [TestReplicationHandlerDiskOverFlow, OverseerRolesTest, TolerantUpdateProcessorTest, MetricsConfigTest, TestSolrCloudWithHadoopAuthPlugin, AsyncCallRequestStatusResponseTest, TestDocTermOrds, MoveReplicaHDFSTest, TestClusterStateMutator, ChaosMonkeySafeLeaderWithPullReplicasTest, RangeFacetCloudTest, TestExtendedDismaxParser, SolrShardReporterTest, TestGeoJSONResponseWriter, StatsReloadRaceTest, TestCloudPhrasesIdentificationComponent, TestFieldTypeResource, TestStressReorder, NodeMutatorTest, TemplateUpdateProcessorTest, BasicFunctionalityTest, BadCopyFieldTest, BasicAuthStandaloneTest, DistributedSpellCheckComponentTest, RestartWhileUpdatingTest, BitVectorTest, NoCacheHeaderTest, TestLegacyField, PingRequestHandlerTest, TestMiniSolrCloudClusterSSL, TestConfigReload, TestCloudSearcherWarming, TestSafeXMLParsing, TestNumericRangeQuery32, LukeRequestHandlerTest, ShardRoutingCustomTest, EchoParamsTest, TestFieldCacheSortRandom, AutoScalingHandlerTest, TestSearchPerf, SpatialFilterTest, TestMaxScoreQueryParser, HdfsThreadLeakTest, DistanceUnitsTest, TestSortByMinMaxFunction, TestComplexPhraseQParserPlugin, XMLAtomicUpdateMultivalueTest, TestDeprecatedFilters, TestJsonFacetErrors, V2StandaloneTest, TestSimNodeAddedTrigger, TestRandomDVFaceting, TestCollationFieldDocValues, SearchHandlerTest, CustomHighlightComponentTest, TestJsonRangeFacets, SolrGraphiteReporterTest, TestInPlaceUpdatesRequiredField, TestQueryUtils, TestLegacyBM25SimilarityFactory, LeaderElectionTest, JavaBinAtomicUpdateMultivalueTest, TestTrieFacet, OverseerTest, TestRawResponseWriter, JavabinLoaderTest, TestSimUtils, CoreAdminCreateDiscoverTest, DistributedVersionInfoTest, TestBinaryField, HDFSCollectionsAPITest, NodeAddedTriggerIntegrationTest, TestQueryingOnDownCollection, TestExpandComponent, TestFileDictionaryLookup, DataDrivenBlockJoinTest, RAMDirectoryFactoryTest, SolrCloudExampleTest, SimpleCollectionCreateDeleteTest, TestUtils, DaemonStreamApiTest, ConcurrentCreateCollectionTest, RestoreTriggerStateTest, TriLevelCompositeIdRoutingTest, TestNumericTerms64, MoreLikeThisComponentTest, DocValuesTest, AnalysisAfterCoreReloadTest, DistributedIntervalFacetingTest, SolrTestCaseJ4Test, TestCrossCoreJoin, TestCursorMarkWithoutUniqueKey, TestDistributedGrouping, TestDistributedMissingSort, TestDistributedSearch, BasicDistributedZk2Test, ClusterStateTest, ClusterStateUpdateTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ClusterStateUpdateTest -Dtests.seed=7A9EF75B3B9A68B1 -Dtests.slow=true -Dtests.locale=pt-AO -Dtests.timezone=Africa/Harare -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J1 | ClusterStateUpdateTest (suite) <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.ClusterStateUpdateTest: 
   [junit4]    >    1) Thread[id=13198, name=SessionTracker, state=TIMED_WAITING, group=TGRP-ClusterStateUpdateTest]
   [junit4]    >         at java.base@14.0.1/java.lang.Thread.sleep(Native Method)
   [junit4]    >         at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([7A9EF75B3B9A68B1]:0)
   [junit4] Completed [468/911 (1!)] on J1 in 13.48s, 1 test, 1 error <<< FAILURES!

[...truncated 46375 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/6209/consoleText

[repro] Revision: 6a455866b0125e3e29de4b504c6d14cf5c14580b

[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseZGC"
[repro] Repro line:  ant test  -Dtestcase=ClusterStateUpdateTest -Dtests.seed=7A9EF75B3B9A68B1 -Dtests.slow=true -Dtests.locale=pt-AO -Dtests.timezone=Africa/Harare -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       ClusterStateUpdateTest
[repro] ant compile-test

[...truncated 2471 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.ClusterStateUpdateTest" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseZGC" -Dtests.seed=7A9EF75B3B9A68B1 -Dtests.slow=true -Dtests.locale=pt-AO -Dtests.timezone=Africa/Harare -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[...truncated 81 lines...]
[repro] Failures w/original seeds:
[repro]   0/5 failed: org.apache.solr.cloud.ClusterStateUpdateTest
[repro] Exiting with code 0

[...truncated 73 lines...]