You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2020/04/27 00:41:41 UTC
[JENKINS] Lucene-Solr-master-MacOSX (64bit/jdk-14) - Build # 5926 -
Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/5926/
Java: 64bit/jdk-14 -XX:-UseCompressedOops -XX:+UseG1GC
1 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.handler.admin.IndexSizeEstimatorTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.handler.admin.IndexSizeEstimatorTest: 1) Thread[id=25322, name=SessionTracker, state=TIMED_WAITING, group=TGRP-IndexSizeEstimatorTest] at java.base@14/java.lang.Thread.sleep(Native Method) at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.handler.admin.IndexSizeEstimatorTest:
1) Thread[id=25322, name=SessionTracker, state=TIMED_WAITING, group=TGRP-IndexSizeEstimatorTest]
at java.base@14/java.lang.Thread.sleep(Native Method)
at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
at __randomizedtesting.SeedInfo.seed([9BAB3DFFA7BA3C5D]:0)
Build Log:
[...truncated 15050 lines...]
[junit4] Suite: org.apache.solr.handler.admin.IndexSizeEstimatorTest
[junit4] 2> 1986652 INFO (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [ ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/server/solr/configsets/_default/conf'
[junit4] 2> 1986653 INFO (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.admin.IndexSizeEstimatorTest_9BAB3DFFA7BA3C5D-001/data-dir-114-001
[junit4] 2> 1986654 WARN (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
[junit4] 2> 1986654 INFO (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 1986655 INFO (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 1986655 INFO (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1986656 INFO (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.admin.IndexSizeEstimatorTest_9BAB3DFFA7BA3C5D-001/tempDir-001
[junit4] 2> 1986659 INFO (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1986661 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1986661 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1986766 INFO (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:49887
[junit4] 2> 1986766 INFO (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:49887
[junit4] 2> 1986766 INFO (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:49887
[junit4] 2> 1986766 INFO (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 49887
[junit4] 2> 1986768 INFO (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1986772 INFO (zkConnectionManagerCallback-14382-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1986773 INFO (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1986776 INFO (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1986780 INFO (zkConnectionManagerCallback-14384-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1986780 INFO (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1986782 INFO (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1986791 INFO (zkConnectionManagerCallback-14386-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1986791 INFO (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1986899 INFO (jetty-launcher-14387-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 1986899 INFO (jetty-launcher-14387-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 1986899 INFO (jetty-launcher-14387-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 1986899 INFO (jetty-launcher-14387-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 1986899 INFO (jetty-launcher-14387-thread-1) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14+36
[junit4] 2> 1986899 INFO (jetty-launcher-14387-thread-2) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14+36
[junit4] 2> 1986904 INFO (jetty-launcher-14387-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1986904 INFO (jetty-launcher-14387-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1986904 INFO (jetty-launcher-14387-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 1986904 INFO (jetty-launcher-14387-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1986904 INFO (jetty-launcher-14387-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1986904 INFO (jetty-launcher-14387-thread-2) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 1986905 INFO (jetty-launcher-14387-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@660b8dca{/solr,null,AVAILABLE}
[junit4] 2> 1986905 INFO (jetty-launcher-14387-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4bf7d3b7{/solr,null,AVAILABLE}
[junit4] 2> 1986906 INFO (jetty-launcher-14387-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@63010f0d{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:49898}
[junit4] 2> 1986906 INFO (jetty-launcher-14387-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@676253df{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:49896}
[junit4] 2> 1986906 INFO (jetty-launcher-14387-thread-1) [ ] o.e.j.s.Server Started @1986983ms
[junit4] 2> 1986906 INFO (jetty-launcher-14387-thread-2) [ ] o.e.j.s.Server Started @1986983ms
[junit4] 2> 1986906 INFO (jetty-launcher-14387-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=49898}
[junit4] 2> 1986906 INFO (jetty-launcher-14387-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=49896}
[junit4] 2> 1986906 ERROR (jetty-launcher-14387-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1986906 ERROR (jetty-launcher-14387-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1986906 INFO (jetty-launcher-14387-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1986906 INFO (jetty-launcher-14387-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1986906 INFO (jetty-launcher-14387-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 9.0.0
[junit4] 2> 1986906 INFO (jetty-launcher-14387-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 9.0.0
[junit4] 2> 1986906 INFO (jetty-launcher-14387-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1986906 INFO (jetty-launcher-14387-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 1986906 INFO (jetty-launcher-14387-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1986906 INFO (jetty-launcher-14387-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-04-27T00:19:20.783858Z
[junit4] 2> 1986906 INFO (jetty-launcher-14387-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 1986906 INFO (jetty-launcher-14387-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-04-27T00:19:20.783879Z
[junit4] 2> 1986908 INFO (jetty-launcher-14387-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1986910 INFO (jetty-launcher-14387-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1986911 INFO (zkConnectionManagerCallback-14390-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1986911 INFO (jetty-launcher-14387-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1986912 INFO (jetty-launcher-14387-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1986913 INFO (zkConnectionManagerCallback-14391-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1986913 INFO (jetty-launcher-14387-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1986914 INFO (jetty-launcher-14387-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1987025 INFO (jetty-launcher-14387-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 1987026 WARN (jetty-launcher-14387-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@4f2e19ae[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1987026 WARN (jetty-launcher-14387-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@4f2e19ae[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1987029 WARN (jetty-launcher-14387-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@6f30c44b[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1987029 WARN (jetty-launcher-14387-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@6f30c44b[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1987030 INFO (jetty-launcher-14387-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:49887/solr
[junit4] 2> 1987031 INFO (jetty-launcher-14387-thread-2) [n:127.0.0.1:49898_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1987035 INFO (zkConnectionManagerCallback-14402-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1987036 INFO (jetty-launcher-14387-thread-2) [n:127.0.0.1:49898_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1987126 INFO (jetty-launcher-14387-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 1987129 WARN (jetty-launcher-14387-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5cd0fb1b[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1987129 WARN (jetty-launcher-14387-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5cd0fb1b[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1987133 WARN (jetty-launcher-14387-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@1c000c50[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1987133 WARN (jetty-launcher-14387-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@1c000c50[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1987134 INFO (jetty-launcher-14387-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:49887/solr
[junit4] 2> 1987135 INFO (jetty-launcher-14387-thread-1) [n:127.0.0.1:49896_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1987138 INFO (zkConnectionManagerCallback-14415-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1987138 INFO (jetty-launcher-14387-thread-1) [n:127.0.0.1:49896_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1987176 INFO (jetty-launcher-14387-thread-1) [n:127.0.0.1:49896_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:49896_solr
[junit4] 2> 1987178 INFO (jetty-launcher-14387-thread-1) [n:127.0.0.1:49896_solr ] o.a.s.c.Overseer Overseer (id=72116744567652358-127.0.0.1:49896_solr-n_0000000000) starting
[junit4] 2> 1987196 INFO (OverseerStateUpdate-72116744567652358-127.0.0.1:49896_solr-n_0000000000) [n:127.0.0.1:49896_solr ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:49896_solr
[junit4] 2> 1987197 INFO (jetty-launcher-14387-thread-1) [n:127.0.0.1:49896_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49896_solr
[junit4] 2> 1987201 INFO (OverseerStateUpdate-72116744567652358-127.0.0.1:49896_solr-n_0000000000) [n:127.0.0.1:49896_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1987208 INFO (jetty-launcher-14387-thread-1) [n:127.0.0.1:49896_solr ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 1987208 WARN (jetty-launcher-14387-thread-1) [n:127.0.0.1:49896_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=you make it. Consider configuring authentication/authorization before exposing Solr to users internal or authorization=external. See https://s.apache.org/solrsecurity for more info. Solr is only as secure as disableddisabled
[junit4] 2> 1987236 INFO (jetty-launcher-14387-thread-1) [n:127.0.0.1:49896_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1987308 INFO (jetty-launcher-14387-thread-1) [n:127.0.0.1:49896_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49896.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ea613f3
[junit4] 2> 1987325 INFO (jetty-launcher-14387-thread-1) [n:127.0.0.1:49896_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49896.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ea613f3
[junit4] 2> 1987327 INFO (jetty-launcher-14387-thread-1) [n:127.0.0.1:49896_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49896.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ea613f3
[junit4] 2> 1987328 INFO (jetty-launcher-14387-thread-1) [n:127.0.0.1:49896_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.admin.IndexSizeEstimatorTest_9BAB3DFFA7BA3C5D-001/tempDir-001/node1/.
[junit4] 2> 1987720 INFO (jetty-launcher-14387-thread-2) [n:127.0.0.1:49898_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1987737 INFO (jetty-launcher-14387-thread-2) [n:127.0.0.1:49898_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:49898_solr as DOWN
[junit4] 2> 1987741 INFO (jetty-launcher-14387-thread-2) [n:127.0.0.1:49898_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 1000 transient cores
[junit4] 2> 1987741 INFO (jetty-launcher-14387-thread-2) [n:127.0.0.1:49898_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49898_solr
[junit4] 2> 1987744 INFO (zkCallback-14414-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1987745 INFO (zkCallback-14401-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1987749 INFO (jetty-launcher-14387-thread-2) [n:127.0.0.1:49898_solr ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 1987750 WARN (jetty-launcher-14387-thread-2) [n:127.0.0.1:49898_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=you make it. Consider configuring authentication/authorization before exposing Solr to users internal or authorization=external. See https://s.apache.org/solrsecurity for more info. Solr is only as secure as disableddisabled
[junit4] 2> 1987772 INFO (jetty-launcher-14387-thread-2) [n:127.0.0.1:49898_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1987833 INFO (jetty-launcher-14387-thread-2) [n:127.0.0.1:49898_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49898.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ea613f3
[junit4] 2> 1987846 INFO (jetty-launcher-14387-thread-2) [n:127.0.0.1:49898_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49898.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ea613f3
[junit4] 2> 1987847 INFO (jetty-launcher-14387-thread-2) [n:127.0.0.1:49898_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49898.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ea613f3
[junit4] 2> 1987848 INFO (jetty-launcher-14387-thread-2) [n:127.0.0.1:49898_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.admin.IndexSizeEstimatorTest_9BAB3DFFA7BA3C5D-001/tempDir-001/node2/.
[junit4] 2> 1987877 INFO (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [ ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=2
[junit4] 2> 1987878 INFO (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1987885 INFO (zkConnectionManagerCallback-14438-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1987885 INFO (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1987895 INFO (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1987906 INFO (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:49887/solr ready
[junit4] 2> 1987925 INFO (qtp1772466331-25359) [n:127.0.0.1:49896_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf&maxShardsPerNode=2&name=IndexSizeEstimator_collection&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1987939 INFO (OverseerThreadFactory-14422-thread-1-processing-n:127.0.0.1:49896_solr) [n:127.0.0.1:49896_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection IndexSizeEstimator_collection
[junit4] 2> 1988057 INFO (qtp1772466331-25362) [n:127.0.0.1:49896_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1988060 INFO (qtp1841757381-25358) [n:127.0.0.1:49898_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1988063 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1988064 INFO (qtp1841757381-25361) [n:127.0.0.1:49898_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1988080 INFO (OverseerStateUpdate-72116744567652358-127.0.0.1:49896_solr-n_0000000000) [n:127.0.0.1:49896_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"IndexSizeEstimator_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"IndexSizeEstimator_collection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:49898/solr",
[junit4] 2> "node_name":"127.0.0.1:49898_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1988090 INFO (OverseerStateUpdate-72116744567652358-127.0.0.1:49896_solr-n_0000000000) [n:127.0.0.1:49896_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"IndexSizeEstimator_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"IndexSizeEstimator_collection_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:49896/solr",
[junit4] 2> "node_name":"127.0.0.1:49896_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1988099 INFO (OverseerStateUpdate-72116744567652358-127.0.0.1:49896_solr-n_0000000000) [n:127.0.0.1:49896_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"IndexSizeEstimator_collection",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"IndexSizeEstimator_collection_shard2_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:49896/solr",
[junit4] 2> "node_name":"127.0.0.1:49896_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1988110 INFO (OverseerStateUpdate-72116744567652358-127.0.0.1:49896_solr-n_0000000000) [n:127.0.0.1:49896_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"IndexSizeEstimator_collection",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"IndexSizeEstimator_collection_shard2_replica_n6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:49898/solr",
[junit4] 2> "node_name":"127.0.0.1:49898_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1988316 INFO (qtp1772466331-25360) [n:127.0.0.1:49896_solr x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=IndexSizeEstimator_collection_shard1_replica_n2&action=CREATE&numShards=2&collection=IndexSizeEstimator_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1988317 INFO (qtp1772466331-25360) [n:127.0.0.1:49896_solr x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 1000 transient cores
[junit4] 2> 1988317 INFO (qtp1841757381-25358) [n:127.0.0.1:49898_solr x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=IndexSizeEstimator_collection_shard2_replica_n6&action=CREATE&numShards=2&collection=IndexSizeEstimator_collection&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1988318 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=IndexSizeEstimator_collection_shard2_replica_n4&action=CREATE&numShards=2&collection=IndexSizeEstimator_collection&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1988319 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=IndexSizeEstimator_collection_shard1_replica_n1&action=CREATE&numShards=2&collection=IndexSizeEstimator_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1988349 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 1988349 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 1988352 INFO (qtp1772466331-25360) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 1988354 INFO (qtp1841757381-25358) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard2 r:core_node8 x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 1988367 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.s.IndexSchema Schema name=cloud-dynamic
[junit4] 2> 1988367 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=cloud-dynamic
[junit4] 2> 1988370 INFO (qtp1841757381-25358) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard2 r:core_node8 x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.s.IndexSchema Schema name=cloud-dynamic
[junit4] 2> 1988396 INFO (qtp1772466331-25360) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.s.IndexSchema Schema name=cloud-dynamic
[junit4] 2> 1988428 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 1988428 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.c.CoreContainer Creating SolrCore 'IndexSizeEstimator_collection_shard2_replica_n4' using configuration from configset conf, trusted=true
[junit4] 2> 1988429 INFO (qtp1841757381-25358) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard2 r:core_node8 x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 1988429 INFO (qtp1841757381-25358) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard2 r:core_node8 x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.c.CoreContainer Creating SolrCore 'IndexSizeEstimator_collection_shard2_replica_n6' using configuration from configset conf, trusted=true
[junit4] 2> 1988429 INFO (qtp1841757381-25358) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard2 r:core_node8 x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49898.solr.core.IndexSizeEstimator_collection.shard2.replica_n6' (registry 'solr.core.IndexSizeEstimator_collection.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ea613f3
[junit4] 2> 1988429 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49896.solr.core.IndexSizeEstimator_collection.shard2.replica_n4' (registry 'solr.core.IndexSizeEstimator_collection.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ea613f3
[junit4] 2> 1988429 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 1988429 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'IndexSizeEstimator_collection_shard1_replica_n1' using configuration from configset conf, trusted=true
[junit4] 2> 1988430 INFO (qtp1841757381-25358) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard2 r:core_node8 x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.c.SolrCore [[IndexSizeEstimator_collection_shard2_replica_n6] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.admin.IndexSizeEstimatorTest_9BAB3DFFA7BA3C5D-001/tempDir-001/node2/./IndexSizeEstimator_collection_shard2_replica_n6], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.admin.IndexSizeEstimatorTest_9BAB3DFFA7BA3C5D-001/tempDir-001/node2/./IndexSizeEstimator_collection_shard2_replica_n6/data/]
[junit4] 2> 1988430 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.c.SolrCore [[IndexSizeEstimator_collection_shard2_replica_n4] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.admin.IndexSizeEstimatorTest_9BAB3DFFA7BA3C5D-001/tempDir-001/node1/./IndexSizeEstimator_collection_shard2_replica_n4], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.admin.IndexSizeEstimatorTest_9BAB3DFFA7BA3C5D-001/tempDir-001/node1/./IndexSizeEstimator_collection_shard2_replica_n4/data/]
[junit4] 2> 1988430 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49898.solr.core.IndexSizeEstimator_collection.shard1.replica_n1' (registry 'solr.core.IndexSizeEstimator_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ea613f3
[junit4] 2> 1988430 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [[IndexSizeEstimator_collection_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.admin.IndexSizeEstimatorTest_9BAB3DFFA7BA3C5D-001/tempDir-001/node2/./IndexSizeEstimator_collection_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.admin.IndexSizeEstimatorTest_9BAB3DFFA7BA3C5D-001/tempDir-001/node2/./IndexSizeEstimator_collection_shard1_replica_n1/data/]
[junit4] 2> 1988436 INFO (qtp1772466331-25360) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 1988436 INFO (qtp1772466331-25360) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.c.CoreContainer Creating SolrCore 'IndexSizeEstimator_collection_shard1_replica_n2' using configuration from configset conf, trusted=true
[junit4] 2> 1988437 INFO (qtp1772466331-25360) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_49896.solr.core.IndexSizeEstimator_collection.shard1.replica_n2' (registry 'solr.core.IndexSizeEstimator_collection.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ea613f3
[junit4] 2> 1988437 INFO (qtp1772466331-25360) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.c.SolrCore [[IndexSizeEstimator_collection_shard1_replica_n2] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.admin.IndexSizeEstimatorTest_9BAB3DFFA7BA3C5D-001/tempDir-001/node1/./IndexSizeEstimator_collection_shard1_replica_n2], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.handler.admin.IndexSizeEstimatorTest_9BAB3DFFA7BA3C5D-001/tempDir-001/node1/./IndexSizeEstimator_collection_shard1_replica_n2/data/]
[junit4] 2> 1988531 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1988531 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1988534 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1988534 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1988535 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1988535 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1988535 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@358cd2f5[IndexSizeEstimator_collection_shard2_replica_n4] main]
[junit4] 2> 1988538 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1988538 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1988541 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@4a074297[IndexSizeEstimator_collection_shard1_replica_n1] main]
[junit4] 2> 1988544 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1988546 INFO (qtp1772466331-25360) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1988547 INFO (qtp1772466331-25360) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1988547 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1988548 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1988549 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1988550 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1988550 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1665082864358653952
[junit4] 2> 1988550 INFO (qtp1772466331-25360) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1988550 INFO (qtp1772466331-25360) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1988550 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1988550 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1665082864358653952
[junit4] 2> 1988552 INFO (qtp1772466331-25360) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@651ac9bd[IndexSizeEstimator_collection_shard1_replica_n2] main]
[junit4] 2> 1988557 INFO (qtp1772466331-25360) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1988559 INFO (searcherExecutor-14444-thread-1-processing-n:127.0.0.1:49898_solr x:IndexSizeEstimator_collection_shard1_replica_n1 c:IndexSizeEstimator_collection s:shard1 r:core_node3) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [IndexSizeEstimator_collection_shard1_replica_n1] Registered new searcher Searcher@4a074297[IndexSizeEstimator_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1988559 INFO (qtp1772466331-25360) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1988560 INFO (qtp1772466331-25360) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1988560 INFO (qtp1772466331-25360) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1665082864369139712
[junit4] 2> 1988560 INFO (searcherExecutor-14440-thread-1-processing-n:127.0.0.1:49896_solr x:IndexSizeEstimator_collection_shard2_replica_n4 c:IndexSizeEstimator_collection s:shard2 r:core_node7) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.c.SolrCore [IndexSizeEstimator_collection_shard2_replica_n4] Registered new searcher Searcher@358cd2f5[IndexSizeEstimator_collection_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1988563 INFO (searcherExecutor-14446-thread-1-processing-n:127.0.0.1:49896_solr x:IndexSizeEstimator_collection_shard1_replica_n2 c:IndexSizeEstimator_collection s:shard1 r:core_node5) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.c.SolrCore [IndexSizeEstimator_collection_shard1_replica_n2] Registered new searcher Searcher@651ac9bd[IndexSizeEstimator_collection_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1988569 INFO (qtp1841757381-25358) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard2 r:core_node8 x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1988569 INFO (qtp1841757381-25358) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard2 r:core_node8 x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1988572 INFO (qtp1841757381-25358) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard2 r:core_node8 x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1988572 INFO (qtp1841757381-25358) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard2 r:core_node8 x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1988573 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/IndexSizeEstimator_collection/terms/shard1 to Terms{values={core_node3=0}, version=0}
[junit4] 2> 1988573 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/IndexSizeEstimator_collection/terms/shard2 to Terms{values={core_node7=0}, version=0}
[junit4] 2> 1988573 INFO (qtp1841757381-25358) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard2 r:core_node8 x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@663f9cfa[IndexSizeEstimator_collection_shard2_replica_n6] main]
[junit4] 2> 1988573 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/IndexSizeEstimator_collection/leaders/shard2
[junit4] 2> 1988573 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/IndexSizeEstimator_collection/leaders/shard1
[junit4] 2> 1988577 INFO (qtp1841757381-25358) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard2 r:core_node8 x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1988580 INFO (qtp1841757381-25358) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard2 r:core_node8 x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1988581 INFO (qtp1841757381-25358) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard2 r:core_node8 x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1988582 INFO (qtp1841757381-25358) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard2 r:core_node8 x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1665082864392208384
[junit4] 2> 1988585 INFO (searcherExecutor-14442-thread-1-processing-n:127.0.0.1:49898_solr x:IndexSizeEstimator_collection_shard2_replica_n6 c:IndexSizeEstimator_collection s:shard2 r:core_node8) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard2 r:core_node8 x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.c.SolrCore [IndexSizeEstimator_collection_shard2_replica_n6] Registered new searcher Searcher@663f9cfa[IndexSizeEstimator_collection_shard2_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1988593 INFO (qtp1772466331-25360) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/IndexSizeEstimator_collection/terms/shard1 to Terms{values={core_node3=0, core_node5=0}, version=1}
[junit4] 2> 1988593 INFO (qtp1772466331-25360) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/IndexSizeEstimator_collection/leaders/shard1
[junit4] 2> 1988605 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1988606 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=9995ms
[junit4] 2> 1988608 INFO (qtp1841757381-25358) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard2 r:core_node8 x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/IndexSizeEstimator_collection/terms/shard2 to Terms{values={core_node7=0, core_node8=0}, version=1}
[junit4] 2> 1988608 INFO (qtp1841757381-25358) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard2 r:core_node8 x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/IndexSizeEstimator_collection/leaders/shard2
[junit4] 2> 1988608 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1988608 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:49898/solr/IndexSizeEstimator_collection_shard1_replica_n1/
[junit4] 2> 1988611 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.u.PeerSync PeerSync: core=IndexSizeEstimator_collection_shard1_replica_n1 url=http://127.0.0.1:49898/solr START replicas=[http://127.0.0.1:49896/solr/IndexSizeEstimator_collection_shard1_replica_n2/] nUpdates=100
[junit4] 2> 1988611 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.u.PeerSync PeerSync: core=IndexSizeEstimator_collection_shard1_replica_n1 url=http://127.0.0.1:49898/solr DONE. We have no versions. sync failed.
[junit4] 2> 1988614 INFO (qtp1772466331-25362) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.c.S.Request [IndexSizeEstimator_collection_shard1_replica_n2] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1988614 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 1988614 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 1988614 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/IndexSizeEstimator_collection/leaders/shard1/leader after winning as /collections/IndexSizeEstimator_collection/leader_elect/shard1/election/72116744567652357-core_node3-n_0000000000
[junit4] 2> 1988621 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:49898/solr/IndexSizeEstimator_collection_shard1_replica_n1/ shard1
[junit4] 2> 1988729 INFO (zkCallback-14401-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1988729 INFO (zkCallback-14401-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1988729 INFO (zkCallback-14401-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1988732 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1988742 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=IndexSizeEstimator_collection_shard1_replica_n1&action=CREATE&numShards=2&collection=IndexSizeEstimator_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=425
[junit4] 2> 1988848 INFO (zkCallback-14401-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1988848 INFO (zkCallback-14401-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1988848 INFO (zkCallback-14401-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1988850 INFO (zkCallback-14401-thread-4) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1989110 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1989110 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1989110 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:49896/solr/IndexSizeEstimator_collection_shard2_replica_n4/
[junit4] 2> 1989112 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.u.PeerSync PeerSync: core=IndexSizeEstimator_collection_shard2_replica_n4 url=http://127.0.0.1:49896/solr START replicas=[http://127.0.0.1:49898/solr/IndexSizeEstimator_collection_shard2_replica_n6/] nUpdates=100
[junit4] 2> 1989112 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.u.PeerSync PeerSync: core=IndexSizeEstimator_collection_shard2_replica_n4 url=http://127.0.0.1:49896/solr DONE. We have no versions. sync failed.
[junit4] 2> 1989113 INFO (qtp1841757381-25361) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard2 r:core_node8 x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.c.S.Request [IndexSizeEstimator_collection_shard2_replica_n6] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1989113 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 1989113 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 1989113 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/IndexSizeEstimator_collection/leaders/shard2/leader after winning as /collections/IndexSizeEstimator_collection/leader_elect/shard2/election/72116744567652358-core_node7-n_0000000000
[junit4] 2> 1989120 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:49896/solr/IndexSizeEstimator_collection_shard2_replica_n4/ shard2
[junit4] 2> 1989225 INFO (zkCallback-14401-thread-4) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1989225 INFO (zkCallback-14401-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1989226 INFO (zkCallback-14401-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1989226 INFO (zkCallback-14414-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1989226 INFO (zkCallback-14401-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1989231 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1989237 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=IndexSizeEstimator_collection_shard2_replica_n4&action=CREATE&numShards=2&collection=IndexSizeEstimator_collection&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=919
[junit4] 2> 1989348 INFO (zkCallback-14414-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1989349 INFO (zkCallback-14414-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1989349 INFO (zkCallback-14401-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1989350 INFO (zkCallback-14401-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1989350 INFO (zkCallback-14401-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1989351 INFO (zkCallback-14401-thread-4) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1992349 INFO (qtp1841757381-25358) [n:127.0.0.1:49898_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=IndexSizeEstimator_collection_shard2_replica_n6&action=CREATE&numShards=2&collection=IndexSizeEstimator_collection&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=4031
[junit4] 2> 1992349 INFO (qtp1772466331-25360) [n:127.0.0.1:49896_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=IndexSizeEstimator_collection_shard1_replica_n2&action=CREATE&numShards=2&collection=IndexSizeEstimator_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=4033
[junit4] 2> 1992363 INFO (qtp1772466331-25359) [n:127.0.0.1:49896_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 1992363 INFO (zkCallback-14414-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1992364 INFO (zkCallback-14401-thread-4) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1992364 INFO (zkCallback-14401-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1992364 INFO (zkCallback-14401-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1992364 INFO (zkCallback-14401-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1992364 INFO (zkCallback-14414-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1992505 INFO (zkCallback-14401-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1992505 INFO (zkCallback-14401-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1992506 INFO (zkCallback-14401-thread-4) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1992508 INFO (zkCallback-14414-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1992508 INFO (zkCallback-14414-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1992510 INFO (zkCallback-14401-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/IndexSizeEstimator_collection/state.json] for collection [IndexSizeEstimator_collection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1992516 INFO (qtp1772466331-25359) [n:127.0.0.1:49896_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf&maxShardsPerNode=2&name=IndexSizeEstimator_collection&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2} status=0 QTime=4591
[junit4] 2> 1992517 INFO (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [ ] o.a.s.c.MiniSolrCloudCluster waitForActiveCollection: IndexSizeEstimator_collection
[junit4] 2> 1994287 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/IndexSizeEstimator_collection/terms/shard1 to Terms{values={core_node3=1, core_node5=1}, version=2}
[junit4] 2> 1994302 INFO (qtp1772466331-25359) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [IndexSizeEstimator_collection_shard1_replica_n2] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:49898/solr/IndexSizeEstimator_collection_shard1_replica_n1/&wt=javabin&version=2}{add=[id-0 (1665082869151694848), id-2 (1665082869154840576), id-3 (1665082869155889152), id-4 (1665082869156937728), id-5 (1665082869156937729), id-6 (1665082869156937730), id-8 (1665082869157986304), id-9 (1665082869157986305), id-11 (1665082869157986306), id-12 (1665082869159034880), ... (982 adds)]} 0 1167
[junit4] 2> 1994305 INFO (qtp1841757381-25348) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [IndexSizeEstimator_collection_shard1_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id-0 (1665082869151694848), id-2 (1665082869154840576), id-3 (1665082869155889152), id-4 (1665082869156937728), id-5 (1665082869156937729), id-6 (1665082869156937730), id-8 (1665082869157986304), id-9 (1665082869157986305), id-11 (1665082869157986306), id-12 (1665082869159034880), ... (982 adds)]} 0 1199
[junit4] 2> 1994317 INFO (qtp1772466331-25362) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/IndexSizeEstimator_collection/terms/shard2 to Terms{values={core_node7=1, core_node8=1}, version=2}
[junit4] 2> 1994344 INFO (OverseerCollectionConfigSetProcessor-72116744567652358-127.0.0.1:49896_solr-n_0000000000) [n:127.0.0.1:49896_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1994397 INFO (qtp1841757381-25357) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard2 r:core_node8 x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.u.p.LogUpdateProcessorFactory [IndexSizeEstimator_collection_shard2_replica_n6] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:49896/solr/IndexSizeEstimator_collection_shard2_replica_n4/&wt=javabin&version=2}{add=[id-1 (1665082869149597696), id-7 (1665082869155889152), id-10 (1665082869157986304), id-13 (1665082869159034880), id-15 (1665082869160083456), id-16 (1665082869161132032), id-19 (1665082869162180608), id-20 (1665082869163229184), id-21 (1665082869166374912), id-22 (1665082869166374913), ... (1018 adds)]} 0 1258
[junit4] 2> 1994398 INFO (qtp1772466331-25362) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.u.p.LogUpdateProcessorFactory [IndexSizeEstimator_collection_shard2_replica_n4] webapp=/solr path=/update params={wt=javabin&version=2}{add=[id-1 (1665082869149597696), id-7 (1665082869155889152), id-10 (1665082869157986304), id-13 (1665082869159034880), id-15 (1665082869160083456), id-16 (1665082869161132032), id-19 (1665082869162180608), id-20 (1665082869163229184), id-21 (1665082869166374912), id-22 (1665082869166374913), ... (1018 adds)]} 0 1314
[junit4] 2> 1994402 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1665082870494920704,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 1994403 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@4dce1673 commitCommandVersion:1665082870494920704
[junit4] 2> 1994404 INFO (qtp1841757381-25358) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard2 r:core_node8 x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1665082870497017856,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 1994405 INFO (qtp1841757381-25358) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard2 r:core_node8 x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@164c1f6f commitCommandVersion:1665082870497017856
[junit4] 2> 1994668 INFO (qtp1841757381-25358) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard2 r:core_node8 x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@7caced3f[IndexSizeEstimator_collection_shard2_replica_n6] main]
[junit4] 2> 1994669 INFO (qtp1841757381-25358) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard2 r:core_node8 x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 1994671 INFO (searcherExecutor-14442-thread-1-processing-n:127.0.0.1:49898_solr x:IndexSizeEstimator_collection_shard2_replica_n6 c:IndexSizeEstimator_collection s:shard2 r:core_node8) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard2 r:core_node8 x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.c.SolrCore [IndexSizeEstimator_collection_shard2_replica_n6] Registered new searcher Searcher@7caced3f[IndexSizeEstimator_collection_shard2_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(9.0.0):C1018:[diagnostics={java.version=14, java.vm.version=14+36, lucene.version=9.0.0, source=flush, os.arch=x86_64, java.runtime.version=14+36, os.version=10.14.6, os=Mac OS X, java.vendor=AdoptOpenJDK, timestamp=1587946768537}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] :id=78juwpgpxbbc385wfu37pno0g)))}
[junit4] 2> 1994674 INFO (qtp1841757381-25358) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard2 r:core_node8 x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.u.p.LogUpdateProcessorFactory [IndexSizeEstimator_collection_shard2_replica_n6] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:49896/solr/IndexSizeEstimator_collection_shard2_replica_n4/&commit_end_point=replicas&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 270
[junit4] 2> 1994709 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@11ac44ac[IndexSizeEstimator_collection_shard2_replica_n4] main]
[junit4] 2> 1994709 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 1994711 INFO (searcherExecutor-14440-thread-1-processing-n:127.0.0.1:49896_solr x:IndexSizeEstimator_collection_shard2_replica_n4 c:IndexSizeEstimator_collection s:shard2 r:core_node7) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.c.SolrCore [IndexSizeEstimator_collection_shard2_replica_n4] Registered new searcher Searcher@11ac44ac[IndexSizeEstimator_collection_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(9.0.0):C1018:[diagnostics={java.version=14, java.vm.version=14+36, lucene.version=9.0.0, source=flush, os.arch=x86_64, java.runtime.version=14+36, os.version=10.14.6, os=Mac OS X, java.vendor=AdoptOpenJDK, timestamp=1587946768583}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] :id=78juwpgpxbbc385wfu37pno0j)))}
[junit4] 2> 1994711 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard2 r:core_node7 x:IndexSizeEstimator_collection_shard2_replica_n4 ] o.a.s.u.p.LogUpdateProcessorFactory [IndexSizeEstimator_collection_shard2_replica_n4] webapp=/solr path=/update params={update.distrib=TOLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:49898/solr/IndexSizeEstimator_collection_shard1_replica_n1/&commit_end_point=leaders&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 309
[junit4] 2> 1994713 INFO (qtp1841757381-25361) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1665082870821027840,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 1994713 INFO (qtp1841757381-25361) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@29b668c0 commitCommandVersion:1665082870821027840
[junit4] 2> 1994717 INFO (qtp1772466331-25360) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1665082870824173568,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 1994717 INFO (qtp1772466331-25360) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@35c21bff commitCommandVersion:1665082870824173568
[junit4] 2> 1994814 INFO (qtp1772466331-25360) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@7267aee4[IndexSizeEstimator_collection_shard1_replica_n2] main]
[junit4] 2> 1994816 INFO (qtp1772466331-25360) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 1994818 INFO (searcherExecutor-14446-thread-1-processing-n:127.0.0.1:49896_solr x:IndexSizeEstimator_collection_shard1_replica_n2 c:IndexSizeEstimator_collection s:shard1 r:core_node5) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.c.SolrCore [IndexSizeEstimator_collection_shard1_replica_n2] Registered new searcher Searcher@7267aee4[IndexSizeEstimator_collection_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(9.0.0):C982:[diagnostics={java.version=14, java.vm.version=14+36, lucene.version=9.0.0, source=flush, os.arch=x86_64, java.runtime.version=14+36, os.version=10.14.6, os=Mac OS X, java.vendor=AdoptOpenJDK, timestamp=1587946768671}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] :id=78juwpgpxbbc385wfu37pno0m)))}
[junit4] 2> 1994819 INFO (qtp1772466331-25360) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.u.p.LogUpdateProcessorFactory [IndexSizeEstimator_collection_shard1_replica_n2] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:49898/solr/IndexSizeEstimator_collection_shard1_replica_n1/&commit_end_point=replicas&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 103
[junit4] 2> 1994822 INFO (qtp1841757381-25361) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@4ba74842[IndexSizeEstimator_collection_shard1_replica_n1] main]
[junit4] 2> 1994826 INFO (searcherExecutor-14444-thread-1-processing-n:127.0.0.1:49898_solr x:IndexSizeEstimator_collection_shard1_replica_n1 c:IndexSizeEstimator_collection s:shard1 r:core_node3) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [IndexSizeEstimator_collection_shard1_replica_n1] Registered new searcher Searcher@4ba74842[IndexSizeEstimator_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(9.0.0):C982:[diagnostics={java.version=14, java.vm.version=14+36, lucene.version=9.0.0, source=flush, os.arch=x86_64, java.runtime.version=14+36, os.version=10.14.6, os=Mac OS X, java.vendor=AdoptOpenJDK, timestamp=1587946768682}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] :id=78juwpgpxbbc385wfu37pno0p)))}
[junit4] 2> 1994827 INFO (qtp1841757381-25361) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 1994827 INFO (qtp1841757381-25361) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard1 r:core_node3 x:IndexSizeEstimator_collection_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [IndexSizeEstimator_collection_shard1_replica_n1] webapp=/solr path=/update params={_stateVer_=IndexSizeEstimator_collection:8&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 427
[junit4] 2> 1994837 INFO (qtp1841757381-25358) [n:127.0.0.1:49898_solr c:IndexSizeEstimator_collection s:shard2 r:core_node8 x:IndexSizeEstimator_collection_shard2_replica_n6 ] o.a.s.c.S.Request [IndexSizeEstimator_collection_shard2_replica_n6] webapp=/solr path=/select params={df=text&distrib=false&_stateVer_=IndexSizeEstimator_collection:8&fl=id&fl=score&shards.purpose=16388&start=0&fsv=true&shard.url=http://127.0.0.1:49898/solr/IndexSizeEstimator_collection_shard2_replica_n6/|http://127.0.0.1:49896/solr/IndexSizeEstimator_collection_shard2_replica_n4/&rows=0&version=2&q=*:*&omitHeader=false&NOW=1587946768705&isShard=true&wt=javabin} hits=1018 status=0 QTime=0
[junit4] 2> 1994838 INFO (qtp1772466331-25356) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.c.S.Request [IndexSizeEstimator_collection_shard1_replica_n2] webapp=/solr path=/select params={df=text&distrib=false&_stateVer_=IndexSizeEstimator_collection:8&fl=id&fl=score&shards.purpose=16388&start=0&fsv=true&shard.url=http://127.0.0.1:49896/solr/IndexSizeEstimator_collection_shard1_replica_n2/|http://127.0.0.1:49898/solr/IndexSizeEstimator_collection_shard1_replica_n1/&rows=0&version=2&q=*:*&omitHeader=false&NOW=1587946768705&isShard=true&wt=javabin} hits=982 status=0 QTime=2
[junit4] 2> 1994839 INFO (qtp1772466331-25359) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.c.S.Request [IndexSizeEstimator_collection_shard1_replica_n2] webapp=/solr path=/select params={q=*:*&_stateVer_=IndexSizeEstimator_collection:8&rows=0&wt=javabin&version=2} hits=2000 status=0 QTime=11
[junit4] 2> 1996086 INFO (TEST-IndexSizeEstimatorTest.testEstimator-seed#[9BAB3DFFA7BA3C5D]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testEstimator
[junit4] 2> 1996103 INFO (TEST-IndexSizeEstimatorTest.testEstimator-seed#[9BAB3DFFA7BA3C5D]) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.h.a.IndexSizeEstimator - estimating stored fields...
[junit4] 2> 1996130 INFO (TEST-IndexSizeEstimatorTest.testEstimator-seed#[9BAB3DFFA7BA3C5D]) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.h.a.IndexSizeEstimator - estimating terms...
[junit4] 2> 1996186 INFO (TEST-IndexSizeEstimatorTest.testEstimator-seed#[9BAB3DFFA7BA3C5D]) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.h.a.IndexSizeEstimator - estimating norms...
[junit4] 2> 1996191 INFO (TEST-IndexSizeEstimatorTest.testEstimator-seed#[9BAB3DFFA7BA3C5D]) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.h.a.IndexSizeEstimator - estimating points...
[junit4] 2> 1996191 INFO (TEST-IndexSizeEstimatorTest.testEstimator-seed#[9BAB3DFFA7BA3C5D]) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.h.a.IndexSizeEstimator - estimating term vectors...
[junit4] 2> 1996837 INFO (TEST-IndexSizeEstimatorTest.testEstimator-seed#[9BAB3DFFA7BA3C5D]) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.h.a.IndexSizeEstimator - estimating docValues...
[junit4] 2> 1996892 INFO (TEST-IndexSizeEstimatorTest.testEstimator-seed#[9BAB3DFFA7BA3C5D]) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.h.a.IndexSizeEstimator - preparing summary...
[junit4] 2> 1996944 INFO (TEST-IndexSizeEstimatorTest.testEstimator-seed#[9BAB3DFFA7BA3C5D]) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.h.a.IndexSizeEstimator - estimating stored fields...
[junit4] 2> 1996963 INFO (TEST-IndexSizeEstimatorTest.testEstimator-seed#[9BAB3DFFA7BA3C5D]) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.h.a.IndexSizeEstimator - estimating terms...
[junit4] 2> 1996985 INFO (TEST-IndexSizeEstimatorTest.testEstimator-seed#[9BAB3DFFA7BA3C5D]) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.h.a.IndexSizeEstimator - estimating norms...
[junit4] 2> 1996985 INFO (TEST-IndexSizeEstimatorTest.testEstimator-seed#[9BAB3DFFA7BA3C5D]) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.h.a.IndexSizeEstimator - estimating points...
[junit4] 2> 1996985 INFO (TEST-IndexSizeEstimatorTest.testEstimator-seed#[9BAB3DFFA7BA3C5D]) [n:127.0.0.1:49896_solr c:IndexSizeEstimator_collection s:shard1 r:core_node5 x:IndexSizeEstimator_collection_shard1_replica_n2 ] o.a.s.h.a.IndexSiz
[...truncated too long message...]
.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/collections/IndexSizeEstimator_collection/terms/shard2
[junit4] 2> 7 /solr/collections/IndexSizeEstimator_collection/terms/shard1
[junit4] 2> 3 /solr/aliases.json
[junit4] 2> 3 /solr/clusterprops.json
[junit4] 2> 2 /solr/collections/IndexSizeEstimator_collection/collectionprops.json
[junit4] 2> 2 /solr/packages.json
[junit4] 2> 2 /solr/security.json
[junit4] 2> 2 /solr/configs/conf
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 50 /solr/collections/IndexSizeEstimator_collection/state.json
[junit4] 2> 3 /solr/clusterstate.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 27 /solr/overseer/queue
[junit4] 2> 7 /solr/live_nodes
[junit4] 2> 6 /solr/collections
[junit4] 2> 5 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> 1999892 INFO (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [n:127.0.0.1:49896_solr ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:49887
[junit4] 2> 1999892 INFO (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [n:127.0.0.1:49896_solr ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:49887
[junit4] 2> 1999892 INFO (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [n:127.0.0.1:49896_solr ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 49887
[junit4] 2> 1999893 INFO (SUITE-IndexSizeEstimatorTest-seed#[9BAB3DFFA7BA3C5D]-worker) [n:127.0.0.1:49896_solr ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
[junit4] 2> Apr 27, 2020 12:19:33 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> Apr 27, 2020 12:19:43 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.handler.admin.IndexSizeEstimatorTest:
[junit4] 2> 1) Thread[id=25322, name=SessionTracker, state=TIMED_WAITING, group=TGRP-IndexSizeEstimatorTest]
[junit4] 2> at java.base@14/java.lang.Thread.sleep(Native Method)
[junit4] 2> at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
[junit4] 2> Apr 27, 2020 12:19:43 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=25322, name=SessionTracker, state=TIMED_WAITING, group=TGRP-IndexSizeEstimatorTest]
[junit4] 2> 2010003 ERROR (SessionTracker) [ ] o.a.z.s.ZooKeeperCriticalThread Severe unrecoverable error, from thread : SessionTracker
[junit4] 2> => java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.base/java.lang.Thread.sleep(Native Method)
[junit4] 2> java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method) [?:?]
[junit4] 2> at org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) ~[zookeeper-3.5.7.jar:3.5.7]
[junit4] 2> Apr 27, 2020 12:19:43 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: All leaked threads terminated.
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene84): {long_l=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene84)), long_tl=PostingsFormat(name=MockRandom), string_sI=Lucene84, _version_=FST50, tv_mv_string=Lucene84, _root_=FST50, point_0___double=PostingsFormat(name=MockRandom), multival_long_ll=FST50, id=PostingsFormat(name=MockRandom), point_1___double=Lucene84}, docValues:{long_l=DocValuesFormat(name=Asserting), long_tl=DocValuesFormat(name=Asserting), _version_=DocValuesFormat(name=Lucene80), payload=DocValuesFormat(name=Lucene80), point_0___double=DocValuesFormat(name=Asserting), multival_long_ll=DocValuesFormat(name=Lucene80), point_1___double=DocValuesFormat(name=Lucene80)}, maxPointsInLeafNode=407, maxMBSortInHeap=7.852384713611114, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@583cda4f), locale=ln-CG, timezone=Asia/Jayapura
[junit4] 2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 14 (64-bit)/cpus=6,threads=1,free=163366744,total=498073600
[junit4] 2> NOTE: All tests run in this JVM: [BJQParserTest, OverseerModifyCollectionTest, TestChildDocTransformer, TestMinHashQParser, UUIDFieldTest, TestDocumentBuilder, ScheduledTriggerTest, TestAddFieldRealTimeGet, SynonymTokenizerTest, TestHashQParserPlugin, SolrLogAuditLoggerPluginTest, HLLSerializationTest, TestSimpleTextCodec, TestDistributedStatsComponentCardinality, SOLR749Test, TestPartialUpdateDeduplication, DistributedExpandComponentTest, DistributedQueryElevationComponentTest, TestDelegationWithHadoopAuth, ResponseLogComponentTest, SolrCloudReportersTest, TestFieldTypeCollectionResource, TestObjectReleaseTracker, TestConfigSets, HdfsDirectoryTest, TestSimGenericDistributedQueue, TestComponentsName, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TaggerTest, ReplicationFactorTest, TriggerCooldownIntegrationTest, HdfsAutoAddReplicasIntegrationTest, TestExportWriter, TestHashPartitioner, InfixSuggestersTest, TestIBSimilarityFactory, ResolveAnalyzerByNameTest, TestSolrXml, SaslZkACLProviderTest, TestZkChroot, PreAnalyzedUpdateProcessorTest, TestLegacyFieldCache, TestCollectionsAPIViaSolrCloudCluster, AuditLoggerPluginTest, SpellCheckCollatorWithCollapseTest, TestUnifiedSolrHighlighterWithoutStoredId, TestCodecSupport, TestSimComputePlanAction, TestCrossCoreJoin, PeerSyncWithLeaderTest, SimpleFacetsTest, TestAnalyzedSuggestions, TestCollationField, TestRemoteStreaming, DistributedFacetPivotSmallTest, SystemCollectionCompatTest, ConvertedLegacyTest, TestManagedSchemaThreadSafety, TestInfoStreamLogging, TestDistribIDF, BasicDistributedZkTest, NestedShardedAtomicUpdateTest, TestSimScenario, SpatialHeatmapFacetsTest, DirectSolrConnectionTest, AlternateDirectoryTest, VersionInfoTest, CopyFieldTest, JsonLoaderTest, TestReplicationHandler, HdfsRestartWhileUpdatingTest, CollectionsAPIAsyncDistributedZkTest, JvmMetricsTest, OverseerTaskQueueTest, TestSizeLimitedDistributedMap, DistributedVersionInfoTest, TestSolrCachePerf, TestRebalanceLeaders, MetricTriggerIntegrationTest, TestScoreJoinQPScore, TestDownShardTolerantSearch, AutoAddReplicasIntegrationTest, SuggestComponentContextFilterQueryTest, TestDistribPackageStore, TestTolerantUpdateProcessorCloud, TestStressCloudBlindAtomicUpdates, TestDirectoryFactory, LeaderElectionContextKeyTest, LeaderElectionIntegrationTest, LeaderTragicEventTest, LeaderVoteWaitTimeoutTest, PeerSyncReplicationTest, TestCloudDeleteByQuery, TestCloudPseudoReturnFields, TestCloudRecovery2, TestConfigSetsAPIExclusivity, TestLeaderElectionZkExpiry, TestPullReplica, TestPullReplicaErrorHandling, VMParamsZkACLAndCredentialsProvidersTest, ZkCLITest, NodeAddedTriggerTest, SearchRateTriggerTest, CdcrWithNodesRestartsTest, HDFSCollectionsAPITest, ZkStateWriterTest, PluginInfoTest, QueryResultKeyTest, TestLazyCores, TestRestoreCore, TestSolrConfigHandlerConcurrent, V2ApiIntegrationTest, XmlUpdateRequestHandlerTest, XsltUpdateRequestHandlerTest, AdminHandlersProxyTest, CoreAdminCreateDiscoverTest, CoreAdminHandlerTest, CoreAdminOperationTest, CoreAdminRequestStatusTest, CoreMergeIndexesAdminHandlerTest, DaemonStreamApiTest, HealthCheckHandlerTest, IndexSizeEstimatorTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=IndexSizeEstimatorTest -Dtests.seed=9BAB3DFFA7BA3C5D -Dtests.slow=true -Dtests.locale=ln-CG -Dtests.timezone=Asia/Jayapura -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J2 | IndexSizeEstimatorTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.handler.admin.IndexSizeEstimatorTest:
[junit4] > 1) Thread[id=25322, name=SessionTracker, state=TIMED_WAITING, group=TGRP-IndexSizeEstimatorTest]
[junit4] > at java.base@14/java.lang.Thread.sleep(Native Method)
[junit4] > at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
[junit4] > at __randomizedtesting.SeedInfo.seed([9BAB3DFFA7BA3C5D]:0)
[junit4] Completed [656/909 (1!)] on J2 in 23.40s, 2 tests, 1 error <<< FAILURES!
[...truncated 45651 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/5926/consoleText
[repro] Revision: ce18505e288edf1e213c283e5d5944ab400269e2
[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseG1GC"
[repro] Repro line: ant test -Dtestcase=IndexSizeEstimatorTest -Dtests.seed=9BAB3DFFA7BA3C5D -Dtests.slow=true -Dtests.locale=ln-CG -Dtests.timezone=Asia/Jayapura -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] IndexSizeEstimatorTest
[repro] ant compile-test
[...truncated 3152 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.IndexSizeEstimatorTest" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseG1GC" -Dtests.seed=9BAB3DFFA7BA3C5D -Dtests.slow=true -Dtests.locale=ln-CG -Dtests.timezone=Asia/Jayapura -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[...truncated 86 lines...]
[repro] Failures w/original seeds:
[repro] 0/5 failed: org.apache.solr.handler.admin.IndexSizeEstimatorTest
[repro] Exiting with code 0
[...truncated 73 lines...]
[JENKINS-Experimental-GC] Lucene-Solr-master-MacOSX (64bit/jdk-14)
- Build # 5930 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/5930/
Java: 64bit/jdk-14 -XX:+UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseZGC
1 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.handler.admin.HealthCheckHandlerTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.handler.admin.HealthCheckHandlerTest: 1) Thread[id=9371, name=SessionTracker, state=TIMED_WAITING, group=TGRP-HealthCheckHandlerTest] at java.base@14/java.lang.Thread.sleep(Native Method) at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.handler.admin.HealthCheckHandlerTest:
1) Thread[id=9371, name=SessionTracker, state=TIMED_WAITING, group=TGRP-HealthCheckHandlerTest]
at java.base@14/java.lang.Thread.sleep(Native Method)
at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
at __randomizedtesting.SeedInfo.seed([1547C6058126E8E4]:0)
Build Log:
[...truncated 13856 lines...]
[junit4] Suite: org.apache.solr.handler.admin.HealthCheckHandlerTest
[junit4] 2> 742540 INFO (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/server/solr/configsets/_default/conf'
[junit4] 2> 742540 INFO (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 742541 INFO (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.handler.admin.HealthCheckHandlerTest_1547C6058126E8E4-001/data-dir-73-001
[junit4] 2> 742541 WARN (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
[junit4] 2> 742541 INFO (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 742542 INFO (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 742543 INFO (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.handler.admin.HealthCheckHandlerTest_1547C6058126E8E4-001/tempDir-001
[junit4] 2> 742544 INFO (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 742545 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 742545 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 742656 INFO (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:60804
[junit4] 2> 742656 INFO (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:60804
[junit4] 2> 742656 INFO (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:60804
[junit4] 2> 742656 INFO (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 60804
[junit4] 2> 742667 INFO (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 742677 INFO (zkConnectionManagerCallback-6230-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 742677 INFO (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 742689 INFO (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 742711 INFO (zkConnectionManagerCallback-6232-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 742711 INFO (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 742715 INFO (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 742720 INFO (zkConnectionManagerCallback-6234-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 742722 INFO (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 742873 INFO (jetty-launcher-6235-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 742873 INFO (jetty-launcher-6235-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 742873 INFO (jetty-launcher-6235-thread-1) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14+36
[junit4] 2> 742876 INFO (jetty-launcher-6235-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 742876 INFO (jetty-launcher-6235-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 742877 INFO (jetty-launcher-6235-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 742877 INFO (jetty-launcher-6235-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@fe69d78{/solr,null,AVAILABLE}
[junit4] 2> 742879 INFO (jetty-launcher-6235-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@68d7e845{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:60810}
[junit4] 2> 742879 INFO (jetty-launcher-6235-thread-1) [ ] o.e.j.s.Server Started @742982ms
[junit4] 2> 742879 INFO (jetty-launcher-6235-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=60810}
[junit4] 2> 742879 ERROR (jetty-launcher-6235-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 742879 INFO (jetty-launcher-6235-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 742879 INFO (jetty-launcher-6235-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 742879 INFO (jetty-launcher-6235-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 742879 INFO (jetty-launcher-6235-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 742879 INFO (jetty-launcher-6235-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-04-27T21:07:15.004732Z
[junit4] 2> 742880 INFO (jetty-launcher-6235-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 742885 INFO (zkConnectionManagerCallback-6237-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 742885 INFO (jetty-launcher-6235-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 742888 INFO (jetty-launcher-6235-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 743008 INFO (jetty-launcher-6235-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 743018 WARN (jetty-launcher-6235-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@2a8af68[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 743018 WARN (jetty-launcher-6235-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@2a8af68[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 743029 WARN (jetty-launcher-6235-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@1f0b57dc[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 743029 WARN (jetty-launcher-6235-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@1f0b57dc[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 743030 INFO (jetty-launcher-6235-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60804/solr
[junit4] 2> 743037 INFO (jetty-launcher-6235-thread-1) [n:127.0.0.1:60810_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 743042 INFO (zkConnectionManagerCallback-6248-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 743047 INFO (jetty-launcher-6235-thread-1) [n:127.0.0.1:60810_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 744918 INFO (jetty-launcher-6235-thread-1) [n:127.0.0.1:60810_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:60810_solr
[junit4] 2> 744946 INFO (jetty-launcher-6235-thread-1) [n:127.0.0.1:60810_solr ] o.a.s.c.Overseer Overseer (id=72121651518636036-127.0.0.1:60810_solr-n_0000000000) starting
[junit4] 2> 745100 INFO (OverseerStateUpdate-72121651518636036-127.0.0.1:60810_solr-n_0000000000) [n:127.0.0.1:60810_solr ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:60810_solr
[junit4] 2> 745111 INFO (jetty-launcher-6235-thread-1) [n:127.0.0.1:60810_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60810_solr
[junit4] 2> 745127 INFO (zkCallback-6247-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 745158 INFO (jetty-launcher-6235-thread-1) [n:127.0.0.1:60810_solr ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 745159 WARN (jetty-launcher-6235-thread-1) [n:127.0.0.1:60810_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=you make it. Consider configuring authentication/authorization before exposing Solr to users internal or authorization=external. See https://s.apache.org/solrsecurity for more info. Solr is only as secure as disableddisabled
[junit4] 2> 745209 INFO (jetty-launcher-6235-thread-1) [n:127.0.0.1:60810_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 745251 INFO (jetty-launcher-6235-thread-1) [n:127.0.0.1:60810_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60810.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6a5b360d
[junit4] 2> 745257 INFO (jetty-launcher-6235-thread-1) [n:127.0.0.1:60810_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60810.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6a5b360d
[junit4] 2> 745257 INFO (jetty-launcher-6235-thread-1) [n:127.0.0.1:60810_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60810.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6a5b360d
[junit4] 2> 745258 INFO (jetty-launcher-6235-thread-1) [n:127.0.0.1:60810_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.handler.admin.HealthCheckHandlerTest_1547C6058126E8E4-001/tempDir-001/node1/.
[junit4] 2> 745283 INFO (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=1
[junit4] 2> 745286 INFO (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 745296 INFO (zkConnectionManagerCallback-6265-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 745296 INFO (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 745337 INFO (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 745380 INFO (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:60804/solr ready
[junit4] 2> 745577 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testHealthCheckV2Api
[junit4] 2> 745585 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/node/health params={wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 745592 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 745592 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 745593 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14+36
[junit4] 2> 745614 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 745614 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 745614 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 745616 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5f4728e{/solr,null,AVAILABLE}
[junit4] 2> 745621 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4a4c9629{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:60820}
[junit4] 2> 745621 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.e.j.s.Server Started @745724ms
[junit4] 2> 745621 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=60820}
[junit4] 2> 745621 ERROR (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 745621 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 745621 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 745621 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 745621 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 745621 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-04-27T21:07:17.746772Z
[junit4] 2> 745623 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 745647 INFO (zkConnectionManagerCallback-6267-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 745649 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 745660 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 745809 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 745812 WARN (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@2a0cf894[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 745812 WARN (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@2a0cf894[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 745816 WARN (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@d684510[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 745816 WARN (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@d684510[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 745817 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60804/solr
[junit4] 2> 745826 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [n:127.0.0.1:60820_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 745827 INFO (zkConnectionManagerCallback-6278-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 745835 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [n:127.0.0.1:60820_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 745993 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [n:127.0.0.1:60820_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 746089 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [n:127.0.0.1:60820_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:60820_solr as DOWN
[junit4] 2> 746106 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [n:127.0.0.1:60820_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 1000 transient cores
[junit4] 2> 746107 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [n:127.0.0.1:60820_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60820_solr
[junit4] 2> 746118 INFO (zkCallback-6247-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 746121 INFO (zkCallback-6264-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 746124 INFO (zkCallback-6277-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 746185 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [n:127.0.0.1:60820_solr ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 746186 WARN (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [n:127.0.0.1:60820_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=you make it. Consider configuring authentication/authorization before exposing Solr to users internal or authorization=external. See https://s.apache.org/solrsecurity for more info. Solr is only as secure as disableddisabled
[junit4] 2> 746216 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [n:127.0.0.1:60820_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 746310 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [n:127.0.0.1:60820_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60820.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6a5b360d
[junit4] 2> 746333 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [n:127.0.0.1:60820_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60820.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6a5b360d
[junit4] 2> 746333 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [n:127.0.0.1:60820_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60820.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6a5b360d
[junit4] 2> 746336 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [n:127.0.0.1:60820_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.handler.admin.HealthCheckHandlerTest_1547C6058126E8E4-001/tempDir-001/node2/.
[junit4] 2> 746374 INFO (qtp107943516-9437) [n:127.0.0.1:60820_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/node/health params={wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 746497 INFO (zkCallback-6247-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 746497 INFO (zkCallback-6264-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 746499 INFO (qtp107943516-9438) [n:127.0.0.1:60820_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/node/health params={wt=javabin&version=2} status=503 QTime=0
[junit4] 2> 746503 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1013063292
[junit4] 2> 746503 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:60820_solr
[junit4] 2> 746504 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.c.ZkController Publish this node as DOWN...
[junit4] 2> 746504 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.c.ZkController Publish node=127.0.0.1:60820_solr as DOWN
[junit4] 2> 746504 WARN (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.c.ZkController Error publishing nodes as down. Continuing to close CoreContainer
[junit4] 2> => org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue
[junit4] 2> at org.apache.solr.cloud.ZkDistributedQueue.<init>(ZkDistributedQueue.java:129)
[junit4] 2> org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue
[junit4] 2> at org.apache.solr.cloud.ZkDistributedQueue.<init>(ZkDistributedQueue.java:129) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.Overseer.getStateUpdateQueue(Overseer.java:834) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.Overseer.getStateUpdateQueue(Overseer.java:822) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.ZkController.publishNodeAsDown(ZkController.java:2647) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.ZkController.preClose(ZkController.java:608) ~[java/:?]
[junit4] 2> at org.apache.solr.core.CoreContainer.shutdown(CoreContainer.java:947) ~[java/:?]
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.close(SolrDispatchFilter.java:354) ~[java/:?]
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner.stop(JettySolrRunner.java:631) ~[java/:?]
[junit4] 2> at org.apache.solr.handler.admin.HealthCheckHandlerTest.testHealthCheckV2Api(HealthCheckHandlerTest.java:186) ~[test/:?]
[junit4] 2> at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
[junit4] 2> at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
[junit4] 2> at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:564) ~[?:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) ~[java/:?]
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) ~[java/:?]
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) ~[java/:?]
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) ~[java/:?]
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) ~[java/:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) ~[java/:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) ~[java/:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) ~[java/:?]
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) ~[java/:?]
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) ~[java/:?]
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) ~[java/:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at java.lang.Thread.run(Thread.java:832) [?:?]
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.5.7.jar:3.5.7]
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.7.jar:3.5.7]
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:2021) ~[zookeeper-3.5.7.jar:3.5.7]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$exists$3(SolrZkClient.java:315) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:315) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:108) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:93) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.ZkDistributedQueue.<init>(ZkDistributedQueue.java:127) ~[java/:?]
[junit4] 2> ... 47 more
[junit4] 2> 746519 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
[junit4] 2> 746519 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5d1a341: rootName = solr_60820, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@cd017db
[junit4] 2> 746526 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
[junit4] 2> 746526 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7f87b6e8: rootName = solr_60820, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@1c77354a
[junit4] 2> 746542 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
[junit4] 2> 746542 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2fb0dae8: rootName = solr_60820, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@534da57f
[junit4] 2> 746542 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
[junit4] 2> 746593 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@4a4c9629{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
[junit4] 2> 746593 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5f4728e{/solr,null,UNAVAILABLE}
[junit4] 2> 746593 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 746622 INFO (TEST-HealthCheckHandlerTest.testHealthCheckV2Api-seed#[1547C6058126E8E4]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testHealthCheckV2Api
[junit4] 2> 747037 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testHealthCheckHandler
[junit4] 2> 747038 INFO (qtp1712331511-9402) [n:127.0.0.1:60810_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/health params={wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 747055 INFO (qtp1712331511-9400) [n:127.0.0.1:60810_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/health params={wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 747067 INFO (qtp1712331511-9400) [n:127.0.0.1:60810_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=_default&name=test&nrtReplicas=1&action=CREATE&numShards=1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 747100 INFO (OverseerThreadFactory-6255-thread-1-processing-n:127.0.0.1:60810_solr) [n:127.0.0.1:60810_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection test
[junit4] 2> 747286 INFO (qtp1712331511-9402) [n:127.0.0.1:60810_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 747307 INFO (qtp1712331511-9403) [n:127.0.0.1:60810_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
[junit4] 2> 747392 INFO (OverseerStateUpdate-72121651518636036-127.0.0.1:60810_solr-n_0000000000) [n:127.0.0.1:60810_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"test",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"test_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:60810/solr",
[junit4] 2> "node_name":"127.0.0.1:60810_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 747627 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr x:test_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=_default&newCollection=true&collection=test&version=2&replicaType=NRT&coreNodeName=core_node2&name=test_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin
[junit4] 2> 747628 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr x:test_shard1_replica_n1 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 1000 transient cores
[junit4] 2> 747725 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 747780 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=default-config
[junit4] 2> 749302 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema default-config/1.6 with uniqueid field id
[junit4] 2> 749302 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'test_shard1_replica_n1' using configuration from configset _default, trusted=true
[junit4] 2> 749303 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60810.solr.core.test.shard1.replica_n1' (registry 'solr.core.test.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6a5b360d
[junit4] 2> 749303 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.c.SolrCore [[test_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.handler.admin.HealthCheckHandlerTest_1547C6058126E8E4-001/tempDir-001/node1/./test_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.handler.admin.HealthCheckHandlerTest_1547C6058126E8E4-001/tempDir-001/node1/./test_shard1_replica_n1/data/]
[junit4] 2> 749579 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 749579 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 749581 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: if uncommitted for 15000ms;
[junit4] 2> 749581 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 749584 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@36a551df[test_shard1_replica_n1] main]
[junit4] 2> 749608 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/_default
[junit4] 2> 749611 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/_default
[junit4] 2> 749613 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/_default/managed-schema
[junit4] 2> 749628 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 749634 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 749634 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.s.DirectSolrSpellChecker init: {name=default, field=_text_, classname=solr.DirectSolrSpellChecker, distanceMeasure=internal, accuracy=0.5, maxEdits=2, minPrefix=1, maxInspections=5, minQueryLength=4, maxQueryFrequency=0.01}
[junit4] 2> 749635 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 749635 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1665161381030133760
[junit4] 2> 749648 INFO (searcherExecutor-6293-thread-1-processing-n:127.0.0.1:60810_solr x:test_shard1_replica_n1 c:test s:shard1 r:core_node2) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.c.QuerySenderListener QuerySenderListener sending requests to Searcher@36a551df[test_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 749649 INFO (searcherExecutor-6293-thread-1-processing-n:127.0.0.1:60810_solr x:test_shard1_replica_n1 c:test s:shard1 r:core_node2) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.c.QuerySenderListener QuerySenderListener done.
[junit4] 2> 749649 INFO (searcherExecutor-6293-thread-1-processing-n:127.0.0.1:60810_solr x:test_shard1_replica_n1 c:test s:shard1 r:core_node2) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 749651 INFO (searcherExecutor-6293-thread-1-processing-n:127.0.0.1:60810_solr x:test_shard1_replica_n1 c:test s:shard1 r:core_node2) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.c.SolrCore [test_shard1_replica_n1] Registered new searcher Searcher@36a551df[test_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 749726 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/test/terms/shard1 to Terms{values={core_node2=0}, version=0}
[junit4] 2> 749726 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/test/leaders/shard1
[junit4] 2> 749830 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 749830 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 749830 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:60810/solr/test_shard1_replica_n1/
[junit4] 2> 749841 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 749844 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.c.SyncStrategy http://127.0.0.1:60810/solr/test_shard1_replica_n1/ has no replicas
[junit4] 2> 749844 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/test/leaders/shard1/leader after winning as /collections/test/leader_elect/shard1/election/72121651518636036-core_node2-n_0000000000
[junit4] 2> 749904 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:60810/solr/test_shard1_replica_n1/ shard1
[junit4] 2> 749915 INFO (zkCallback-6247-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test/state.json] for collection [test] has occurred - updating... (live nodes size: [1])
[junit4] 2> 749915 INFO (zkCallback-6247-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test/state.json] for collection [test] has occurred - updating... (live nodes size: [1])
[junit4] 2> 749922 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr c:test s:shard1 r:core_node2 x:test_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 749960 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=_default&newCollection=true&collection=test&version=2&replicaType=NRT&coreNodeName=core_node2&name=test_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin} status=0 QTime=2337
[junit4] 2> 749983 INFO (qtp1712331511-9400) [n:127.0.0.1:60810_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 750086 INFO (zkCallback-6247-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test/state.json] for collection [test] has occurred - updating... (live nodes size: [1])
[junit4] 2> 750087 INFO (zkCallback-6247-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test/state.json] for collection [test] has occurred - updating... (live nodes size: [1])
[junit4] 2> 750087 INFO (zkCallback-6247-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test/state.json] for collection [test] has occurred - updating... (live nodes size: [1])
[junit4] 2> 750100 INFO (qtp1712331511-9400) [n:127.0.0.1:60810_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=_default&name=test&nrtReplicas=1&action=CREATE&numShards=1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin&version=2} status=0 QTime=3033
[junit4] 2> 750102 INFO (qtp1712331511-9402) [n:127.0.0.1:60810_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/health params={wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 750125 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 750154 INFO (qtp1712331511-9400) [n:127.0.0.1:60810_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=test&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 750241 INFO (OverseerCollectionConfigSetProcessor-72121651518636036-127.0.0.1:60810_solr-n_0000000000) [n:127.0.0.1:60810_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 750244 INFO (OverseerThreadFactory-6255-thread-2-processing-n:127.0.0.1:60810_solr) [n:127.0.0.1:60810_solr ] o.a.s.c.a.c.OverseerCollectionMessageHandler Executing Collection Cmd=action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true&deleteMetricsHistory=true, asyncId=null
[junit4] 2> 750246 INFO (qtp1712331511-9402) [n:127.0.0.1:60810_solr x:test_shard1_replica_n1 ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.test.shard1.replica_n1 tag=null
[junit4] 2> 750246 INFO (qtp1712331511-9402) [n:127.0.0.1:60810_solr x:test_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6e50497: rootName = solr_60810, domain = solr.core.test.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.test.shard1.replica_n1/com.codahale.metrics.MetricRegistry@3ebf7aea
[junit4] 2> 750265 INFO (qtp1712331511-9402) [n:127.0.0.1:60810_solr ] o.a.s.c.SolrCore [test_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@28d8de3d
[junit4] 2> 750265 INFO (qtp1712331511-9402) [n:127.0.0.1:60810_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.test.shard1.replica_n1 tag=SolrCore@28d8de3d
[junit4] 2> 750265 INFO (qtp1712331511-9402) [n:127.0.0.1:60810_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.test.shard1.leader tag=SolrCore@28d8de3d
[junit4] 2> 750265 INFO (qtp1712331511-9402) [n:127.0.0.1:60810_solr ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close() ... SKIPPED (unnecessary).
[junit4] 2> 750279 INFO (qtp1712331511-9402) [n:127.0.0.1:60810_solr ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/test/terms/shard1 to Terms{values={}, version=1}
[junit4] 2> 750297 INFO (qtp1712331511-9402) [n:127.0.0.1:60810_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&deleteMetricsHistory=true&core=test_shard1_replica_n1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=51
[junit4] 2> 750490 INFO (zkCallback-6247-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDeleted path:/collections/test/state.json] for collection [test] has occurred - updating... (live nodes size: [1])
[junit4] 2> 750490 INFO (zkCallback-6247-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDeleted path:/collections/test/state.json] for collection [test] has occurred - updating... (live nodes size: [1])
[junit4] 2> 750491 INFO (zkCallback-6247-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDeleted path:/collections/test/state.json] for collection [test] has occurred - updating... (live nodes size: [1])
[junit4] 2> 750696 INFO (qtp1712331511-9400) [n:127.0.0.1:60810_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=test&action=DELETE&wt=javabin&version=2} status=0 QTime=542
[junit4] 2> 750701 INFO (qtp1712331511-9403) [n:127.0.0.1:60810_solr ] o.a.s.h.a.ConfigSetsHandler Invoked ConfigSet Action :list with params action=LIST&wt=javabin&version=2
[junit4] 2> 750707 INFO (qtp1712331511-9403) [n:127.0.0.1:60810_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/configs params={action=LIST&wt=javabin&version=2} status=0 QTime=7
[junit4] 2> 750711 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr ] o.a.s.h.a.ConfigSetsHandler Invoked ConfigSet Action :delete with params name=conf&action=DELETE&wt=javabin&version=2
[junit4] 2> 750766 INFO (OverseerThreadFactory-6255-thread-3-processing-n:127.0.0.1:60810_solr) [n:127.0.0.1:60810_solr ] o.a.s.c.OverseerConfigSetMessageHandler OverseerConfigSetMessageHandler.processMessage : delete, {
[junit4] 2> "name":"conf",
[junit4] 2> "operation":"configsets:delete"}
[junit4] 2> 750778 INFO (OverseerCollectionConfigSetProcessor-72121651518636036-127.0.0.1:60810_solr-n_0000000000) [n:127.0.0.1:60810_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 750782 INFO (OverseerThreadFactory-6255-thread-3-processing-n:127.0.0.1:60810_solr) [n:127.0.0.1:60810_solr ] o.a.s.c.OverseerConfigSetMessageHandler no existing ConfigSet properties found
[junit4] 2> 750831 INFO (qtp1712331511-9401) [n:127.0.0.1:60810_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/configs params={name=conf&action=DELETE&wt=javabin&version=2} status=0 QTime=120
[junit4] 2> 750832 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 750832 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 750832 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14+36
[junit4] 2> 750836 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 750836 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 750836 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 750837 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4e3adfe0{/solr,null,AVAILABLE}
[junit4] 2> 750839 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7d867f70{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:60861}
[junit4] 2> 750839 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.e.j.s.Server Started @750943ms
[junit4] 2> 750839 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=60861}
[junit4] 2> 750841 ERROR (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 750841 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 750841 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 750841 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 750841 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 750841 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-04-27T21:07:22.966216Z
[junit4] 2> 750844 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 750856 INFO (zkConnectionManagerCallback-6301-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 750857 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 750859 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 750994 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 751002 WARN (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@32f7022b[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 751002 WARN (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@32f7022b[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 751014 WARN (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@414fbe29[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 751014 WARN (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@414fbe29[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 751018 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60804/solr
[junit4] 2> 751022 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [n:127.0.0.1:60861_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 751035 INFO (zkConnectionManagerCallback-6312-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 751035 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [n:127.0.0.1:60861_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 751214 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [n:127.0.0.1:60861_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 751275 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [n:127.0.0.1:60861_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:60861_solr as DOWN
[junit4] 2> 751317 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [n:127.0.0.1:60861_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 1000 transient cores
[junit4] 2> 751317 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [n:127.0.0.1:60861_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60861_solr
[junit4] 2> 751329 INFO (zkCallback-6264-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 751329 INFO (zkCallback-6311-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 751329 INFO (zkCallback-6264-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 751329 INFO (zkCallback-6247-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 751399 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [n:127.0.0.1:60861_solr ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 751401 WARN (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [n:127.0.0.1:60861_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=you make it. Consider configuring authentication/authorization before exposing Solr to users internal or authorization=external. See https://s.apache.org/solrsecurity for more info. Solr is only as secure as disableddisabled
[junit4] 2> 751428 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [n:127.0.0.1:60861_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 751456 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [n:127.0.0.1:60861_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60861.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6a5b360d
[junit4] 2> 751468 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [n:127.0.0.1:60861_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60861.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6a5b360d
[junit4] 2> 751468 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [n:127.0.0.1:60861_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60861.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6a5b360d
[junit4] 2> 751469 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [n:127.0.0.1:60861_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.handler.admin.HealthCheckHandlerTest_1547C6058126E8E4-001/tempDir-001/node3/.
[junit4] 2> 751483 INFO (qtp282402375-9486) [n:127.0.0.1:60861_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/health params={wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 751494 INFO (zkCallback-6247-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 751494 INFO (zkCallback-6264-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 751495 INFO (zkCallback-6264-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 751596 INFO (qtp282402375-9488) [n:127.0.0.1:60861_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/health params={wt=javabin&version=2} status=503 QTime=0
[junit4] 2> 751614 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=412487688
[junit4] 2> 751614 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:60861_solr
[junit4] 2> 751615 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.c.ZkController Publish this node as DOWN...
[junit4] 2> 751615 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.c.ZkController Publish node=127.0.0.1:60861_solr as DOWN
[junit4] 2> 751615 WARN (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.c.ZkController Error publishing nodes as down. Continuing to close CoreContainer
[junit4] 2> => org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue
[junit4] 2> at org.apache.solr.cloud.ZkDistributedQueue.<init>(ZkDistributedQueue.java:129)
[junit4] 2> org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue
[junit4] 2> at org.apache.solr.cloud.ZkDistributedQueue.<init>(ZkDistributedQueue.java:129) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.Overseer.getStateUpdateQueue(Overseer.java:834) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.Overseer.getStateUpdateQueue(Overseer.java:822) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.ZkController.publishNodeAsDown(ZkController.java:2647) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.ZkController.preClose(ZkController.java:608) ~[java/:?]
[junit4] 2> at org.apache.solr.core.CoreContainer.shutdown(CoreContainer.java:947) ~[java/:?]
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.close(SolrDispatchFilter.java:354) ~[java/:?]
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner.stop(JettySolrRunner.java:631) ~[java/:?]
[junit4] 2> at org.apache.solr.handler.admin.HealthCheckHandlerTest.testHealthCheckHandler(HealthCheckHandlerTest.java:109) ~[test/:?]
[junit4] 2> at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
[junit4] 2> at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
[junit4] 2> at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:564) ~[?:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) ~[java/:?]
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) ~[java/:?]
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) ~[java/:?]
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) ~[java/:?]
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) ~[java/:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) ~[java/:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) ~[java/:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) ~[java/:?]
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) ~[java/:?]
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) ~[java/:?]
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) ~[java/:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826) ~[randomizedtesting-runner-2.7.6.jar:?]
[junit4] 2> at java.lang.Thread.run(Thread.java:832) [?:?]
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.5.7.jar:3.5.7]
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.5.7.jar:3.5.7]
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:2021) ~[zookeeper-3.5.7.jar:3.5.7]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$exists$3(SolrZkClient.java:315) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:315) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:108) ~[java/:?]
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:93) ~[java/:?]
[junit4] 2> at org.apache.solr.cloud.ZkDistributedQueue.<init>(ZkDistributedQueue.java:127) ~[java/:?]
[junit4] 2> ... 47 more
[junit4] 2> 751622 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
[junit4] 2> 751622 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3df5a94e: rootName = solr_60861, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@52b419ce
[junit4] 2> 751640 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
[junit4] 2> 751641 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@18a42c68: rootName = solr_60861, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@1c77354a
[junit4] 2> 751643 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
[junit4] 2> 751643 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@34856ac6: rootName = solr_60861, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@534da57f
[junit4] 2> 751643 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
[junit4] 2> 751690 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@7d867f70{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
[junit4] 2> 751691 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4e3adfe0{/solr,null,UNAVAILABLE}
[junit4] 2> 751691 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 751696 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 751696 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 751696 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14+36
[junit4] 2> 751759 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 751759 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 751759 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 751760 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@452dbc8a{/solr,null,AVAILABLE}
[junit4] 2> 751763 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@323f7541{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:60867}
[junit4] 2> 751763 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.e.j.s.Server Started @751867ms
[junit4] 2> 751763 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=60867}
[junit4] 2> 751764 ERROR (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 751764 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 751764 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 751764 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 751764 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 751764 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-04-27T21:07:23.889393Z
[junit4] 2> 751766 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 751772 INFO (zkConnectionManagerCallback-6327-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 751775 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 751778 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 751910 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 751923 WARN (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@37f1806e[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 751923 WARN (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@37f1806e[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 751938 WARN (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@66d605ed[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 751938 WARN (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@66d605ed[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 751939 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60804/solr
[junit4] 2> 751956 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [n:127.0.0.1:60867_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 751959 INFO (zkConnectionManagerCallback-6338-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 751959 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [n:127.0.0.1:60867_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 752031 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [n:127.0.0.1:60867_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 752087 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [n:127.0.0.1:60867_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:60867_solr as DOWN
[junit4] 2> 752100 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [n:127.0.0.1:60867_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 1000 transient cores
[junit4] 2> 752100 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [n:127.0.0.1:60867_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60867_solr
[junit4] 2> 752113 INFO (zkCallback-6247-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 752114 INFO (zkCallback-6264-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 752116 INFO (zkCallback-6264-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 752117 INFO (zkCallback-6337-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 752185 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [n:127.0.0.1:60867_solr ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 752185 WARN (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [n:127.0.0.1:60867_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=you make it. Consider configuring authentication/authorization before exposing Solr to users internal or authorization=external. See https://s.apache.org/solrsecurity for more info. Solr is only as secure as disableddisabled
[junit4] 2> 752237 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [n:127.0.0.1:60867_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 752283 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [n:127.0.0.1:60867_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60867.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6a5b360d
[junit4] 2> 752297 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [n:127.0.0.1:60867_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60867.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6a5b360d
[junit4] 2> 752297 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [n:127.0.0.1:60867_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60867.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6a5b360d
[junit4] 2> 752301 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [n:127.0.0.1:60867_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.handler.admin.HealthCheckHandlerTest_1547C6058126E8E4-001/tempDir-001/node4/.
[junit4] 2> 752317 INFO (qtp710424805-9519) [n:127.0.0.1:60867_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/info/health params={wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 752317 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1494557617
[junit4] 2> 752318 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:60867_solr
[junit4] 2> 752319 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.c.ZkController Publish this node as DOWN...
[junit4] 2> 752319 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.c.ZkController Publish node=127.0.0.1:60867_solr as DOWN
[junit4] 2> 752341 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
[junit4] 2> 752342 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@a22ad34: rootName = solr_60867, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@5bd2a4f1
[junit4] 2> 752371 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
[junit4] 2> 752371 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@20c85504: rootName = solr_60867, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@1c77354a
[junit4] 2> 752374 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
[junit4] 2> 752375 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@48260ba1: rootName = solr_60867, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@534da57f
[junit4] 2> 752375 INFO (TEST-HealthCheckHandlerTest.testHealthCheckHandler-seed#[1547C6058126E8E4]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
[junit4] 2> 752513 INFO (zkCallback-6264-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 752513 INFO (zkCallback-6264-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 752515 INFO (zkCallback-6247-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 752518 ERROR (qtp710424805-9520) [ ] o.a.s.s.SolrDispatchFilter Error processing the request. CoreContainer is either not initialized or shutting down.
[junit4] 2> 752519 WARN (qtp710424805-9520) [ ] o.e.j.s.HttpChannel /solr/admin/info/health
[junit4] 2> => javax.servlet.UnavailableException: Error processing the request. CoreContainer is either not initialized or shutting down.
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:381)
[junit4] 2> javax.servlet.UnavailableException: Error processing the request. CoreContainer is either not initialized or shutting down.
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:381) ~[java/:?]
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:362) ~[java/:?]
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java
[...truncated too long message...]
rs for registry=solr.jetty tag=null
[junit4] 2> 754380 INFO (jetty-closer-6360-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@211e236: rootName = solr_60810, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@534da57f
[junit4] 2> 754380 INFO (jetty-closer-6360-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
[junit4] 2> 754388 INFO (closeThreadPool-6365-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72121651518636036-127.0.0.1:60810_solr-n_0000000000) closing
[junit4] 2> 754389 INFO (OverseerStateUpdate-72121651518636036-127.0.0.1:60810_solr-n_0000000000) [n:127.0.0.1:60810_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:60810_solr
[junit4] 2> 754390 INFO (OverseerAutoScalingTriggerThread-72121651518636036-127.0.0.1:60810_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 754391 INFO (closeThreadPool-6365-thread-2) [ ] o.a.s.c.Overseer Overseer (id=72121651518636036-127.0.0.1:60810_solr-n_0000000000) closing
[junit4] 2> 754518 INFO (jetty-closer-6360-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72121651518636036-127.0.0.1:60810_solr-n_0000000000) closing
[junit4] 2> 754561 INFO (jetty-closer-6360-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@68d7e845{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
[junit4] 2> 754562 INFO (jetty-closer-6360-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@fe69d78{/solr,null,UNAVAILABLE}
[junit4] 2> 754562 INFO (jetty-closer-6360-thread-1) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 754576 INFO (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
[junit4] 2> 754820 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/aliases.json
[junit4] 2> 6 /solr/clusterprops.json
[junit4] 2> 4 /solr/packages.json
[junit4] 2> 4 /solr/security.json
[junit4] 2> 3 /solr/collections/test/state.json
[junit4] 2> 3 /solr/collections/test/terms/shard1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 9 /solr/collections/test/state.json
[junit4] 2> 6 /solr/clusterstate.json
[junit4] 2> 3 /solr/aliases.json
[junit4] 2> 3 /solr/overseer_elect/election/72121651518636036-127.0.0.1:60810_solr-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 26 /solr/live_nodes
[junit4] 2> 23 /solr/overseer/queue
[junit4] 2> 11 /solr/collections
[junit4] 2> 10 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> 754827 INFO (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:60804
[junit4] 2> 754827 INFO (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:60804
[junit4] 2> 754827 INFO (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 60804
[junit4] 2> 754829 INFO (SUITE-HealthCheckHandlerTest-seed#[1547C6058126E8E4]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
[junit4] 2> Apr 27, 2020 9:07:27 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> Apr 27, 2020 9:07:37 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.handler.admin.HealthCheckHandlerTest:
[junit4] 2> 1) Thread[id=9371, name=SessionTracker, state=TIMED_WAITING, group=TGRP-HealthCheckHandlerTest]
[junit4] 2> at java.base@14/java.lang.Thread.sleep(Native Method)
[junit4] 2> at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
[junit4] 2> Apr 27, 2020 9:07:37 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=9371, name=SessionTracker, state=TIMED_WAITING, group=TGRP-HealthCheckHandlerTest]
[junit4] 2> 764993 ERROR (SessionTracker) [ ] o.a.z.s.ZooKeeperCriticalThread Severe unrecoverable error, from thread : SessionTracker
[junit4] 2> => java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.base/java.lang.Thread.sleep(Native Method)
[junit4] 2> java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method) [?:?]
[junit4] 2> at org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) ~[zookeeper-3.5.7.jar:3.5.7]
[junit4] 2> Apr 27, 2020 9:07:37 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: All leaked threads terminated.
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene84), sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@637fcae7), locale=fr-MG, timezone=Europe/Uzhgorod
[junit4] 2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 14 (64-bit)/cpus=6,threads=1,free=356515840,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [TestSolrConfigHandlerConcurrent, SoftAutoCommitTest, TestClassicSimilarityFactory, TestHttpShardHandlerFactory, TestSolrDeletionPolicy2, SharedFSAutoReplicaFailoverTest, MergeStrategyTest, UnloadDistributedZkTest, TestCharFilters, SmileWriterTest, ZkCollectionPropsCachingTest, TestTextField, TestUnInvertedFieldException, EmbeddedSolrNoSerializeTest, AssignBackwardCompatibilityTest, FileBasedSpellCheckerTest, HdfsTlogReplayBufferedWhileIndexingTest, DistributedFacetPivotLargeTest, ZookeeperReadAPITest, TestCloudJSONFacetSKG, NoCacheHeaderTest, DataDrivenBlockJoinTest, SuggesterTest, TestUniqueKeyFieldResource, TestUtils, SystemInfoHandlerTest, RoutingToNodesWithPropertiesTest, TestOrdValues, BJQFilterAccessibleTest, XmlUpdateRequestHandlerTest, TestWaitForStateWithJettyShutdowns, SegmentsInfoRequestHandlerTest, DistributedMLTComponentTest, TestDynamicURP, HdfsBasicDistributedZk2Test, TestFacetMethods, SolrCoreMetricManagerTest, JavaBinAtomicUpdateMultivalueTest, TestJettySolrRunner, TestGraphMLResponseWriter, SolrRrdBackendFactoryTest, DocumentAnalysisRequestHandlerTest, SystemLogListenerTest, NodeAddedTriggerTest, TestReqParamsAPI, IndexSizeTriggerSizeEstimationTest, TestBulkSchemaConcurrent, DistanceUnitsTest, CustomTermsComponentTest, RequestLoggingTest, TestHalfAndHalfDocValues, SignificantTermsQParserPluginTest, TestCollapseQParserPlugin, ZkNodePropsTest, TestMultiWordSynonyms, SchemaVersionSpecificBehaviorTest, TestSolrCloudWithHadoopAuthPlugin, JWTVerificationkeyResolverTest, DateFieldTest, DistributedSuggestComponentTest, TestFileDictionaryLookup, PreAnalyzedFieldTest, TestDistributedMissingSort, OverseerSolrResponseUnsafeSerializationTest, TestPKIAuthenticationPlugin, MigrateRouteKeyTest, TestJoin, DistributedUpdateProcessorTest, TestLazyCores, ByteBuffersDirectoryFactoryTest, HealthCheckHandlerTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=HealthCheckHandlerTest -Dtests.seed=1547C6058126E8E4 -Dtests.slow=true -Dtests.locale=fr-MG -Dtests.timezone=Europe/Uzhgorod -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J0 | HealthCheckHandlerTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.handler.admin.HealthCheckHandlerTest:
[junit4] > 1) Thread[id=9371, name=SessionTracker, state=TIMED_WAITING, group=TGRP-HealthCheckHandlerTest]
[junit4] > at java.base@14/java.lang.Thread.sleep(Native Method)
[junit4] > at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
[junit4] > at __randomizedtesting.SeedInfo.seed([1547C6058126E8E4]:0)
[junit4] Completed [337/910 (1!)] on J0 in 22.73s, 5 tests, 1 error <<< FAILURES!
[...truncated 46861 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/5930/consoleText
[repro] Revision: bc4da80776d46fcf55c674894a62662908720681
[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseZGC"
[repro] Repro line: ant test -Dtestcase=HealthCheckHandlerTest -Dtests.seed=1547C6058126E8E4 -Dtests.slow=true -Dtests.locale=fr-MG -Dtests.timezone=Europe/Uzhgorod -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] HealthCheckHandlerTest
[repro] ant compile-test
[...truncated 3152 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.HealthCheckHandlerTest" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseZGC" -Dtests.seed=1547C6058126E8E4 -Dtests.slow=true -Dtests.locale=fr-MG -Dtests.timezone=Europe/Uzhgorod -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[...truncated 101 lines...]
[repro] Failures w/original seeds:
[repro] 0/5 failed: org.apache.solr.handler.admin.HealthCheckHandlerTest
[repro] Exiting with code 0
[...truncated 73 lines...]
[JENKINS-Experimental-GC] Lucene-Solr-master-MacOSX (64bit/jdk-14)
- Build # 5929 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/5929/
Java: 64bit/jdk-14 -XX:-UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseShenandoahGC
1 tests failed.
FAILED: org.apache.solr.schema.TestCloudSchemaless.test
Error Message:
Timeout occurred while waiting response from server at: http://127.0.0.1:50782/_p/collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occurred while waiting response from server at: http://127.0.0.1:50782/_p/collection1
at __randomizedtesting.SeedInfo.seed([D54150C109B61A9:85002AD6BE670C51]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:676)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:265)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207)
at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:107)
at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:72)
at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:86)
at org.apache.solr.schema.TestCloudSchemaless.test(TestCloudSchemaless.java:113)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1081)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1053)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
at java.base/java.lang.Thread.run(Thread.java:832)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.base/sun.nio.ch.NioSocketImpl.timedRead(NioSocketImpl.java:283)
at java.base/sun.nio.ch.NioSocketImpl.implRead(NioSocketImpl.java:309)
at java.base/sun.nio.ch.NioSocketImpl.read(NioSocketImpl.java:350)
at java.base/sun.nio.ch.NioSocketImpl$1.read(NioSocketImpl.java:803)
at java.base/java.net.Socket$SocketInputStream.read(Socket.java:982)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:280)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:157)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:564)
... 48 more
Build Log:
[...truncated 15826 lines...]
[junit4] Suite: org.apache.solr.schema.TestCloudSchemaless
[junit4] 2> 618595 INFO (SUITE-TestCloudSchemaless-seed#[D54150C109B61A9]-worker) [ ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/server/solr/configsets/_default/conf'
[junit4] 2> 618595 INFO (SUITE-TestCloudSchemaless-seed#[D54150C109B61A9]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 618606 INFO (SUITE-TestCloudSchemaless-seed#[D54150C109B61A9]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/data-dir-32-001
[junit4] 2> 618606 WARN (SUITE-TestCloudSchemaless-seed#[D54150C109B61A9]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=21 numCloses=21
[junit4] 2> 618606 INFO (SUITE-TestCloudSchemaless-seed#[D54150C109B61A9]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 618609 INFO (SUITE-TestCloudSchemaless-seed#[D54150C109B61A9]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="https://issues.apache.org/jira/browse/SOLR-5776") w/ MAC_OS_X supressed clientAuth
[junit4] 2> 618609 INFO (SUITE-TestCloudSchemaless-seed#[D54150C109B61A9]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /_p/
[junit4] 2> 618979 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 618979 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 618980 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 619083 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.ZkTestServer start zk server on port:50687
[junit4] 2> 619084 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:50687
[junit4] 2> 619084 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:50687
[junit4] 2> 619084 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 50687
[junit4] 2> 619086 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 619092 INFO (zkConnectionManagerCallback-5696-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 619092 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 619099 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 619106 INFO (zkConnectionManagerCallback-5698-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 619106 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 619112 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-schemaless.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 619115 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema-add-schema-fields-update-processor.xml to /configs/conf1/schema.xml
[junit4] 2> 619118 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 619121 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 619125 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 619128 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 619131 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 619135 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 619139 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 619142 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 619147 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 619150 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 619867 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 619867 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 619867 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14+36
[junit4] 2> 619878 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 619878 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 619879 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 619890 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@602edc7b{/_p,null,AVAILABLE}
[junit4] 2> 619900 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@119806c6{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:50704}
[junit4] 2> 619900 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.e.j.s.Server Started @620000ms
[junit4] 2> 619900 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/_p, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/tempDir-001/control/data, hostPort=50704, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/control-001/cores, replicaType=NRT}
[junit4] 2> 619912 ERROR (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 619912 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 619912 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 619912 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 619912 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 619912 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-04-27T14:52:59.768388Z
[junit4] 2> 619916 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 619922 INFO (zkConnectionManagerCallback-5700-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 619923 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 620042 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 620043 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/control-001/solr.xml
[junit4] 2> 620070 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@207fd835, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 620190 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 620193 WARN (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3c35fbb[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 620193 WARN (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3c35fbb[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 620208 WARN (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@258f194c[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 620208 WARN (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@258f194c[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 620209 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50687/solr
[junit4] 2> 620216 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 620217 INFO (zkConnectionManagerCallback-5711-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 620217 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 620339 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [n:127.0.0.1:50704__p ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 620342 INFO (zkConnectionManagerCallback-5713-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 620342 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [n:127.0.0.1:50704__p ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 621042 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [n:127.0.0.1:50704__p ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:50704__p
[junit4] 2> 621047 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [n:127.0.0.1:50704__p ] o.a.s.c.Overseer Overseer (id=72120179852902404-127.0.0.1:50704__p-n_0000000000) starting
[junit4] 2> 621105 INFO (OverseerStateUpdate-72120179852902404-127.0.0.1:50704__p-n_0000000000) [n:127.0.0.1:50704__p ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:50704__p
[junit4] 2> 621108 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [n:127.0.0.1:50704__p ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50704__p
[junit4] 2> 621119 INFO (zkCallback-5712-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 621136 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [n:127.0.0.1:50704__p ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 621137 WARN (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [n:127.0.0.1:50704__p ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=you make it. Consider configuring authentication/authorization before exposing Solr to users internal or authorization=external. See https://s.apache.org/solrsecurity for more info. Solr is only as secure as disableddisabled
[junit4] 2> 621177 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [n:127.0.0.1:50704__p ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 621209 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [n:127.0.0.1:50704__p ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@207fd835
[junit4] 2> 621217 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [n:127.0.0.1:50704__p ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@207fd835
[junit4] 2> 621217 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [n:127.0.0.1:50704__p ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@207fd835
[junit4] 2> 621220 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [n:127.0.0.1:50704__p ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/control-001/cores
[junit4] 2> 621241 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 621245 INFO (zkConnectionManagerCallback-5730-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 621247 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 621261 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 621275 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:50687/solr ready
[junit4] 2> 621279 INFO (qtp425534760-8365) [n:127.0.0.1:50704__p ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:50704__p&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 621324 INFO (OverseerThreadFactory-5720-thread-1-processing-n:127.0.0.1:50704__p) [n:127.0.0.1:50704__p ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 621487 INFO (qtp425534760-8367) [n:127.0.0.1:50704__p ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 621493 INFO (qtp425534760-8364) [n:127.0.0.1:50704__p ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
[junit4] 2> 621509 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p x:control_collection_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 621509 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p x:control_collection_shard1_replica_n1 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 622555 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 622564 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
[junit4] 2> 622575 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=add-schema-fields-update-processor
[junit4] 2> 622583 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema add-schema-fields-update-processor/1.6 with uniqueid field id
[junit4] 2> 622590 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchema Created and persisted managed schema znode at /configs/conf1/managed-schema
[junit4] 2> 622610 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, renamed the non-managed schema /configs/conf1/schema.xml to /configs/conf1/schema.xml.bak
[junit4] 2> 622612 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from configset conf1, trusted=true
[junit4] 2> 622613 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@207fd835
[junit4] 2> 622613 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 622619 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=55.876953125, floorSegmentMB=1.7978515625, forceMergeDeletesPctAllowed=12.172810517792648, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0, deletesPctAllowed=26.190022158023382
[junit4] 2> 623066 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 623066 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 623069 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 623070 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 623075 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=26, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.42412737197468553]
[junit4] 2> 623086 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@362666d2[control_collection_shard1_replica_n1] main]
[junit4] 2> 623094 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 623096 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 623096 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema
[junit4] 2> 623099 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 623105 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 623105 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1665137831272513536
[junit4] 2> 623111 INFO (searcherExecutor-5732-thread-1-processing-n:127.0.0.1:50704__p x:control_collection_shard1_replica_n1 c:control_collection s:shard1) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@362666d2[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 623127 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, version=0}
[junit4] 2> 623127 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/control_collection/leaders/shard1
[junit4] 2> 623156 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 623156 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 623156 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:50704/_p/control_collection_shard1_replica_n1/
[junit4] 2> 623159 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 623161 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy http://127.0.0.1:50704/_p/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 623161 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/72120179852902404-core_node2-n_0000000000
[junit4] 2> 623175 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:50704/_p/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 623289 INFO (zkCallback-5712-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 623290 INFO (zkCallback-5712-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 623295 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 623307 INFO (qtp425534760-8366) [n:127.0.0.1:50704__p ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1798
[junit4] 2> 623314 INFO (qtp425534760-8365) [n:127.0.0.1:50704__p ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 623331 INFO (OverseerCollectionConfigSetProcessor-72120179852902404-127.0.0.1:50704__p-n_0000000000) [n:127.0.0.1:50704__p ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 623409 INFO (zkCallback-5712-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 623409 INFO (zkCallback-5712-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 623410 INFO (zkCallback-5712-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 623411 INFO (qtp425534760-8365) [n:127.0.0.1:50704__p ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:50704__p&wt=javabin&version=2} status=0 QTime=2132
[junit4] 2> 623412 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Waiting to see 1 active replicas in collection: control_collection
[junit4] 2> 623521 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 623525 INFO (zkConnectionManagerCallback-5741-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 623526 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 623533 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 623542 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:50687/solr ready
[junit4] 2> 623542 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 623550 INFO (qtp425534760-8365) [n:127.0.0.1:50704__p ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=4&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 623566 INFO (OverseerThreadFactory-5720-thread-2-processing-n:127.0.0.1:50704__p) [n:127.0.0.1:50704__p ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 623783 WARN (OverseerThreadFactory-5720-thread-2-processing-n:127.0.0.1:50704__p) [n:127.0.0.1:50704__p ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 623786 INFO (qtp425534760-8365) [n:127.0.0.1:50704__p ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 623788 INFO (qtp425534760-8365) [n:127.0.0.1:50704__p ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=4&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=238
[junit4] 2> 623790 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 4 expected:4
[junit4] 2> 623790 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 623790 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 4 expected:4
[junit4] 2> 623790 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 623791 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 4 expected:4
[junit4] 2> 623791 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 623791 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating jetty instances pullReplicaCount=0 numOtherReplicas=8
[junit4] 2> 624128 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/shard-1-001 of type NRT for shard2
[junit4] 2> 624131 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 624131 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 624131 INFO (closeThreadPool-5742-thread-1) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14+36
[junit4] 2> 624134 INFO (closeThreadPool-5742-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 624134 INFO (closeThreadPool-5742-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 624134 INFO (closeThreadPool-5742-thread-1) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 624135 INFO (closeThreadPool-5742-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@293f7447{/_p,null,AVAILABLE}
[junit4] 2> 624138 INFO (closeThreadPool-5742-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@40ee7ad3{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:50765}
[junit4] 2> 624138 INFO (closeThreadPool-5742-thread-1) [ ] o.e.j.s.Server Started @624238ms
[junit4] 2> 624138 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/_p, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/tempDir-001/jetty1, hostPort=50765, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/shard-1-001/cores, replicaType=NRT}
[junit4] 2> 624138 ERROR (closeThreadPool-5742-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 624138 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 624138 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 624138 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 624138 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 624138 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-04-27T14:53:03.994789Z
[junit4] 2> 624139 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 624143 INFO (zkConnectionManagerCallback-5744-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 624143 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 624251 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 624251 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/shard-1-001/solr.xml
[junit4] 2> 624254 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@207fd835, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 624468 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 624470 WARN (closeThreadPool-5742-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@4f276831[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 624470 WARN (closeThreadPool-5742-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@4f276831[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 624476 WARN (closeThreadPool-5742-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@2b07322c[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 624476 WARN (closeThreadPool-5742-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@2b07322c[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 624478 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50687/solr
[junit4] 2> 624479 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 624483 INFO (zkConnectionManagerCallback-5755-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 624483 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 624503 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/shard-2-001 of type NRT for shard3
[junit4] 2> 624504 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 624504 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 624504 INFO (closeThreadPool-5742-thread-2) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14+36
[junit4] 2> 624506 INFO (closeThreadPool-5742-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 624506 INFO (closeThreadPool-5742-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 624506 INFO (closeThreadPool-5742-thread-2) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 624506 INFO (closeThreadPool-5742-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@75ea5d44{/_p,null,AVAILABLE}
[junit4] 2> 624507 INFO (closeThreadPool-5742-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@bff5a6c{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:50769}
[junit4] 2> 624507 INFO (closeThreadPool-5742-thread-2) [ ] o.e.j.s.Server Started @624608ms
[junit4] 2> 624507 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/_p, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/tempDir-001/jetty2, hostPort=50769, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/shard-2-001/cores, replicaType=NRT}
[junit4] 2> 624508 ERROR (closeThreadPool-5742-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 624508 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 624508 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 624508 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 624508 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 624508 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-04-27T14:53:04.364397Z
[junit4] 2> 624512 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 624517 INFO (zkConnectionManagerCallback-5757-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 624517 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 624593 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50765__p ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 624602 INFO (zkConnectionManagerCallback-5759-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 624602 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50765__p ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 624628 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50765__p ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 624655 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50765__p ] o.a.s.c.ZkController Publish node=127.0.0.1:50765__p as DOWN
[junit4] 2> 624659 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50765__p ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 624659 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50765__p ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50765__p
[junit4] 2> 624666 INFO (zkCallback-5712-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 624666 INFO (zkCallback-5758-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 624667 INFO (zkCallback-5740-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 624674 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50765__p ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 624675 WARN (closeThreadPool-5742-thread-1) [n:127.0.0.1:50765__p ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=you make it. Consider configuring authentication/authorization before exposing Solr to users internal or authorization=external. See https://s.apache.org/solrsecurity for more info. Solr is only as secure as disableddisabled
[junit4] 2> 624692 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 624692 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/shard-2-001/solr.xml
[junit4] 2> 624697 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@207fd835, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 624706 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50765__p ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 624757 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50765__p ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@207fd835
[junit4] 2> 624774 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50765__p ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@207fd835
[junit4] 2> 624777 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50765__p ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@207fd835
[junit4] 2> 624779 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50765__p ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/shard-1-001/cores
[junit4] 2> 624787 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:50765__p
[junit4] 2> 624907 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 624912 WARN (closeThreadPool-5742-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@4d75e28[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 624912 WARN (closeThreadPool-5742-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@4d75e28[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 624921 WARN (closeThreadPool-5742-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@7615b84[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 624921 WARN (closeThreadPool-5742-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@7615b84[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 624922 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50687/solr
[junit4] 2> 624923 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 624928 INFO (zkConnectionManagerCallback-5778-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 624930 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 625044 INFO (closeThreadPool-5742-thread-2) [n:127.0.0.1:50769__p ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 625046 INFO (zkConnectionManagerCallback-5780-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 625046 INFO (closeThreadPool-5742-thread-2) [n:127.0.0.1:50769__p ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 625083 INFO (closeThreadPool-5742-thread-2) [n:127.0.0.1:50769__p ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 625099 INFO (closeThreadPool-5742-thread-2) [n:127.0.0.1:50769__p ] o.a.s.c.ZkController Publish node=127.0.0.1:50769__p as DOWN
[junit4] 2> 625103 INFO (closeThreadPool-5742-thread-2) [n:127.0.0.1:50769__p ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 625103 INFO (closeThreadPool-5742-thread-2) [n:127.0.0.1:50769__p ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50769__p
[junit4] 2> 625110 INFO (zkCallback-5740-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 625110 INFO (zkCallback-5758-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 625110 INFO (zkCallback-5712-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 625111 INFO (zkCallback-5779-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 625120 INFO (closeThreadPool-5742-thread-2) [n:127.0.0.1:50769__p ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 625121 WARN (closeThreadPool-5742-thread-2) [n:127.0.0.1:50769__p ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=you make it. Consider configuring authentication/authorization before exposing Solr to users internal or authorization=external. See https://s.apache.org/solrsecurity for more info. Solr is only as secure as disableddisabled
[junit4] 2> 625149 INFO (closeThreadPool-5742-thread-2) [n:127.0.0.1:50769__p ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 625173 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/shard-3-001 of type NRT for shard4
[junit4] 2> 625176 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 625176 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 625177 INFO (closeThreadPool-5742-thread-1) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14+36
[junit4] 2> 625193 INFO (closeThreadPool-5742-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 625193 INFO (closeThreadPool-5742-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 625193 INFO (closeThreadPool-5742-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 625195 INFO (closeThreadPool-5742-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@45e631c3{/_p,null,AVAILABLE}
[junit4] 2> 625199 INFO (closeThreadPool-5742-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@482019d1{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:50776}
[junit4] 2> 625200 INFO (closeThreadPool-5742-thread-1) [ ] o.e.j.s.Server Started @625300ms
[junit4] 2> 625200 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/_p, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/tempDir-001/jetty3, hostPort=50776, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/shard-3-001/cores, replicaType=NRT}
[junit4] 2> 625202 ERROR (closeThreadPool-5742-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 625203 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 625203 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 625203 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 625204 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 625204 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-04-27T14:53:05.060020Z
[junit4] 2> 625205 INFO (closeThreadPool-5742-thread-2) [n:127.0.0.1:50769__p ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@207fd835
[junit4] 2> 625207 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 625215 INFO (zkConnectionManagerCallback-5789-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 625216 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 625241 INFO (closeThreadPool-5742-thread-2) [n:127.0.0.1:50769__p ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@207fd835
[junit4] 2> 625241 INFO (closeThreadPool-5742-thread-2) [n:127.0.0.1:50769__p ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@207fd835
[junit4] 2> 625244 INFO (closeThreadPool-5742-thread-2) [n:127.0.0.1:50769__p ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/shard-2-001/cores
[junit4] 2> 625258 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:50769__p
[junit4] 2> 625323 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 625324 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/shard-3-001/solr.xml
[junit4] 2> 625336 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@207fd835, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 625484 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 625491 WARN (closeThreadPool-5742-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@715eaedd[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 625491 WARN (closeThreadPool-5742-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@715eaedd[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 625510 WARN (closeThreadPool-5742-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@609eba04[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 625510 WARN (closeThreadPool-5742-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@609eba04[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 625511 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50687/solr
[junit4] 2> 625516 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 625520 INFO (zkConnectionManagerCallback-5801-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 625521 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 625572 INFO (OverseerCollectionConfigSetProcessor-72120179852902404-127.0.0.1:50704__p-n_0000000000) [n:127.0.0.1:50704__p ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 625639 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50776__p ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 625643 INFO (zkConnectionManagerCallback-5803-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 625644 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50776__p ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 625728 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50776__p ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 625761 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50776__p ] o.a.s.c.ZkController Publish node=127.0.0.1:50776__p as DOWN
[junit4] 2> 625771 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50776__p ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 625771 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50776__p ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50776__p
[junit4] 2> 625777 INFO (zkCallback-5779-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 625778 INFO (zkCallback-5758-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 625779 INFO (zkCallback-5740-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 625779 INFO (zkCallback-5712-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 625779 INFO (zkCallback-5802-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 625793 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50776__p ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 625794 WARN (closeThreadPool-5742-thread-1) [n:127.0.0.1:50776__p ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=you make it. Consider configuring authentication/authorization before exposing Solr to users internal or authorization=external. See https://s.apache.org/solrsecurity for more info. Solr is only as secure as disableddisabled
[junit4] 2> 625815 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50776__p ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 625840 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50776__p ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@207fd835
[junit4] 2> 625875 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50776__p ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@207fd835
[junit4] 2> 625877 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50776__p ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@207fd835
[junit4] 2> 625895 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50776__p ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/shard-3-001/cores
[junit4] 2> 625931 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:50776__p
[junit4] 2> 626085 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 4 in directory /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/shard-4-001 of type NRT for shard1
[junit4] 2> 626086 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 626086 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 626086 INFO (closeThreadPool-5742-thread-1) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14+36
[junit4] 2> 626092 INFO (closeThreadPool-5742-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 626093 INFO (closeThreadPool-5742-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 626094 INFO (closeThreadPool-5742-thread-1) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 626095 INFO (closeThreadPool-5742-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6dabb581{/_p,null,AVAILABLE}
[junit4] 2> 626096 INFO (closeThreadPool-5742-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@18c1dd66{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:50782}
[junit4] 2> 626096 INFO (closeThreadPool-5742-thread-1) [ ] o.e.j.s.Server Started @626197ms
[junit4] 2> 626096 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/_p, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/tempDir-001/jetty4, hostPort=50782, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/shard-4-001/cores, replicaType=NRT}
[junit4] 2> 626097 ERROR (closeThreadPool-5742-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 626097 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 626097 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 626097 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 626097 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 626097 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-04-27T14:53:05.953611Z
[junit4] 2> 626100 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 626103 INFO (zkConnectionManagerCallback-5813-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 626105 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 626212 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 626212 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/shard-4-001/solr.xml
[junit4] 2> 626217 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@207fd835, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 626339 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 626343 WARN (closeThreadPool-5742-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@238d4ef4[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 626343 WARN (closeThreadPool-5742-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@238d4ef4[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 626349 WARN (closeThreadPool-5742-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@bd7181c[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 626349 WARN (closeThreadPool-5742-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@bd7181c[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 626351 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50687/solr
[junit4] 2> 626352 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 626356 INFO (zkConnectionManagerCallback-5824-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 626356 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 626466 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50782__p ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 626471 INFO (zkConnectionManagerCallback-5826-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 626471 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50782__p ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 626506 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50782__p ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 626595 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50782__p ] o.a.s.c.ZkController Publish node=127.0.0.1:50782__p as DOWN
[junit4] 2> 626614 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50782__p ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 626614 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50782__p ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50782__p
[junit4] 2> 626626 INFO (zkCallback-5740-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 626626 INFO (zkCallback-5712-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 626628 INFO (zkCallback-5802-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 626628 INFO (zkCallback-5779-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 626628 INFO (zkCallback-5758-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 626628 INFO (zkCallback-5825-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 626663 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50782__p ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 626664 WARN (closeThreadPool-5742-thread-1) [n:127.0.0.1:50782__p ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=you make it. Consider configuring authentication/authorization before exposing Solr to users internal or authorization=external. See https://s.apache.org/solrsecurity for more info. Solr is only as secure as disableddisabled
[junit4] 2> 626739 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50782__p ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 626755 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 5 in directory /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/shard-5-001 of type NRT for shard2
[junit4] 2> 626756 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 626756 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 626756 INFO (closeThreadPool-5742-thread-2) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14+36
[junit4] 2> 626760 INFO (closeThreadPool-5742-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 626760 INFO (closeThreadPool-5742-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 626760 INFO (closeThreadPool-5742-thread-2) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 626761 INFO (closeThreadPool-5742-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4debea08{/_p,null,AVAILABLE}
[junit4] 2> 626762 INFO (closeThreadPool-5742-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6b9f4dd8{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:50786}
[junit4] 2> 626762 INFO (closeThreadPool-5742-thread-2) [ ] o.e.j.s.Server Started @626862ms
[junit4] 2> 626762 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/_p, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/tempDir-001/jetty5, hostPort=50786, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/shard-5-001/cores, replicaType=NRT}
[junit4] 2> 626762 ERROR (closeThreadPool-5742-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 626762 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 626762 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 626762 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 626762 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 626763 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-04-27T14:53:06.619001Z
[junit4] 2> 626764 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 626768 INFO (zkConnectionManagerCallback-5835-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 626768 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 626795 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50782__p ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@207fd835
[junit4] 2> 626807 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50782__p ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@207fd835
[junit4] 2> 626807 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50782__p ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@207fd835
[junit4] 2> 626809 INFO (closeThreadPool-5742-thread-1) [n:127.0.0.1:50782__p ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/shard-4-001/cores
[junit4] 2> 626827 INFO (closeThreadPool-5742-thread-1) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:50782__p
[junit4] 2> 626886 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 626886 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/shard-5-001/solr.xml
[junit4] 2> 626893 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@207fd835, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 626992 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 627000 WARN (closeThreadPool-5742-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@4f67052b[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 627000 WARN (closeThreadPool-5742-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@4f67052b[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 627057 WARN (closeThreadPool-5742-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@4a14e1ca[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 627057 WARN (closeThreadPool-5742-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@4a14e1ca[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 627058 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50687/solr
[junit4] 2> 627066 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 627066 INFO (zkConnectionManagerCallback-5847-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 627067 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 627184 INFO (closeThreadPool-5742-thread-2) [n:127.0.0.1:50786__p ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 627191 INFO (zkConnectionManagerCallback-5849-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 627192 INFO (closeThreadPool-5742-thread-2) [n:127.0.0.1:50786__p ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 627242 INFO (closeThreadPool-5742-thread-2) [n:127.0.0.1:50786__p ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
[junit4] 2> 627275 INFO (closeThreadPool-5742-thread-2) [n:127.0.0.1:50786__p ] o.a.s.c.ZkController Publish node=127.0.0.1:50786__p as DOWN
[junit4] 2> 627282 INFO (closeThreadPool-5742-thread-2) [n:127.0.0.1:50786__p ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 627285 INFO (closeThreadPool-5742-thread-2) [n:127.0.0.1:50786__p ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50786__p
[junit4] 2> 627291 INFO (zkCallback-5825-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
[junit4] 2> 627291 INFO (zkCallback-5779-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
[junit4] 2> 627292 INFO (zkCallback-5740-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
[junit4] 2> 627292 INFO (zkCallback-5712-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
[junit4] 2> 627294 INFO (zkCallback-5802-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
[junit4] 2> 627294 INFO (zkCallback-5758-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
[junit4] 2> 627296 INFO (zkCallback-5848-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
[junit4] 2> 627320 INFO (closeThreadPool-5742-thread-2) [n:127.0.0.1:50786__p ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 627321 WARN (closeThreadPool-5742-thread-2) [n:127.0.0.1:50786__p ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=you make it. Consider configuring authentication/authorization before exposing Solr to users internal or authorization=external. See https://s.apache.org/solrsecurity for more info. Solr is only as secure as disableddisabled
[junit4] 2> 627353 INFO (closeThreadPool-5742-thread-2) [n:127.0.0.1:50786__p ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 627387 INFO (closeThreadPool-5742-thread-2) [n:127.0.0.1:50786__p ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@207fd835
[junit4] 2> 627401 INFO (closeThreadPool-5742-thread-2) [n:127.0.0.1:50786__p ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@207fd835
[junit4] 2> 627401 INFO (closeThreadPool-5742-thread-2) [n:127.0.0.1:50786__p ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@207fd835
[junit4] 2> 627403 INFO (closeThreadPool-5742-thread-2) [n:127.0.0.1:50786__p ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001/shard-5-001/cores
[junit4] 2> 627417 INFO (closeThreadPool-5742-thread-2) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:50786__p
[junit4] 2> 627626 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.Abstra
[...truncated too long message...]
B61A9]) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
[junit4] 2> 4269762 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 12 /solr/aliases.json
[junit4] 2> 9 /solr/packages.json
[junit4] 2> 9 /solr/security.json
[junit4] 2> 9 /solr/configs/conf1
[junit4] 2> 9 /solr/configs/conf1/managed-schema
[junit4] 2> 8 /solr/collections/collection1/collectionprops.json
[junit4] 2> 7 /solr/collections/collection1/terms/shard1
[junit4] 2> 7 /solr/collections/collection1/terms/shard2
[junit4] 2> 7 /solr/collections/collection1/terms/shard3
[junit4] 2> 7 /solr/collections/collection1/terms/shard4
[junit4] 2> 2 /solr/collections/control_collection/terms/shard1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 2638 /solr/configs/conf1/managed-schema
[junit4] 2> 288 /solr/collections/collection1/state.json
[junit4] 2> 12 /solr/clusterprops.json
[junit4] 2> 12 /solr/collections/control_collection/state.json
[junit4] 2> 12 /solr/clusterstate.json
[junit4] 2> 2 /solr/overseer_elect/election/72120179852902410-127.0.0.1:50765__p-n_0000000001
[junit4] 2> 2 /solr/overseer_elect/election/72120179852902424-127.0.0.1:50794__p-n_0000000006
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 88 /solr/live_nodes
[junit4] 2> 73 /solr/overseer/queue
[junit4] 2> 20 /solr/overseer/collection-queue-work
[junit4] 2> 12 /solr/collections
[junit4] 2>
[junit4] 2> 4269790 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:50687
[junit4] 2> 4269790 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:50687
[junit4] 2> 4269790 INFO (TEST-TestCloudSchemaless.test-seed#[D54150C109B61A9]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 50687
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestCloudSchemaless -Dtests.method=test -Dtests.seed=D54150C109B61A9 -Dtests.slow=true -Dtests.locale=ee-TG -Dtests.timezone=VST -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 3651s J2 | TestCloudSchemaless.test <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.SolrServerException: Timeout occurred while waiting response from server at: http://127.0.0.1:50782/_p/collection1
[junit4] > at __randomizedtesting.SeedInfo.seed([D54150C109B61A9:85002AD6BE670C51]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:676)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:265)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207)
[junit4] > at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:107)
[junit4] > at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:72)
[junit4] > at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:86)
[junit4] > at org.apache.solr.schema.TestCloudSchemaless.test(TestCloudSchemaless.java:113)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:564)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1081)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1053)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:832)
[junit4] > Caused by: java.net.SocketTimeoutException: Read timed out
[junit4] > at java.base/sun.nio.ch.NioSocketImpl.timedRead(NioSocketImpl.java:283)
[junit4] > at java.base/sun.nio.ch.NioSocketImpl.implRead(NioSocketImpl.java:309)
[junit4] > at java.base/sun.nio.ch.NioSocketImpl.read(NioSocketImpl.java:350)
[junit4] > at java.base/sun.nio.ch.NioSocketImpl$1.read(NioSocketImpl.java:803)
[junit4] > at java.base/java.net.Socket$SocketInputStream.read(Socket.java:982)
[junit4] > at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
[junit4] > at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
[junit4] > at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:280)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
[junit4] > at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
[junit4] > at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
[junit4] > at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:157)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
[junit4] > at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
[junit4] > at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186)
[junit4] > at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
[junit4] > at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
[junit4] > at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:564)
[junit4] > ... 48 more
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.schema.TestCloudSchemaless_D54150C109B61A9-001
[junit4] 2> Apr 27, 2020 3:53:49 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene84): {}, docValues:{}, maxPointsInLeafNode=1847, maxMBSortInHeap=5.853918770643864, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@30cacb52), locale=ee-TG, timezone=VST
[junit4] 2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 14 (64-bit)/cpus=6,threads=1,free=9760984,total=241958912
[junit4] 2> NOTE: All tests run in this JVM: [ScheduledTriggerTest, SignatureUpdateProcessorFactoryTest, TestTrieFacet, TestCodecSupport, CircularListTest, CacheHeaderTest, TestEmbeddedSolrServerAdminHandler, TestSearchPerf, ClusterStateTest, TestPullReplicaErrorHandling, CloudMLTQParserTest, MoveReplicaHDFSFailoverTest, TestSQLHandler, TestNonDefinedSimilarityFactory, DeleteInactiveReplicaTest, TestExtendedDismaxParser, CdcrBidirectionalTest, SolrSlf4jReporterTest, TestMacroExpander, TestPHPSerializedResponseWriter, TestSchemaSimilarityResource, TestUseDocValuesAsStored2, TestIntervalFaceting, SolrMetricReporterTest, HighlighterConfigTest, TestFieldResource, DistributedDebugComponentTest, NestedShardedAtomicUpdateTest, TestCloudInspectUtil, FileUtilsTest, TestFieldCache, DistributedQueryComponentOptimizationTest, ReplicationFactorTest, TestHdfsUpdateLog, CloneFieldUpdateProcessorFactoryTest, TestFieldCacheWithThreads, TestManagedSchemaAPI, TestTrie, TestDocumentBuilder, TestCloudSchemaless]
[junit4] Completed [860/910 (1!)] on J2 in 3651.89s, 1 test, 1 error <<< FAILURES!
[...truncated 44970 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/5929/consoleText
[repro] Revision: ff4363675e3f0873cdb874d12740749449e91d9f
[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseShenandoahGC"
[repro] Repro line: ant test -Dtestcase=TestCloudSchemaless -Dtests.method=test -Dtests.seed=D54150C109B61A9 -Dtests.slow=true -Dtests.locale=ee-TG -Dtests.timezone=VST -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] TestCloudSchemaless
[repro] ant compile-test
[...truncated 3152 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestCloudSchemaless" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseShenandoahGC" -Dtests.seed=D54150C109B61A9 -Dtests.slow=true -Dtests.locale=ee-TG -Dtests.timezone=VST -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[...truncated 116 lines...]
[repro] Failures w/original seeds:
[repro] 0/5 failed: org.apache.solr.schema.TestCloudSchemaless
[repro] Exiting with code 0
[...truncated 73 lines...]
[JENKINS] Lucene-Solr-master-MacOSX (64bit/jdk-12.0.2) - Build #
5928 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/5928/
Java: 64bit/jdk-12.0.2 -XX:+UseCompressedOops -XX:+UseSerialGC
2 tests failed.
FAILED: org.apache.solr.cloud.TestCryptoKeys.test
Error Message:
{ "responseHeader":{ "status":500, "QTime":30042}, "errorMessages":["4 out of 5 the property overlay to be of version 1 within 30 seconds! Failed cores: [http://127.0.0.1:51965/collection1_shard1_replica_n1/, http://127.0.0.1:51975/collection1_shard1_replica_n3/, http://127.0.0.1:51955/collection1_shard1_replica_n5/, http://127.0.0.1:51993/collection1_shard1_replica_n7/]\n"], "WARNING":"This response format is experimental. It is likely to change in the future.", "error":{ "metadata":[ "error-class","org.apache.solr.common.SolrException", "root-error-class","org.apache.solr.common.SolrException"], "msg":"4 out of 5 the property overlay to be of version 1 within 30 seconds! Failed cores: [http://127.0.0.1:51965/collection1_shard1_replica_n1/, http://127.0.0.1:51975/collection1_shard1_replica_n3/, http://127.0.0.1:51955/collection1_shard1_replica_n5/, http://127.0.0.1:51993/collection1_shard1_replica_n7/]", "trace":"org.apache.solr.common.SolrException: 4 out of 5 the property overlay to be of version 1 within 30 seconds! Failed cores: [http://127.0.0.1:51965/collection1_shard1_replica_n1/, http://127.0.0.1:51975/collection1_shard1_replica_n3/, http://127.0.0.1:51955/collection1_shard1_replica_n5/, http://127.0.0.1:51993/collection1_shard1_replica_n7/]\n\tat org.apache.solr.handler.SolrConfigHandler.waitForAllReplicasState(SolrConfigHandler.java:813)\n\tat org.apache.solr.handler.SolrConfigHandler$Command.handleCommands(SolrConfigHandler.java:522)\n\tat org.apache.solr.handler.SolrConfigHandler$Command.handlePOST(SolrConfigHandler.java:363)\n\tat org.apache.solr.handler.SolrConfigHandler.handleRequestBody(SolrConfigHandler.java:139)\n\tat org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:209)\n\tat org.apache.solr.core.SolrCore.execute(SolrCore.java:2586)\n\tat org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:803)\n\tat org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:582)\n\tat org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:432)\n\tat org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:362)\n\tat org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)\n\tat org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)\n\tat org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)\n\tat org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)\n\tat org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)\n\tat org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)\n\tat org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)\n\tat org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)\n\tat org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)\n\tat org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)\n\tat org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)\n\tat org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)\n\tat org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)\n\tat org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)\n\tat org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\n\tat org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)\n\tat org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)\n\tat org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\n\tat org.eclipse.jetty.server.Server.handle(Server.java:500)\n\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)\n\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)\n\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)\n\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)\n\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\n\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)\n\tat org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)\n\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)\n\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)\n\tat java.base/java.lang.Thread.run(Thread.java:835)\n", "code":500}} expected null, but was:<[4 out of 5 the property overlay to be of version 1 within 30 seconds! Failed cores: [http://127.0.0.1:51965/collection1_shard1_replica_n1/, http://127.0.0.1:51975/collection1_shard1_replica_n3/, http://127.0.0.1:51955/collection1_shard1_replica_n5/, http://127.0.0.1:51993/collection1_shard1_replica_n7/] ]>
Stack Trace:
java.lang.AssertionError: {
"responseHeader":{
"status":500,
"QTime":30042},
"errorMessages":["4 out of 5 the property overlay to be of version 1 within 30 seconds! Failed cores: [http://127.0.0.1:51965/collection1_shard1_replica_n1/, http://127.0.0.1:51975/collection1_shard1_replica_n3/, http://127.0.0.1:51955/collection1_shard1_replica_n5/, http://127.0.0.1:51993/collection1_shard1_replica_n7/]\n"],
"WARNING":"This response format is experimental. It is likely to change in the future.",
"error":{
"metadata":[
"error-class","org.apache.solr.common.SolrException",
"root-error-class","org.apache.solr.common.SolrException"],
"msg":"4 out of 5 the property overlay to be of version 1 within 30 seconds! Failed cores: [http://127.0.0.1:51965/collection1_shard1_replica_n1/, http://127.0.0.1:51975/collection1_shard1_replica_n3/, http://127.0.0.1:51955/collection1_shard1_replica_n5/, http://127.0.0.1:51993/collection1_shard1_replica_n7/]",
"trace":"org.apache.solr.common.SolrException: 4 out of 5 the property overlay to be of version 1 within 30 seconds! Failed cores: [http://127.0.0.1:51965/collection1_shard1_replica_n1/, http://127.0.0.1:51975/collection1_shard1_replica_n3/, http://127.0.0.1:51955/collection1_shard1_replica_n5/, http://127.0.0.1:51993/collection1_shard1_replica_n7/]\n\tat org.apache.solr.handler.SolrConfigHandler.waitForAllReplicasState(SolrConfigHandler.java:813)\n\tat org.apache.solr.handler.SolrConfigHandler$Command.handleCommands(SolrConfigHandler.java:522)\n\tat org.apache.solr.handler.SolrConfigHandler$Command.handlePOST(SolrConfigHandler.java:363)\n\tat org.apache.solr.handler.SolrConfigHandler.handleRequestBody(SolrConfigHandler.java:139)\n\tat org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:209)\n\tat org.apache.solr.core.SolrCore.execute(SolrCore.java:2586)\n\tat org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:803)\n\tat org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:582)\n\tat org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:432)\n\tat org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:362)\n\tat org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)\n\tat org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166)\n\tat org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1604)\n\tat org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)\n\tat org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)\n\tat org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)\n\tat org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)\n\tat org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)\n\tat org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)\n\tat org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)\n\tat org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)\n\tat org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)\n\tat org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)\n\tat org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)\n\tat org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\n\tat org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)\n\tat org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:717)\n\tat org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)\n\tat org.eclipse.jetty.server.Server.handle(Server.java:500)\n\tat org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)\n\tat org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)\n\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)\n\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)\n\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)\n\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)\n\tat org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)\n\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)\n\tat org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)\n\tat java.base/java.lang.Thread.run(Thread.java:835)\n",
"code":500}}
expected null, but was:<[4 out of 5 the property overlay to be of version 1 within 30 seconds! Failed cores: [http://127.0.0.1:51965/collection1_shard1_replica_n1/, http://127.0.0.1:51975/collection1_shard1_replica_n3/, http://127.0.0.1:51955/collection1_shard1_replica_n5/, http://127.0.0.1:51993/collection1_shard1_replica_n7/]
]>
at __randomizedtesting.SeedInfo.seed([8D553B31893FED84:50104EB27C3807C]:0)
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotNull(Assert.java:755)
at org.junit.Assert.assertNull(Assert.java:737)
at org.apache.solr.core.TestSolrConfigHandler.runConfigCommand(TestSolrConfigHandler.java:179)
at org.apache.solr.cloud.TestCryptoKeys.test(TestCryptoKeys.java:121)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:567)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1081)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1053)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
at java.base/java.lang.Thread.run(Thread.java:835)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestSSLRandomization
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.TestSSLRandomization: 1) Thread[id=16104, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestSSLRandomization] at java.base@12.0.2/java.lang.Thread.sleep(Native Method) at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.TestSSLRandomization:
1) Thread[id=16104, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestSSLRandomization]
at java.base@12.0.2/java.lang.Thread.sleep(Native Method)
at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
at __randomizedtesting.SeedInfo.seed([8D553B31893FED84]:0)
Build Log:
[...truncated 13005 lines...]
[junit4] Suite: org.apache.solr.cloud.TestCryptoKeys
[junit4] 2> 159396 INFO (SUITE-TestCryptoKeys-seed#[8D553B31893FED84]-worker) [ ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/server/solr/configsets/_default/conf'
[junit4] 2> 159396 INFO (SUITE-TestCryptoKeys-seed#[8D553B31893FED84]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 159397 INFO (SUITE-TestCryptoKeys-seed#[8D553B31893FED84]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.TestCryptoKeys_8D553B31893FED84-001/data-dir-8-001
[junit4] 2> 159397 WARN (SUITE-TestCryptoKeys-seed#[8D553B31893FED84]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
[junit4] 2> 159397 INFO (SUITE-TestCryptoKeys-seed#[8D553B31893FED84]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 159399 INFO (SUITE-TestCryptoKeys-seed#[8D553B31893FED84]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 159399 INFO (SUITE-TestCryptoKeys-seed#[8D553B31893FED84]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 159423 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 159430 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 159430 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 159538 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.ZkTestServer start zk server on port:51923
[junit4] 2> 159538 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:51923
[junit4] 2> 159538 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:51923
[junit4] 2> 159538 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 51923
[junit4] 2> 159549 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 159557 INFO (zkConnectionManagerCallback-540-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 159563 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 159588 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 159594 INFO (zkConnectionManagerCallback-542-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 159599 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 159629 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 159645 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 159655 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 159667 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 159683 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 159694 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 159719 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 159755 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 159848 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 159886 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 159953 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 159995 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 163426 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 163427 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 163427 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 12.0.2+10
[junit4] 2> 163456 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 163456 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 163456 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 163459 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2b42fbbc{/,null,AVAILABLE}
[junit4] 2> 163511 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1c3d15e{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:51936}
[junit4] 2> 163511 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.e.j.s.Server Started @163567ms
[junit4] 2> 163511 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.TestCryptoKeys_8D553B31893FED84-001/tempDir-001/control/data, hostPort=51936, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.TestCryptoKeys_8D553B31893FED84-001/control-001/cores}
[junit4] 2> 163516 ERROR (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 163516 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 163517 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 163517 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 163517 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 163517 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-04-27T09:33:04.190261Z
[junit4] 2> 163520 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 163555 INFO (zkConnectionManagerCallback-544-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 163555 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 163673 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 163674 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.TestCryptoKeys_8D553B31893FED84-001/control-001/solr.xml
[junit4] 2> 163703 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@5b6c4260, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 164643 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 164655 WARN (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@a12502[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 164655 WARN (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@a12502[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 164685 WARN (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@207bdf37[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 164686 WARN (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@207bdf37[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 164698 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51923/solr
[junit4] 2> 164752 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 164753 INFO (zkConnectionManagerCallback-555-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 164754 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 164983 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [n:127.0.0.1:51936_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 164992 INFO (zkConnectionManagerCallback-557-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 164992 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [n:127.0.0.1:51936_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 172716 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [n:127.0.0.1:51936_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:51936_
[junit4] 2> 172745 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [n:127.0.0.1:51936_ ] o.a.s.c.Overseer Overseer (id=72118921646112772-127.0.0.1:51936_-n_0000000000) starting
[junit4] 2> 173353 INFO (OverseerStateUpdate-72118921646112772-127.0.0.1:51936_-n_0000000000) [n:127.0.0.1:51936_ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:51936_
[junit4] 2> 173379 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [n:127.0.0.1:51936_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51936_
[junit4] 2> 173686 INFO (OverseerStateUpdate-72118921646112772-127.0.0.1:51936_-n_0000000000) [n:127.0.0.1:51936_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 174192 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [n:127.0.0.1:51936_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 174192 WARN (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [n:127.0.0.1:51936_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=you make it. Consider configuring authentication/authorization before exposing Solr to users internal or authorization=external. See https://s.apache.org/solrsecurity for more info. Solr is only as secure as disableddisabled
[junit4] 2> 174269 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [n:127.0.0.1:51936_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 174439 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [n:127.0.0.1:51936_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b6c4260
[junit4] 2> 174478 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [n:127.0.0.1:51936_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b6c4260
[junit4] 2> 174478 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [n:127.0.0.1:51936_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b6c4260
[junit4] 2> 174496 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [n:127.0.0.1:51936_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.TestCryptoKeys_8D553B31893FED84-001/control-001/cores
[junit4] 2> 174563 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 174612 INFO (zkConnectionManagerCallback-574-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 174616 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 174680 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 174781 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:51923/solr ready
[junit4] 2> 174788 INFO (qtp1027671134-1060) [n:127.0.0.1:51936_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:51936_&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 175002 INFO (OverseerThreadFactory-564-thread-1-processing-n:127.0.0.1:51936_) [n:127.0.0.1:51936_ ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 175795 INFO (qtp1027671134-1061) [n:127.0.0.1:51936_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
[junit4] 2> 176093 INFO (qtp1027671134-1059) [n:127.0.0.1:51936_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
[junit4] 2> 176469 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ x:control_collection_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 176469 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ x:control_collection_shard1_replica_n1 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 178476 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 178660 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=test
[junit4] 2> 179315 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 181133 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from configset conf1, trusted=true
[junit4] 2> 181137 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b6c4260
[junit4] 2> 181138 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.TestCryptoKeys_8D553B31893FED84-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.TestCryptoKeys_8D553B31893FED84-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 181156 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=17, maxMergedSegmentMB=86.0751953125, floorSegmentMB=0.83203125, forceMergeDeletesPctAllowed=19.16097675285539, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0, deletesPctAllowed=27.68428750370809
[junit4] 2> 181301 WARN (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A, b=B}}}
[junit4] 2> 181659 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 181659 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 181681 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 181681 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 181683 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=39.2421875, floorSegmentMB=2.1474609375, forceMergeDeletesPctAllowed=22.703132365353163, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6702059644570059, deletesPctAllowed=20.450353572781598
[junit4] 2> 181701 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@531abe4c[control_collection_shard1_replica_n1] main]
[junit4] 2> 181855 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 181938 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 181943 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 181943 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1665117719223074816
[junit4] 2> 181998 INFO (searcherExecutor-576-thread-1-processing-n:127.0.0.1:51936_ x:control_collection_shard1_replica_n1 c:control_collection s:shard1) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@531abe4c[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 182405 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, version=0}
[junit4] 2> 182408 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/control_collection/leaders/shard1
[junit4] 2> 182720 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 182720 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 182720 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:51936/control_collection_shard1_replica_n1/
[junit4] 2> 182741 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 182755 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy http://127.0.0.1:51936/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 182760 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/72118921646112772-core_node2-n_0000000000
[junit4] 2> 182903 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:51936/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 182972 INFO (zkCallback-556-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 182972 INFO (zkCallback-556-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 183019 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 183300 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=6832
[junit4] 2> 183550 INFO (qtp1027671134-1060) [n:127.0.0.1:51936_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 183757 INFO (zkCallback-556-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 183758 INFO (zkCallback-556-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 183778 INFO (zkCallback-556-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 183819 INFO (qtp1027671134-1060) [n:127.0.0.1:51936_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:51936_&wt=javabin&version=2} status=0 QTime=9032
[junit4] 2> 183838 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Waiting to see 1 active replicas in collection: control_collection
[junit4] 2> 184133 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 184203 INFO (zkConnectionManagerCallback-585-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 184214 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 184370 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 184443 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:51923/solr ready
[junit4] 2> 184473 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 184482 INFO (qtp1027671134-1060) [n:127.0.0.1:51936_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 184550 INFO (OverseerThreadFactory-564-thread-2-processing-n:127.0.0.1:51936_) [n:127.0.0.1:51936_ ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 185217 WARN (OverseerThreadFactory-564-thread-2-processing-n:127.0.0.1:51936_) [n:127.0.0.1:51936_ ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 185314 INFO (qtp1027671134-1060) [n:127.0.0.1:51936_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 185473 INFO (qtp1027671134-1060) [n:127.0.0.1:51936_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=990
[junit4] 2> 185497 INFO (watches-582-thread-1) [ ] o.a.s.c.SolrCloudTestCase active slice count: 1 expected:1
[junit4] 2> 185497 INFO (watches-582-thread-1) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 185498 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 1 expected:1
[junit4] 2> 185498 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 185526 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 1 expected:1
[junit4] 2> 185526 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 185544 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 1 expected:1
[junit4] 2> 185544 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 185544 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating jetty instances pullReplicaCount=0 numOtherReplicas=4
[junit4] 2> 186737 INFO (OverseerCollectionConfigSetProcessor-72118921646112772-127.0.0.1:51936_-n_0000000000) [n:127.0.0.1:51936_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 188677 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.TestCryptoKeys_8D553B31893FED84-001/shard-1-001 of type NRT for shard1
[junit4] 2> 188688 INFO (closeThreadPool-586-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 188688 INFO (closeThreadPool-586-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 188688 INFO (closeThreadPool-586-thread-1) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 12.0.2+10
[junit4] 2> 188694 INFO (closeThreadPool-586-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 188694 INFO (closeThreadPool-586-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 188694 INFO (closeThreadPool-586-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 188695 INFO (closeThreadPool-586-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@b9d83b5{/,null,AVAILABLE}
[junit4] 2> 188744 INFO (closeThreadPool-586-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3b2b1a65{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:51955}
[junit4] 2> 188744 INFO (closeThreadPool-586-thread-1) [ ] o.e.j.s.Server Started @188800ms
[junit4] 2> 188744 INFO (closeThreadPool-586-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.TestCryptoKeys_8D553B31893FED84-001/tempDir-001/jetty1, hostPort=51955, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.TestCryptoKeys_8D553B31893FED84-001/shard-1-001/cores, replicaType=NRT}
[junit4] 2> 188746 ERROR (closeThreadPool-586-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 188746 INFO (closeThreadPool-586-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 188746 INFO (closeThreadPool-586-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 188746 INFO (closeThreadPool-586-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 188746 INFO (closeThreadPool-586-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 188746 INFO (closeThreadPool-586-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-04-27T09:33:29.419770Z
[junit4] 2> 188750 INFO (closeThreadPool-586-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 188755 INFO (zkConnectionManagerCallback-588-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 188755 INFO (closeThreadPool-586-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 188862 INFO (closeThreadPool-586-thread-1) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 188862 INFO (closeThreadPool-586-thread-1) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.TestCryptoKeys_8D553B31893FED84-001/shard-1-001/solr.xml
[junit4] 2> 188870 INFO (closeThreadPool-586-thread-1) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@5b6c4260, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 189556 INFO (closeThreadPool-586-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 189602 WARN (closeThreadPool-586-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@1afe42ee[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 189602 WARN (closeThreadPool-586-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@1afe42ee[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 189624 WARN (closeThreadPool-586-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@322a168d[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 189624 WARN (closeThreadPool-586-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@322a168d[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 189626 INFO (closeThreadPool-586-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51923/solr
[junit4] 2> 189645 INFO (closeThreadPool-586-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 189663 INFO (zkConnectionManagerCallback-599-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 189666 INFO (closeThreadPool-586-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 189793 INFO (closeThreadPool-586-thread-1) [n:127.0.0.1:51955_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 189885 INFO (zkConnectionManagerCallback-601-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 189890 INFO (closeThreadPool-586-thread-1) [n:127.0.0.1:51955_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 190310 INFO (closeThreadPool-586-thread-1) [n:127.0.0.1:51955_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 190582 INFO (closeThreadPool-586-thread-1) [n:127.0.0.1:51955_ ] o.a.s.c.ZkController Publish node=127.0.0.1:51955_ as DOWN
[junit4] 2> 190637 INFO (closeThreadPool-586-thread-1) [n:127.0.0.1:51955_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 190637 INFO (closeThreadPool-586-thread-1) [n:127.0.0.1:51955_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51955_
[junit4] 2> 190681 INFO (zkCallback-556-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 190681 INFO (zkCallback-584-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 190685 INFO (zkCallback-600-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 190758 INFO (closeThreadPool-586-thread-1) [n:127.0.0.1:51955_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 190766 WARN (closeThreadPool-586-thread-1) [n:127.0.0.1:51955_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=you make it. Consider configuring authentication/authorization before exposing Solr to users internal or authorization=external. See https://s.apache.org/solrsecurity for more info. Solr is only as secure as disableddisabled
[junit4] 2> 191026 INFO (closeThreadPool-586-thread-1) [n:127.0.0.1:51955_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 191065 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.TestCryptoKeys_8D553B31893FED84-001/shard-2-001 of type NRT for shard1
[junit4] 2> 191067 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 191067 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 191067 INFO (closeThreadPool-586-thread-2) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 12.0.2+10
[junit4] 2> 191070 INFO (closeThreadPool-586-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 191070 INFO (closeThreadPool-586-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 191070 INFO (closeThreadPool-586-thread-2) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 191072 INFO (closeThreadPool-586-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@66754f0e{/,null,AVAILABLE}
[junit4] 2> 191155 INFO (closeThreadPool-586-thread-1) [n:127.0.0.1:51955_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b6c4260
[junit4] 2> 191176 INFO (closeThreadPool-586-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@33ae03d8{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:51965}
[junit4] 2> 191176 INFO (closeThreadPool-586-thread-2) [ ] o.e.j.s.Server Started @191231ms
[junit4] 2> 191176 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.TestCryptoKeys_8D553B31893FED84-001/tempDir-001/jetty2, hostPort=51965, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.TestCryptoKeys_8D553B31893FED84-001/shard-2-001/cores, replicaType=NRT}
[junit4] 2> 191180 ERROR (closeThreadPool-586-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 191180 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 191180 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 191180 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 191180 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 191180 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-04-27T09:33:31.853447Z
[junit4] 2> 191185 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 191199 INFO (closeThreadPool-586-thread-1) [n:127.0.0.1:51955_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b6c4260
[junit4] 2> 191199 INFO (closeThreadPool-586-thread-1) [n:127.0.0.1:51955_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b6c4260
[junit4] 2> 191210 INFO (closeThreadPool-586-thread-1) [n:127.0.0.1:51955_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.TestCryptoKeys_8D553B31893FED84-001/shard-1-001/cores
[junit4] 2> 191289 INFO (zkConnectionManagerCallback-610-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 191289 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 191293 INFO (closeThreadPool-586-thread-1) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:51955_
[junit4] 2> 191651 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 191684 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.TestCryptoKeys_8D553B31893FED84-001/shard-2-001/solr.xml
[junit4] 2> 191740 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@5b6c4260, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 192750 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 192775 WARN (closeThreadPool-586-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@28942915[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 192775 WARN (closeThreadPool-586-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@28942915[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 192831 WARN (closeThreadPool-586-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@19ae5662[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 192831 WARN (closeThreadPool-586-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@19ae5662[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 192832 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51923/solr
[junit4] 2> 192847 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 192863 INFO (zkConnectionManagerCallback-622-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 192874 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 193102 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51965_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 193218 INFO (zkConnectionManagerCallback-624-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 193219 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51965_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 193336 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51965_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 193531 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51965_ ] o.a.s.c.ZkController Publish node=127.0.0.1:51965_ as DOWN
[junit4] 2> 193602 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51965_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 193602 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51965_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51965_
[junit4] 2> 193647 INFO (zkCallback-584-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 193649 INFO (zkCallback-600-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 193649 INFO (zkCallback-556-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 193650 INFO (zkCallback-623-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 193889 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51965_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 193890 WARN (closeThreadPool-586-thread-2) [n:127.0.0.1:51965_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=you make it. Consider configuring authentication/authorization before exposing Solr to users internal or authorization=external. See https://s.apache.org/solrsecurity for more info. Solr is only as secure as disableddisabled
[junit4] 2> 194105 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51965_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 194416 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51965_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b6c4260
[junit4] 2> 194480 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51965_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b6c4260
[junit4] 2> 194480 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51965_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b6c4260
[junit4] 2> 194486 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51965_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.TestCryptoKeys_8D553B31893FED84-001/shard-2-001/cores
[junit4] 2> 194565 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:51965_
[junit4] 2> 194964 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.TestCryptoKeys_8D553B31893FED84-001/shard-3-001 of type NRT for shard1
[junit4] 2> 194971 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 194971 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 194972 INFO (closeThreadPool-586-thread-2) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 12.0.2+10
[junit4] 2> 195090 INFO (closeThreadPool-586-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 195091 INFO (closeThreadPool-586-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 195098 INFO (closeThreadPool-586-thread-2) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 195110 INFO (closeThreadPool-586-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@34861f0{/,null,AVAILABLE}
[junit4] 2> 195181 INFO (closeThreadPool-586-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1b0c9a17{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:51975}
[junit4] 2> 195181 INFO (closeThreadPool-586-thread-2) [ ] o.e.j.s.Server Started @195237ms
[junit4] 2> 195184 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.TestCryptoKeys_8D553B31893FED84-001/tempDir-001/jetty3, hostPort=51975, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.TestCryptoKeys_8D553B31893FED84-001/shard-3-001/cores, replicaType=NRT}
[junit4] 2> 195185 ERROR (closeThreadPool-586-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 195185 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 195185 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 195185 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 195185 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 195185 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-04-27T09:33:35.858710Z
[junit4] 2> 195187 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 195221 INFO (zkConnectionManagerCallback-634-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 195231 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 195373 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 195374 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.TestCryptoKeys_8D553B31893FED84-001/shard-3-001/solr.xml
[junit4] 2> 195408 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@5b6c4260, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 196784 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 196817 WARN (closeThreadPool-586-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@75565c4c[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 196817 WARN (closeThreadPool-586-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@75565c4c[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 196979 WARN (closeThreadPool-586-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@6f8fa2a7[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 196979 WARN (closeThreadPool-586-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@6f8fa2a7[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 197030 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51923/solr
[junit4] 2> 197041 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 197047 INFO (zkConnectionManagerCallback-645-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 197049 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 197318 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51975_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 197322 INFO (zkConnectionManagerCallback-647-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 197323 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51975_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 197401 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51975_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 197528 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51975_ ] o.a.s.c.ZkController Publish node=127.0.0.1:51975_ as DOWN
[junit4] 2> 197559 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51975_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 197560 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51975_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51975_
[junit4] 2> 197576 INFO (zkCallback-600-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 197576 INFO (zkCallback-584-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 197576 INFO (zkCallback-556-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 197580 INFO (zkCallback-623-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 197581 INFO (zkCallback-646-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 197737 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51975_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 197737 WARN (closeThreadPool-586-thread-2) [n:127.0.0.1:51975_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=you make it. Consider configuring authentication/authorization before exposing Solr to users internal or authorization=external. See https://s.apache.org/solrsecurity for more info. Solr is only as secure as disableddisabled
[junit4] 2> 197935 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51975_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 197987 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51975_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b6c4260
[junit4] 2> 198005 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51975_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b6c4260
[junit4] 2> 198005 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51975_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b6c4260
[junit4] 2> 198007 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51975_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.TestCryptoKeys_8D553B31893FED84-001/shard-3-001/cores
[junit4] 2> 198053 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:51975_
[junit4] 2> 198457 INFO (TEST-TestCryptoKeys.test-seed#[8D553B31893FED84]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 4 in directory /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.TestCryptoKeys_8D553B31893FED84-001/shard-4-001 of type NRT for shard1
[junit4] 2> 198462 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 198462 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 198462 INFO (closeThreadPool-586-thread-2) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 12.0.2+10
[junit4] 2> 198496 INFO (closeThreadPool-586-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 198496 INFO (closeThreadPool-586-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 198497 INFO (closeThreadPool-586-thread-2) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 198499 INFO (closeThreadPool-586-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5d4916b{/,null,AVAILABLE}
[junit4] 2> 198545 INFO (closeThreadPool-586-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7f2c9877{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:51993}
[junit4] 2> 198545 INFO (closeThreadPool-586-thread-2) [ ] o.e.j.s.Server Started @198600ms
[junit4] 2> 198545 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.TestCryptoKeys_8D553B31893FED84-001/tempDir-001/jetty4, hostPort=51993, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.TestCryptoKeys_8D553B31893FED84-001/shard-4-001/cores, replicaType=NRT}
[junit4] 2> 198545 ERROR (closeThreadPool-586-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 198545 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 198546 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 198546 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 198546 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 198546 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-04-27T09:33:39.219238Z
[junit4] 2> 198553 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 198567 INFO (zkConnectionManagerCallback-657-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 198568 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 198678 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 198679 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.TestCryptoKeys_8D553B31893FED84-001/shard-4-001/solr.xml
[junit4] 2> 198705 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@5b6c4260, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 198819 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 198845 WARN (closeThreadPool-586-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@53f5bb58[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 198846 WARN (closeThreadPool-586-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@53f5bb58[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 198874 WARN (closeThreadPool-586-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@77e35e48[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 198876 WARN (closeThreadPool-586-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@77e35e48[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 198896 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51923/solr
[junit4] 2> 198899 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 198904 INFO (zkConnectionManagerCallback-668-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 198917 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 199052 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51993_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 199056 INFO (zkConnectionManagerCallback-670-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 199057 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51993_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 199170 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51993_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 199360 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51993_ ] o.a.s.c.ZkController Publish node=127.0.0.1:51993_ as DOWN
[junit4] 2> 199397 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51993_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 199398 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51993_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51993_
[junit4] 2> 199439 INFO (zkCallback-623-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 199440 INFO (zkCallback-584-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 199449 INFO (zkCallback-556-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 199449 INFO (zkCallback-669-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 199450 INFO (zkCallback-600-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 199450 INFO (zkCallback-646-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 199526 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51993_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 199527 WARN (closeThreadPool-586-thread-2) [n:127.0.0.1:51993_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=you make it. Consider configuring authentication/authorization before exposing Solr to users internal or authorization=external. See https://s.apache.org/solrsecurity for more info. Solr is only as secure as disableddisabled
[junit4] 2> 199576 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51993_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 199650 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51993_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b6c4260
[junit4] 2> 199667 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51993_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b6c4260
[junit4] 2> 199667 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51993_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b6c4260
[junit4] 2> 199669 INFO (closeThreadPool-586-thread-2) [n:127.0.0.1:51993_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J3/temp/solr.cloud.TestCryptoKeys_8D553B31893FED84-001/shard-4-001/cores
[junit4] 2> 199767 INFO (closeThreadPool-586-thread-2) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:51993_
[junit4] 2> 199781 INFO (qtp1027671134-1062) [n:127.0.0.1:51936_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:51975_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 199781 INFO (qtp1027671134-1060) [n:127.0.0.1:51936_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:51965_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 199782 INFO (qtp1027671134-1059) [n:127.0.0.1:51936_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:51955_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 199783 INFO (qtp1027671134-1061) [n:127.0.0.1:51936_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:51993_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 199909 INFO (qtp1027671134-1234) [n:127.0.0.1:51936_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.control_collection.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=9
[junit4] 2> 199929 INFO (qtp1027671134-1234) [n:127.0.0.1:51936_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
[junit4] 2> 199942 INFO (qtp1058310495-1116) [n:127.0.0.1:51955_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
[junit4] 2> 199951 INFO (qtp932286962-1143) [n:127.0.0.1:51965_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
[junit4] 2> 199959 INFO (qtp2047690473-1176) [n:127.0.0.1:51975_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=2
[junit4] 2> 199975 INFO (qtp375404643-1205) [n:127.0.0.1:51993_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=9
[junit4] 2> 200016 INFO (qtp1027671134-1234) [n:127.0.0.1:51936_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.control_collection.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=3
[junit4] 2> 200029 INFO (qtp1027671134-1234) [n:127.0.0.1:51936_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
[junit4] 2> 200033 INFO (qtp1058310495-1117) [n:127.0.0.1:51955_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
[junit4] 2> 200040 INFO (qtp932286962-1144) [n:127.0.0.1:51965_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
[junit4] 2> 200067 INFO (qtp2047690473-1177) [n:1
[...truncated too long message...]
o.a.s.c.ZkTestServer Shutting down ZkTestServer.
[junit4] 2> 1698756 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/clusterprops.json
[junit4] 2> 5 /solr/aliases.json
[junit4] 2> 4 /solr/configs/org.apache.solr.cloud.TestMiniSolrCloudClusterSSL
[junit4] 2> 4 /solr/packages.json
[junit4] 2> 4 /solr/security.json
[junit4] 2> 2 /solr/collections/first_collection/terms/shard1
[junit4] 2> 2 /solr/collections/first_collection/terms/shard3
[junit4] 2> 2 /solr/collections/first_collection/terms/shard2
[junit4] 2> 2 /solr/collections/second_collection/terms/shard1
[junit4] 2> 2 /solr/collections/second_collection/terms/shard2
[junit4] 2> 2 /solr/collections/second_collection/terms/shard3
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 40 /solr/collections/first_collection/state.json
[junit4] 2> 37 /solr/collections/second_collection/state.json
[junit4] 2> 5 /solr/clusterstate.json
[junit4] 2> 2 /solr/autoscaling.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 39 /solr/overseer/queue
[junit4] 2> 21 /solr/live_nodes
[junit4] 2> 13 /solr/collections
[junit4] 2> 9 /solr/overseer/collection-queue-work
[junit4] 2> 2 /solr/autoscaling/events/.scheduled_maintenance
[junit4] 2> 2 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 2 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> 1698784 INFO (SUITE-TestSSLRandomization-seed#[8D553B31893FED84]-worker) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:65338
[junit4] 2> 1698784 INFO (SUITE-TestSSLRandomization-seed#[8D553B31893FED84]-worker) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:65338
[junit4] 2> 1698784 INFO (SUITE-TestSSLRandomization-seed#[8D553B31893FED84]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 65338
[junit4] 2> 1698784 INFO (SUITE-TestSSLRandomization-seed#[8D553B31893FED84]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
[junit4] 2> Apr 27, 2020 9:58:39 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> Apr 27, 2020 9:58:49 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.cloud.TestSSLRandomization:
[junit4] 2> 1) Thread[id=16104, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestSSLRandomization]
[junit4] 2> at java.base@12.0.2/java.lang.Thread.sleep(Native Method)
[junit4] 2> at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
[junit4] 2> Apr 27, 2020 9:58:49 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=16104, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestSSLRandomization]
[junit4] 2> 1708885 ERROR (SessionTracker) [ ] o.a.z.s.ZooKeeperCriticalThread Severe unrecoverable error, from thread : SessionTracker
[junit4] 2> => java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.base/java.lang.Thread.sleep(Native Method)
[junit4] 2> java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method) [?:?]
[junit4] 2> at org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) ~[zookeeper-3.5.7.jar:3.5.7]
[junit4] 2> Apr 27, 2020 9:58:49 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: All leaked threads terminated.
[junit4] 2> NOTE: test params are: codec=FastCompressingStoredFieldsData(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=8, maxDocsPerChunk=873, blockShift=16), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=8, blockSize=16)), sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@583a55da), locale=en-TC, timezone=America/Yellowknife
[junit4] 2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 12.0.2 (64-bit)/cpus=6,threads=1,free=112341800,total=233140224
[junit4] 2> NOTE: All tests run in this JVM: [BlockCacheTest, CdcrOpsAndBoundariesTest, DistributedFacetPivotLargeTest, TestSimUtils, TermVectorComponentDistributedTest, TestClusterProperties, EnumFieldTest, CoreAdminCreateDiscoverTest, TestUniqueKeyFieldResource, TestPseudoReturnFields, TestJsonFacetsWithNestedObjects, PreAnalyzedFieldTest, MoveReplicaTest, TestCloudNestedDocsSort, SuggesterTest, TestDynamicLoadingUrl, TestTextField, ForceLeaderTest, TestClusterStateMutator, PhrasesIdentificationComponentTest, TestDistributedGrouping, TransactionLogTest, TestConfigOverlay, XMLAtomicUpdateMultivalueTest, DisMaxRequestHandlerTest, DistanceUnitsTest, PeerSyncWithBufferUpdatesTest, TestNumericRangeQuery64, TestExportTool, CleanupOldIndexTest, TestCollapseQParserPlugin, CustomTermsComponentTest, TestPKIAuthenticationPlugin, TestFacetMethods, NodeAddedTriggerIntegrationTest, TestRawTransformer, TestManagedResourceStorage, TestHalfAndHalfDocValues, ConcurrentCreateCollectionTest, AutoScalingHandlerTest, HdfsThreadLeakTest, TestNumericTerms64, TestSimNodeAddedTrigger, SolrCoreTest, ProtectedTermFilterFactoryTest, CSVRequestHandlerTest, HdfsNNFailoverTest, SolrRrdBackendFactoryTest, TestAtomicUpdateErrorCases, TestWordDelimiterFilterFactory, TestSchemaNameResource, TestJmxIntegration, TestLegacyFieldReuse, UninvertDocValuesMergePolicyTest, TestOnReconnectListenerSupport, DistribDocExpirationUpdateProcessorTest, CollectionPropsTest, ShardRoutingTest, TestDynamicFieldResource, TriggerIntegrationTest, SmileWriterTest, TestExplainDocTransformer, TestSolrCloudWithHadoopAuthPlugin, TestEmbeddedSolrServerSchemaAPI, DeleteNodeTest, SimpleCollectionCreateDeleteTest, BasicAuthOnSingleNodeTest, SolrCoreMetricManagerTest, TestSolrDeletionPolicy1, DateFieldTest, MergeStrategyTest, ShardsWhitelistTest, DirectoryFactoryTest, TolerantUpdateProcessorTest, HDFSCollectionsAPITest, BJQFilterAccessibleTest, TestQuerySenderNoQuery, SoftAutoCommitTest, IndexSizeTriggerMixedBoundsTest, TestDocSet, TestUtils, TemplateUpdateProcessorTest, TestLeaderElectionWithEmptyReplica, RestoreTriggerStateTest, TestHttpShardHandlerFactory, FileBasedSpellCheckerTest, TestFiltering, TestSimpleTrackingShardHandler, TestSolrCoreProperties, TestSolrTestCaseJ4, TestTolerantSearch, TestTrie, TestCharFilters, TestDeprecatedFilters, TestLuceneMatchVersion, TokenizerChainTest, TestEmbeddedSolrServerAdminHandler, TestEmbeddedSolrServerConstructors, AliasIntegrationTest, ChaosMonkeySafeLeaderTest, CreateCollectionCleanupTest, CreateRoutedAliasTest, DistributedQueueTest, HttpPartitionTest, LeaderFailureAfterFreshStartTest, SharedFSAutoReplicaFailoverTest, SliceStateTest, SolrCLIZkUtilsTest, SyncSliceTest, TestLeaderElectionZkExpiry, TestQueryingOnDownCollection, TestSSLRandomization]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestSSLRandomization -Dtests.seed=8D553B31893FED84 -Dtests.slow=true -Dtests.locale=en-TC -Dtests.timezone=America/Yellowknife -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J4 | TestSSLRandomization (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.TestSSLRandomization:
[junit4] > 1) Thread[id=16104, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestSSLRandomization]
[junit4] > at java.base@12.0.2/java.lang.Thread.sleep(Native Method)
[junit4] > at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
[junit4] > at __randomizedtesting.SeedInfo.seed([8D553B31893FED84]:0)
[junit4] Completed [544/909 (2!)] on J4 in 18.36s, 4 tests, 1 error <<< FAILURES!
[...truncated 53795 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/5928/consoleText
[repro] Revision: 13bbe6033378bd9f3af82f8093f870a5e0df1443
[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseSerialGC"
[repro] Repro line: ant test -Dtestcase=TestCryptoKeys -Dtests.method=test -Dtests.seed=8D553B31893FED84 -Dtests.slow=true -Dtests.locale=az-Latn-AZ -Dtests.timezone=America/New_York -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[repro] Repro line: ant test -Dtestcase=TestSSLRandomization -Dtests.seed=8D553B31893FED84 -Dtests.slow=true -Dtests.locale=en-TC -Dtests.timezone=America/Yellowknife -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] TestCryptoKeys
[repro] TestSSLRandomization
[repro] ant compile-test
[...truncated 3152 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=10 -Dtests.class="*.TestCryptoKeys|*.TestSSLRandomization" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseSerialGC" -Dtests.seed=8D553B31893FED84 -Dtests.slow=true -Dtests.locale=az-Latn-AZ -Dtests.timezone=America/New_York -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[...truncated 121 lines...]
[repro] Failures w/original seeds:
[repro] 0/5 failed: org.apache.solr.cloud.TestCryptoKeys
[repro] 0/5 failed: org.apache.solr.cloud.TestSSLRandomization
[repro] Exiting with code 0
[...truncated 73 lines...]
[JENKINS] Lucene-Solr-master-MacOSX (64bit/jdk-13.0.2) - Build #
5927 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/5927/
Java: 64bit/jdk-13.0.2 -XX:+UseCompressedOops -XX:+UseParallelGC
3 tests failed.
FAILED: org.apache.solr.handler.admin.DaemonStreamApiTest.testAPIs
Error Message:
State for daemon 'daemon0' did not become TERMINATED in 10 seconds
Stack Trace:
java.lang.AssertionError: State for daemon 'daemon0' did not become TERMINATED in 10 seconds
at __randomizedtesting.SeedInfo.seed([CEDFF848383AA49:EC027CF4ED9D3F3]:0)
at org.junit.Assert.fail(Assert.java:88)
at org.apache.solr.handler.admin.DaemonStreamApiTest.checkStopped(DaemonStreamApiTest.java:226)
at org.apache.solr.handler.admin.DaemonStreamApiTest.testAPIs(DaemonStreamApiTest.java:138)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:567)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
at java.base/java.lang.Thread.run(Thread.java:830)
FAILED: junit.framework.TestSuite.org.apache.solr.handler.admin.DaemonStreamApiTest
Error Message:
3 threads leaked from SUITE scope at org.apache.solr.handler.admin.DaemonStreamApiTest: 1) Thread[id=21351, name=DaemonStream-daemon1-13558-thread-1-processing-n:127.0.0.1:59321_solr x:checkpointColl_shard1_replica_n1 c:checkpointColl s:shard1 r:core_node2-EventThread, state=WAITING, group=TGRP-DaemonStreamApiTest] at java.base@13.0.2/jdk.internal.misc.Unsafe.park(Native Method) at java.base@13.0.2/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@13.0.2/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081) at java.base@13.0.2/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433) at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) 2) Thread[id=21225, name=DaemonStream-daemon1-13558-thread-1-processing-n:127.0.0.1:59321_solr x:checkpointColl_shard1_replica_n1 c:checkpointColl s:shard1 r:core_node2, state=TIMED_WAITING, group=TGRP-DaemonStreamApiTest] at java.base@13.0.2/java.lang.Object.wait(Native Method) at app//org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:241) at app//org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:194) at app//org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:127) at app//org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:117) at app//org.apache.solr.common.cloud.ZkStateReader.<init>(ZkStateReader.java:343) at app//org.apache.solr.client.solrj.impl.ZkClientClusterStateProvider.getZkStateReader(ZkClientClusterStateProvider.java:175) at app//org.apache.solr.client.solrj.impl.ZkClientClusterStateProvider.connect(ZkClientClusterStateProvider.java:160) at app//org.apache.solr.client.solrj.impl.BaseCloudSolrClient.connect(BaseCloudSolrClient.java:335) at app//org.apache.solr.client.solrj.io.SolrClientCache.getCloudSolrClient(SolrClientCache.java:67) at app//org.apache.solr.client.solrj.io.stream.UpdateStream.setCloudSolrClient(UpdateStream.java:290) at app//org.apache.solr.client.solrj.io.stream.UpdateStream.open(UpdateStream.java:115) at app//org.apache.solr.client.solrj.io.stream.DaemonStream$StreamRunner.stream(DaemonStream.java:335) at app//org.apache.solr.client.solrj.io.stream.DaemonStream$StreamRunner.run(DaemonStream.java:319) at java.base@13.0.2/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) at java.base@13.0.2/java.util.concurrent.FutureTask.run(FutureTask.java:264) at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:210) at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$218/0x0000000800e6d040.run(Unknown Source) at java.base@13.0.2/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base@13.0.2/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base@13.0.2/java.lang.Thread.run(Thread.java:830) 3) Thread[id=21350, name=DaemonStream-daemon1-13558-thread-1-processing-n:127.0.0.1:59321_solr x:checkpointColl_shard1_replica_n1 c:checkpointColl s:shard1 r:core_node2-SendThread(127.0.0.1:59310), state=TIMED_WAITING, group=TGRP-DaemonStreamApiTest] at java.base@13.0.2/java.lang.Thread.sleep(Native Method) at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:369) at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1137)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 3 threads leaked from SUITE scope at org.apache.solr.handler.admin.DaemonStreamApiTest:
1) Thread[id=21351, name=DaemonStream-daemon1-13558-thread-1-processing-n:127.0.0.1:59321_solr x:checkpointColl_shard1_replica_n1 c:checkpointColl s:shard1 r:core_node2-EventThread, state=WAITING, group=TGRP-DaemonStreamApiTest]
at java.base@13.0.2/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@13.0.2/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
at java.base@13.0.2/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
at java.base@13.0.2/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
2) Thread[id=21225, name=DaemonStream-daemon1-13558-thread-1-processing-n:127.0.0.1:59321_solr x:checkpointColl_shard1_replica_n1 c:checkpointColl s:shard1 r:core_node2, state=TIMED_WAITING, group=TGRP-DaemonStreamApiTest]
at java.base@13.0.2/java.lang.Object.wait(Native Method)
at app//org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:241)
at app//org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:194)
at app//org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:127)
at app//org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:117)
at app//org.apache.solr.common.cloud.ZkStateReader.<init>(ZkStateReader.java:343)
at app//org.apache.solr.client.solrj.impl.ZkClientClusterStateProvider.getZkStateReader(ZkClientClusterStateProvider.java:175)
at app//org.apache.solr.client.solrj.impl.ZkClientClusterStateProvider.connect(ZkClientClusterStateProvider.java:160)
at app//org.apache.solr.client.solrj.impl.BaseCloudSolrClient.connect(BaseCloudSolrClient.java:335)
at app//org.apache.solr.client.solrj.io.SolrClientCache.getCloudSolrClient(SolrClientCache.java:67)
at app//org.apache.solr.client.solrj.io.stream.UpdateStream.setCloudSolrClient(UpdateStream.java:290)
at app//org.apache.solr.client.solrj.io.stream.UpdateStream.open(UpdateStream.java:115)
at app//org.apache.solr.client.solrj.io.stream.DaemonStream$StreamRunner.stream(DaemonStream.java:335)
at app//org.apache.solr.client.solrj.io.stream.DaemonStream$StreamRunner.run(DaemonStream.java:319)
at java.base@13.0.2/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base@13.0.2/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:210)
at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$218/0x0000000800e6d040.run(Unknown Source)
at java.base@13.0.2/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base@13.0.2/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base@13.0.2/java.lang.Thread.run(Thread.java:830)
3) Thread[id=21350, name=DaemonStream-daemon1-13558-thread-1-processing-n:127.0.0.1:59321_solr x:checkpointColl_shard1_replica_n1 c:checkpointColl s:shard1 r:core_node2-SendThread(127.0.0.1:59310), state=TIMED_WAITING, group=TGRP-DaemonStreamApiTest]
at java.base@13.0.2/java.lang.Thread.sleep(Native Method)
at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:369)
at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1137)
at __randomizedtesting.SeedInfo.seed([CEDFF848383AA49]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.handler.admin.MetricsHandlerTest
Error Message:
ObjectTracker found 1 object(s) that were not released!!! [InternalHttpClient] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:339) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:348) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:286) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:273) at org.apache.solr.client.solrj.impl.CloudSolrClient.<init>(CloudSolrClient.java:101) at org.apache.solr.client.solrj.impl.CloudSolrClient$Builder.build(CloudSolrClient.java:473) at org.apache.solr.client.solrj.io.SolrClientCache.getCloudSolrClient(SolrClientCache.java:66) at org.apache.solr.client.solrj.io.stream.UpdateStream.setCloudSolrClient(UpdateStream.java:290) at org.apache.solr.client.solrj.io.stream.UpdateStream.open(UpdateStream.java:115) at org.apache.solr.client.solrj.io.stream.DaemonStream$StreamRunner.stream(DaemonStream.java:335) at org.apache.solr.client.solrj.io.stream.DaemonStream$StreamRunner.run(DaemonStream.java:319) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:210) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:830) expected null, but was:<ObjectTracker found 1 object(s) that were not released!!! [InternalHttpClient] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:339) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:348) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:286) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:273) at org.apache.solr.client.solrj.impl.CloudSolrClient.<init>(CloudSolrClient.java:101) at org.apache.solr.client.solrj.impl.CloudSolrClient$Builder.build(CloudSolrClient.java:473) at org.apache.solr.client.solrj.io.SolrClientCache.getCloudSolrClient(SolrClientCache.java:66) at org.apache.solr.client.solrj.io.stream.UpdateStream.setCloudSolrClient(UpdateStream.java:290) at org.apache.solr.client.solrj.io.stream.UpdateStream.open(UpdateStream.java:115) at org.apache.solr.client.solrj.io.stream.DaemonStream$StreamRunner.stream(DaemonStream.java:335) at org.apache.solr.client.solrj.io.stream.DaemonStream$StreamRunner.run(DaemonStream.java:319) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:210) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:830) >
Stack Trace:
java.lang.AssertionError: ObjectTracker found 1 object(s) that were not released!!! [InternalHttpClient]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:339)
at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:348)
at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:286)
at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:273)
at org.apache.solr.client.solrj.impl.CloudSolrClient.<init>(CloudSolrClient.java:101)
at org.apache.solr.client.solrj.impl.CloudSolrClient$Builder.build(CloudSolrClient.java:473)
at org.apache.solr.client.solrj.io.SolrClientCache.getCloudSolrClient(SolrClientCache.java:66)
at org.apache.solr.client.solrj.io.stream.UpdateStream.setCloudSolrClient(UpdateStream.java:290)
at org.apache.solr.client.solrj.io.stream.UpdateStream.open(UpdateStream.java:115)
at org.apache.solr.client.solrj.io.stream.DaemonStream$StreamRunner.stream(DaemonStream.java:335)
at org.apache.solr.client.solrj.io.stream.DaemonStream$StreamRunner.run(DaemonStream.java:319)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:210)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:830)
expected null, but was:<ObjectTracker found 1 object(s) that were not released!!! [InternalHttpClient]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:339)
at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:348)
at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:286)
at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:273)
at org.apache.solr.client.solrj.impl.CloudSolrClient.<init>(CloudSolrClient.java:101)
at org.apache.solr.client.solrj.impl.CloudSolrClient$Builder.build(CloudSolrClient.java:473)
at org.apache.solr.client.solrj.io.SolrClientCache.getCloudSolrClient(SolrClientCache.java:66)
at org.apache.solr.client.solrj.io.stream.UpdateStream.setCloudSolrClient(UpdateStream.java:290)
at org.apache.solr.client.solrj.io.stream.UpdateStream.open(UpdateStream.java:115)
at org.apache.solr.client.solrj.io.stream.DaemonStream$StreamRunner.stream(DaemonStream.java:335)
at org.apache.solr.client.solrj.io.stream.DaemonStream$StreamRunner.run(DaemonStream.java:319)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:210)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:830)
>
at __randomizedtesting.SeedInfo.seed([CEDFF848383AA49]:0)
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotNull(Assert.java:755)
at org.junit.Assert.assertNull(Assert.java:737)
at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:334)
at jdk.internal.reflect.GeneratedMethodAccessor39.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:567)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:905)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
at java.base/java.lang.Thread.run(Thread.java:830)
Build Log:
[...truncated 15117 lines...]
[junit4] Suite: org.apache.solr.handler.admin.DaemonStreamApiTest
[junit4] 2> 1602305 INFO (SUITE-DaemonStreamApiTest-seed#[CEDFF848383AA49]-worker) [ ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/server/solr/configsets/_default/conf'
[junit4] 2> 1602305 INFO (SUITE-DaemonStreamApiTest-seed#[CEDFF848383AA49]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1602305 INFO (SUITE-DaemonStreamApiTest-seed#[CEDFF848383AA49]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.handler.admin.DaemonStreamApiTest_CEDFF848383AA49-001/data-dir-146-001
[junit4] 2> 1602305 INFO (SUITE-DaemonStreamApiTest-seed#[CEDFF848383AA49]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 1602308 INFO (SUITE-DaemonStreamApiTest-seed#[CEDFF848383AA49]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 1602315 INFO (TEST-DaemonStreamApiTest.testAPIs-seed#[CEDFF848383AA49]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testAPIs
[junit4] 2> 1602315 INFO (TEST-DaemonStreamApiTest.testAPIs-seed#[CEDFF848383AA49]) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.handler.admin.DaemonStreamApiTest_CEDFF848383AA49-001/tempDir-001
[junit4] 2> 1602316 INFO (TEST-DaemonStreamApiTest.testAPIs-seed#[CEDFF848383AA49]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1602316 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1602316 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1602417 INFO (TEST-DaemonStreamApiTest.testAPIs-seed#[CEDFF848383AA49]) [ ] o.a.s.c.ZkTestServer start zk server on port:59310
[junit4] 2> 1602417 INFO (TEST-DaemonStreamApiTest.testAPIs-seed#[CEDFF848383AA49]) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:59310
[junit4] 2> 1602417 INFO (TEST-DaemonStreamApiTest.testAPIs-seed#[CEDFF848383AA49]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:59310
[junit4] 2> 1602417 INFO (TEST-DaemonStreamApiTest.testAPIs-seed#[CEDFF848383AA49]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 59310
[junit4] 2> 1602420 INFO (TEST-DaemonStreamApiTest.testAPIs-seed#[CEDFF848383AA49]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1602427 INFO (zkConnectionManagerCallback-13494-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1602427 INFO (TEST-DaemonStreamApiTest.testAPIs-seed#[CEDFF848383AA49]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1602432 INFO (TEST-DaemonStreamApiTest.testAPIs-seed#[CEDFF848383AA49]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1602436 INFO (zkConnectionManagerCallback-13496-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1602436 INFO (TEST-DaemonStreamApiTest.testAPIs-seed#[CEDFF848383AA49]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1602436 INFO (TEST-DaemonStreamApiTest.testAPIs-seed#[CEDFF848383AA49]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1602443 INFO (zkConnectionManagerCallback-13498-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1602443 INFO (TEST-DaemonStreamApiTest.testAPIs-seed#[CEDFF848383AA49]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1602555 INFO (jetty-launcher-13499-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 1602555 INFO (jetty-launcher-13499-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 1602555 INFO (jetty-launcher-13499-thread-1) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 13.0.2+8
[junit4] 2> 1602557 INFO (jetty-launcher-13499-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1602557 INFO (jetty-launcher-13499-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1602557 INFO (jetty-launcher-13499-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 1602558 INFO (jetty-launcher-13499-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6c35f166{/solr,null,AVAILABLE}
[junit4] 2> 1602559 INFO (jetty-launcher-13499-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@311e754d{ssl, (ssl, alpn, http/1.1, h2)}{127.0.0.1:59321}
[junit4] 2> 1602559 INFO (jetty-launcher-13499-thread-1) [ ] o.e.j.s.Server Started @1602614ms
[junit4] 2> 1602559 INFO (jetty-launcher-13499-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=59321}
[junit4] 2> 1602559 ERROR (jetty-launcher-13499-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1602559 INFO (jetty-launcher-13499-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1602559 INFO (jetty-launcher-13499-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 9.0.0
[junit4] 2> 1602559 INFO (jetty-launcher-13499-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1602559 INFO (jetty-launcher-13499-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 1602559 INFO (jetty-launcher-13499-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-04-27T05:00:19.897876Z
[junit4] 2> 1602560 INFO (jetty-launcher-13499-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1602564 INFO (zkConnectionManagerCallback-13501-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1602564 INFO (jetty-launcher-13499-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1602567 INFO (jetty-launcher-13499-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1602676 INFO (jetty-launcher-13499-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 1602677 WARN (jetty-launcher-13499-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@357f5630[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1602677 WARN (jetty-launcher-13499-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@357f5630[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1602680 WARN (jetty-launcher-13499-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@346556ac[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1602680 WARN (jetty-launcher-13499-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@346556ac[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1602681 INFO (jetty-launcher-13499-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59310/solr
[junit4] 2> 1602682 INFO (jetty-launcher-13499-thread-1) [n:127.0.0.1:59321_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1602686 INFO (zkConnectionManagerCallback-13512-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1602687 INFO (jetty-launcher-13499-thread-1) [n:127.0.0.1:59321_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1602955 INFO (jetty-launcher-13499-thread-1) [n:127.0.0.1:59321_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:59321_solr
[junit4] 2> 1602960 INFO (jetty-launcher-13499-thread-1) [n:127.0.0.1:59321_solr ] o.a.s.c.Overseer Overseer (id=72117849446481924-127.0.0.1:59321_solr-n_0000000000) starting
[junit4] 2> 1602998 INFO (OverseerStateUpdate-72117849446481924-127.0.0.1:59321_solr-n_0000000000) [n:127.0.0.1:59321_solr ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:59321_solr
[junit4] 2> 1602999 INFO (jetty-launcher-13499-thread-1) [n:127.0.0.1:59321_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59321_solr
[junit4] 2> 1603004 INFO (OverseerStateUpdate-72117849446481924-127.0.0.1:59321_solr-n_0000000000) [n:127.0.0.1:59321_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1603011 INFO (jetty-launcher-13499-thread-1) [n:127.0.0.1:59321_solr ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 1603012 WARN (jetty-launcher-13499-thread-1) [n:127.0.0.1:59321_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=you make it. Consider configuring authentication/authorization before exposing Solr to users internal or authorization=external. See https://s.apache.org/solrsecurity for more info. Solr is only as secure as disableddisabled
[junit4] 2> 1603029 INFO (jetty-launcher-13499-thread-1) [n:127.0.0.1:59321_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1603058 INFO (jetty-launcher-13499-thread-1) [n:127.0.0.1:59321_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59321.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bec9cd
[junit4] 2> 1603071 INFO (jetty-launcher-13499-thread-1) [n:127.0.0.1:59321_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59321.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bec9cd
[junit4] 2> 1603071 INFO (jetty-launcher-13499-thread-1) [n:127.0.0.1:59321_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59321.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bec9cd
[junit4] 2> 1603073 INFO (jetty-launcher-13499-thread-1) [n:127.0.0.1:59321_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.handler.admin.DaemonStreamApiTest_CEDFF848383AA49-001/tempDir-001/node1/.
[junit4] 2> 1603082 INFO (TEST-DaemonStreamApiTest.testAPIs-seed#[CEDFF848383AA49]) [ ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=1
[junit4] 2> 1603085 INFO (TEST-DaemonStreamApiTest.testAPIs-seed#[CEDFF848383AA49]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1603088 INFO (zkConnectionManagerCallback-13529-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1603088 INFO (TEST-DaemonStreamApiTest.testAPIs-seed#[CEDFF848383AA49]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1603092 INFO (TEST-DaemonStreamApiTest.testAPIs-seed#[CEDFF848383AA49]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1603096 INFO (TEST-DaemonStreamApiTest.testAPIs-seed#[CEDFF848383AA49]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:59310/solr ready
[junit4] 2> 1603097 INFO (TEST-DaemonStreamApiTest.testAPIs-seed#[CEDFF848383AA49]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1603100 INFO (zkConnectionManagerCallback-13531-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1603100 INFO (TEST-DaemonStreamApiTest.testAPIs-seed#[CEDFF848383AA49]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1603220 INFO (qtp1004936765-21167) [n:127.0.0.1:59321_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf&maxShardsPerNode=1&name=sourceColl&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1603230 INFO (OverseerThreadFactory-13519-thread-1-processing-n:127.0.0.1:59321_solr) [n:127.0.0.1:59321_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection sourceColl
[junit4] 2> 1603357 INFO (qtp1004936765-21164) [n:127.0.0.1:59321_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1603358 INFO (qtp1004936765-21166) [n:127.0.0.1:59321_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1603369 INFO (OverseerStateUpdate-72117849446481924-127.0.0.1:59321_solr-n_0000000000) [n:127.0.0.1:59321_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"sourceColl",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"sourceColl_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:59321/solr",
[junit4] 2> "node_name":"127.0.0.1:59321_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1603577 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr x:sourceColl_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=sourceColl_shard1_replica_n1&action=CREATE&numShards=1&collection=sourceColl&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1603578 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr x:sourceColl_shard1_replica_n1 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 1000 transient cores
[junit4] 2> 1603597 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 1603611 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=minimal
[junit4] 2> 1603612 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1603612 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'sourceColl_shard1_replica_n1' using configuration from configset conf, trusted=true
[junit4] 2> 1603613 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59321.solr.core.sourceColl.shard1.replica_n1' (registry 'solr.core.sourceColl.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bec9cd
[junit4] 2> 1603613 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.c.SolrCore [[sourceColl_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.handler.admin.DaemonStreamApiTest_CEDFF848383AA49-001/tempDir-001/node1/./sourceColl_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.handler.admin.DaemonStreamApiTest_CEDFF848383AA49-001/tempDir-001/node1/./sourceColl_shard1_replica_n1/data/]
[junit4] 2> 1603669 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1603669 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1603671 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1603671 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1603674 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@6f8e6e49[sourceColl_shard1_replica_n1] main]
[junit4] 2> 1603677 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1603678 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1603679 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1603679 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1665100541871521792
[junit4] 2> 1603683 INFO (searcherExecutor-13533-thread-1-processing-n:127.0.0.1:59321_solr x:sourceColl_shard1_replica_n1 c:sourceColl s:shard1 r:core_node2) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.c.SolrCore [sourceColl_shard1_replica_n1] Registered new searcher Searcher@6f8e6e49[sourceColl_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1603694 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/sourceColl/terms/shard1 to Terms{values={core_node2=0}, version=0}
[junit4] 2> 1603695 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/sourceColl/leaders/shard1
[junit4] 2> 1603707 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1603707 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1603707 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:59321/solr/sourceColl_shard1_replica_n1/
[junit4] 2> 1603708 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1603708 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.c.SyncStrategy https://127.0.0.1:59321/solr/sourceColl_shard1_replica_n1/ has no replicas
[junit4] 2> 1603708 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/sourceColl/leaders/shard1/leader after winning as /collections/sourceColl/leader_elect/shard1/election/72117849446481924-core_node2-n_0000000000
[junit4] 2> 1603714 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:59321/solr/sourceColl_shard1_replica_n1/ shard1
[junit4] 2> 1603823 INFO (zkCallback-13511-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/sourceColl/state.json] for collection [sourceColl] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1603827 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1603836 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=sourceColl_shard1_replica_n1&action=CREATE&numShards=1&collection=sourceColl&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=258
[junit4] 2> 1603843 INFO (qtp1004936765-21167) [n:127.0.0.1:59321_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 1603940 INFO (zkCallback-13511-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/sourceColl/state.json] for collection [sourceColl] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1603940 INFO (zkCallback-13511-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/sourceColl/state.json] for collection [sourceColl] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1603942 INFO (qtp1004936765-21167) [n:127.0.0.1:59321_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf&maxShardsPerNode=1&name=sourceColl&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=722
[junit4] 2> 1603945 INFO (qtp1004936765-21164) [n:127.0.0.1:59321_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf&maxShardsPerNode=1&name=targetColl&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1603954 INFO (OverseerThreadFactory-13519-thread-2-processing-n:127.0.0.1:59321_solr) [n:127.0.0.1:59321_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection targetColl
[junit4] 2> 1603955 INFO (OverseerCollectionConfigSetProcessor-72117849446481924-127.0.0.1:59321_solr-n_0000000000) [n:127.0.0.1:59321_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1604172 INFO (qtp1004936765-21166) [n:127.0.0.1:59321_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.sourceColl.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
[junit4] 2> 1604174 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1604176 INFO (qtp1004936765-21167) [n:127.0.0.1:59321_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.sourceColl.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
[junit4] 2> 1604178 INFO (qtp1004936765-21166) [n:127.0.0.1:59321_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1604193 INFO (OverseerStateUpdate-72117849446481924-127.0.0.1:59321_solr-n_0000000000) [n:127.0.0.1:59321_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"targetColl",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"targetColl_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:59321/solr",
[junit4] 2> "node_name":"127.0.0.1:59321_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1604399 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr x:targetColl_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=targetColl_shard1_replica_n1&action=CREATE&numShards=1&collection=targetColl&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1604442 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:targetColl s:shard1 r:core_node2 x:targetColl_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 1604451 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:targetColl s:shard1 r:core_node2 x:targetColl_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=minimal
[junit4] 2> 1604453 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:targetColl s:shard1 r:core_node2 x:targetColl_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1604453 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:targetColl s:shard1 r:core_node2 x:targetColl_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'targetColl_shard1_replica_n1' using configuration from configset conf, trusted=true
[junit4] 2> 1604454 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:targetColl s:shard1 r:core_node2 x:targetColl_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59321.solr.core.targetColl.shard1.replica_n1' (registry 'solr.core.targetColl.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bec9cd
[junit4] 2> 1604454 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:targetColl s:shard1 r:core_node2 x:targetColl_shard1_replica_n1 ] o.a.s.c.SolrCore [[targetColl_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.handler.admin.DaemonStreamApiTest_CEDFF848383AA49-001/tempDir-001/node1/./targetColl_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.handler.admin.DaemonStreamApiTest_CEDFF848383AA49-001/tempDir-001/node1/./targetColl_shard1_replica_n1/data/]
[junit4] 2> 1604562 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:targetColl s:shard1 r:core_node2 x:targetColl_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1604562 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:targetColl s:shard1 r:core_node2 x:targetColl_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1604565 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:targetColl s:shard1 r:core_node2 x:targetColl_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1604565 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:targetColl s:shard1 r:core_node2 x:targetColl_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1604566 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:targetColl s:shard1 r:core_node2 x:targetColl_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@29449253[targetColl_shard1_replica_n1] main]
[junit4] 2> 1604568 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:targetColl s:shard1 r:core_node2 x:targetColl_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1604571 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:targetColl s:shard1 r:core_node2 x:targetColl_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1604572 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:targetColl s:shard1 r:core_node2 x:targetColl_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1604573 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:targetColl s:shard1 r:core_node2 x:targetColl_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1665100542808948736
[junit4] 2> 1604578 INFO (searcherExecutor-13539-thread-1-processing-n:127.0.0.1:59321_solr x:targetColl_shard1_replica_n1 c:targetColl s:shard1 r:core_node2) [n:127.0.0.1:59321_solr c:targetColl s:shard1 r:core_node2 x:targetColl_shard1_replica_n1 ] o.a.s.c.SolrCore [targetColl_shard1_replica_n1] Registered new searcher Searcher@29449253[targetColl_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1604589 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:targetColl s:shard1 r:core_node2 x:targetColl_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/targetColl/terms/shard1 to Terms{values={core_node2=0}, version=0}
[junit4] 2> 1604590 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:targetColl s:shard1 r:core_node2 x:targetColl_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/targetColl/leaders/shard1
[junit4] 2> 1604603 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:targetColl s:shard1 r:core_node2 x:targetColl_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1604603 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:targetColl s:shard1 r:core_node2 x:targetColl_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1604603 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:targetColl s:shard1 r:core_node2 x:targetColl_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:59321/solr/targetColl_shard1_replica_n1/
[junit4] 2> 1604606 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:targetColl s:shard1 r:core_node2 x:targetColl_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1604607 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:targetColl s:shard1 r:core_node2 x:targetColl_shard1_replica_n1 ] o.a.s.c.SyncStrategy https://127.0.0.1:59321/solr/targetColl_shard1_replica_n1/ has no replicas
[junit4] 2> 1604608 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:targetColl s:shard1 r:core_node2 x:targetColl_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/targetColl/leaders/shard1/leader after winning as /collections/targetColl/leader_elect/shard1/election/72117849446481924-core_node2-n_0000000000
[junit4] 2> 1604622 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:targetColl s:shard1 r:core_node2 x:targetColl_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:59321/solr/targetColl_shard1_replica_n1/ shard1
[junit4] 2> 1604725 INFO (zkCallback-13511-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/targetColl/state.json] for collection [targetColl] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1604725 INFO (zkCallback-13511-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/targetColl/state.json] for collection [targetColl] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1604730 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:targetColl s:shard1 r:core_node2 x:targetColl_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1604735 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=targetColl_shard1_replica_n1&action=CREATE&numShards=1&collection=targetColl&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=336
[junit4] 2> 1604742 INFO (qtp1004936765-21164) [n:127.0.0.1:59321_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 1604836 INFO (zkCallback-13511-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/targetColl/state.json] for collection [targetColl] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1604836 INFO (zkCallback-13511-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/targetColl/state.json] for collection [targetColl] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1604836 INFO (zkCallback-13511-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/targetColl/state.json] for collection [targetColl] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1604838 INFO (qtp1004936765-21164) [n:127.0.0.1:59321_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf&maxShardsPerNode=1&name=targetColl&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=893
[junit4] 2> 1604839 INFO (qtp1004936765-21167) [n:127.0.0.1:59321_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf&maxShardsPerNode=1&name=checkpointColl&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1604848 INFO (OverseerThreadFactory-13519-thread-3-processing-n:127.0.0.1:59321_solr) [n:127.0.0.1:59321_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection checkpointColl
[junit4] 2> 1604849 INFO (OverseerCollectionConfigSetProcessor-72117849446481924-127.0.0.1:59321_solr-n_0000000000) [n:127.0.0.1:59321_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1605067 INFO (qtp1004936765-21166) [n:127.0.0.1:59321_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.sourceColl.shard1.replica_n1:INDEX.sizeInBytes&key=solr.core.targetColl.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
[junit4] 2> 1605069 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=1
[junit4] 2> 1605071 INFO (qtp1004936765-21164) [n:127.0.0.1:59321_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.sourceColl.shard1.replica_n1:INDEX.sizeInBytes&key=solr.core.targetColl.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
[junit4] 2> 1605072 INFO (qtp1004936765-21166) [n:127.0.0.1:59321_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0
[junit4] 2> 1605084 INFO (OverseerStateUpdate-72117849446481924-127.0.0.1:59321_solr-n_0000000000) [n:127.0.0.1:59321_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"checkpointColl",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"checkpointColl_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:59321/solr",
[junit4] 2> "node_name":"127.0.0.1:59321_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1605295 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr x:checkpointColl_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=checkpointColl_shard1_replica_n1&action=CREATE&numShards=1&collection=checkpointColl&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1605319 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 1605334 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=minimal
[junit4] 2> 1605335 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1605335 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'checkpointColl_shard1_replica_n1' using configuration from configset conf, trusted=true
[junit4] 2> 1605336 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59321.solr.core.checkpointColl.shard1.replica_n1' (registry 'solr.core.checkpointColl.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@8bec9cd
[junit4] 2> 1605336 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.SolrCore [[checkpointColl_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.handler.admin.DaemonStreamApiTest_CEDFF848383AA49-001/tempDir-001/node1/./checkpointColl_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.handler.admin.DaemonStreamApiTest_CEDFF848383AA49-001/tempDir-001/node1/./checkpointColl_shard1_replica_n1/data/]
[junit4] 2> 1605421 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1605421 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1605422 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1605422 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1605423 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.s.SolrIndexSearcher Opening [Searcher@7919c61f[checkpointColl_shard1_replica_n1] main]
[junit4] 2> 1605426 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1605427 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1605427 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1605427 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1665100543704432640
[junit4] 2> 1605434 INFO (searcherExecutor-13545-thread-1-processing-n:127.0.0.1:59321_solr x:checkpointColl_shard1_replica_n1 c:checkpointColl s:shard1 r:core_node2) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.SolrCore [checkpointColl_shard1_replica_n1] Registered new searcher Searcher@7919c61f[checkpointColl_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1605444 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/checkpointColl/terms/shard1 to Terms{values={core_node2=0}, version=0}
[junit4] 2> 1605444 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/checkpointColl/leaders/shard1
[junit4] 2> 1605458 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1605459 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1605459 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:59321/solr/checkpointColl_shard1_replica_n1/
[junit4] 2> 1605459 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1605460 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.SyncStrategy https://127.0.0.1:59321/solr/checkpointColl_shard1_replica_n1/ has no replicas
[junit4] 2> 1605460 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/checkpointColl/leaders/shard1/leader after winning as /collections/checkpointColl/leader_elect/shard1/election/72117849446481924-core_node2-n_0000000000
[junit4] 2> 1605467 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:59321/solr/checkpointColl_shard1_replica_n1/ shard1
[junit4] 2> 1605572 INFO (zkCallback-13511-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/checkpointColl/state.json] for collection [checkpointColl] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1605572 INFO (zkCallback-13511-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/checkpointColl/state.json] for collection [checkpointColl] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1605584 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1605592 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=checkpointColl_shard1_replica_n1&action=CREATE&numShards=1&collection=checkpointColl&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=298
[junit4] 2> 1605597 INFO (qtp1004936765-21167) [n:127.0.0.1:59321_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 1605694 INFO (zkCallback-13511-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/checkpointColl/state.json] for collection [checkpointColl] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1605694 INFO (zkCallback-13511-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/checkpointColl/state.json] for collection [checkpointColl] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1605694 INFO (zkCallback-13511-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/checkpointColl/state.json] for collection [checkpointColl] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1605696 INFO (qtp1004936765-21167) [n:127.0.0.1:59321_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf&maxShardsPerNode=1&name=checkpointColl&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=856
[junit4] 2> 1605709 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=1
[junit4] 2> 1605725 INFO (qtp1004936765-21166) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=start&id=daemon0&wt=json&version=2.2} status=0 QTime=4
[junit4] 2> 1605735 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=stop&id=daemon0&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1605748 INFO (qtp1004936765-21166) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=kill&id=daemon0&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1605769 INFO (qtp1004936765-21167) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={qt=/stream&_stateVer_=checkpointColl:4&expr=++daemon(id%3D"daemon0",++++runInterval%3D"1000",++++terminate%3D"false",++++update(targetColl,++++++batchSize%3D100,++++++topic(checkpointColl,++++++++sourceColl,++++++++q%3D"*:*",++++++++fl%3D"id",++++++++id%3D"topic1",++++++++initialCheckpoint%3D0)))&wt=javabin&version=2} status=0 QTime=17
[junit4] 2> 1605772 INFO (DaemonStream-daemon0-13550-thread-1-processing-n:127.0.0.1:59321_solr x:checkpointColl_shard1_replica_n1 c:checkpointColl s:shard1 r:core_node2) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1605775 INFO (qtp1004936765-21166) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={qt=/stream&_stateVer_=checkpointColl:4&expr=++daemon(id%3D"daemon0",++++runInterval%3D"1000",++++terminate%3D"false",++++update(targetColl,++++++batchSize%3D100,++++++topic(checkpointColl,++++++++sourceColl,++++++++q%3D"*:*",++++++++fl%3D"id",++++++++id%3D"topic1",++++++++initialCheckpoint%3D0)))&wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 1605776 INFO (zkConnectionManagerCallback-13555-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1605776 INFO (DaemonStream-daemon0-13550-thread-1-processing-n:127.0.0.1:59321_solr x:checkpointColl_shard1_replica_n1 c:checkpointColl s:shard1 r:core_node2) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1605779 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={qt=/stream&_stateVer_=checkpointColl:4&expr=++daemon(id%3D"daemon1",++++runInterval%3D"1000",++++terminate%3D"false",++++update(targetColl,++++++batchSize%3D100,++++++topic(checkpointColl,++++++++sourceColl,++++++++q%3D"*:*",++++++++fl%3D"id",++++++++id%3D"topic1",++++++++initialCheckpoint%3D0)))&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 1605782 INFO (qtp1004936765-21164) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={qt=/stream&_stateVer_=checkpointColl:4&expr=++daemon(id%3D"daemon1",++++runInterval%3D"1000",++++terminate%3D"false",++++update(targetColl,++++++batchSize%3D100,++++++topic(checkpointColl,++++++++sourceColl,++++++++q%3D"*:*",++++++++fl%3D"id",++++++++id%3D"topic1",++++++++initialCheckpoint%3D0)))&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 1605783 INFO (DaemonStream-daemon0-13550-thread-1-processing-n:127.0.0.1:59321_solr x:checkpointColl_shard1_replica_n1 c:checkpointColl s:shard1 r:core_node2) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1605790 INFO (DaemonStream-daemon0-13550-thread-1-processing-n:127.0.0.1:59321_solr x:checkpointColl_shard1_replica_n1 c:checkpointColl s:shard1 r:core_node2) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:59310/solr ready
[junit4] 2> 1605798 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1605809 INFO (qtp1004936765-21164) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/get params={qt=/get&ids=topic1&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1605812 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/get params={qt=/get&ids=topic1&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1605813 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/get params={qt=/get&ids=topic1&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1605814 INFO (qtp1004936765-21166) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1605817 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/get params={qt=/get&ids=topic1&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1605838 INFO (qtp1004936765-21164) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.c.S.Request [sourceColl_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&distrib=false&fl=id,_version_&initialCheckpoint=0&sort=_version_+asc&rows=500&wt=json&version=2.2} hits=0 status=0 QTime=0
[junit4] 2> 1605842 INFO (qtp1004936765-21164) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.c.S.Request [sourceColl_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&distrib=false&fl=id,_version_&initialCheckpoint=0&sort=_version_+asc&rows=500&wt=json&version=2.2} hits=0 status=0 QTime=0
[junit4] 2> 1605842 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.c.S.Request [sourceColl_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&distrib=false&fl=id,_version_&initialCheckpoint=0&sort=_version_+asc&rows=500&wt=json&version=2.2} hits=0 status=0 QTime=0
[junit4] 2> 1605844 INFO (qtp1004936765-21164) [n:127.0.0.1:59321_solr c:sourceColl s:shard1 r:core_node2 x:sourceColl_shard1_replica_n1 ] o.a.s.c.S.Request [sourceColl_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&distrib=false&fl=id,_version_&initialCheckpoint=0&sort=_version_+asc&rows=500&wt=json&version=2.2} hits=0 status=0 QTime=0
[junit4] 2> 1605863 INFO (qtp1004936765-21164) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/checkpointColl/terms/shard1 to Terms{values={core_node2=1}, version=1}
[junit4] 2> 1605863 INFO (qtp1004936765-21164) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [checkpointColl_shard1_replica_n1] webapp=/solr path=/update params={_stateVer_=checkpointColl:4&collection=checkpointColl&wt=javabin&version=2}{add=[topic1 (1665100544156368896)]} 0 11
[junit4] 2> 1605866 INFO (qtp1004936765-21166) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Failed to save terms, version is not a match, retrying
[junit4] 2> 1605866 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Failed to save terms, version is not a match, retrying
[junit4] 2> 1605867 INFO (qtp1004936765-21167) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Failed to save terms, version is not a match, retrying
[junit4] 2> 1605869 INFO (qtp1004936765-21166) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [checkpointColl_shard1_replica_n1] webapp=/solr path=/update params={_stateVer_=checkpointColl:4&collection=checkpointColl&wt=javabin&version=2}{add=[topic1 (1665100544159514624)]} 0 10
[junit4] 2> 1605869 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [checkpointColl_shard1_replica_n1] webapp=/solr path=/update params={_stateVer_=checkpointColl:4&collection=checkpointColl&wt=javabin&version=2}{add=[topic1 (1665100544158466048)]} 0 15
[junit4] 2> 1605869 INFO (qtp1004936765-21167) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.u.p.LogUpdateProcessorFactory [checkpointColl_shard1_replica_n1] webapp=/solr path=/update params={_stateVer_=checkpointColl:4&collection=checkpointColl&wt=javabin&version=2}{add=[topic1 (1665100544160563200)]} 0 13
[junit4] 2> 1605946 INFO (qtp1004936765-21238) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1605964 INFO (qtp1004936765-21164) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1605974 ERROR (qtp1004936765-21166) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.s.i.s.DaemonStream There is already a running daemon named 'daemon0', no action taken
[junit4] 2> 1605974 INFO (qtp1004936765-21166) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=start&id=daemon0&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1605985 INFO (qtp1004936765-21238) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=stop&id=daemon0&wt=json&version=2.2} status=0 QTime=1
[junit4] 2> 1605995 INFO (qtp1004936765-21164) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1606107 INFO (qtp1004936765-21166) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1606223 INFO (qtp1004936765-21238) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1606333 INFO (qtp1004936765-21164) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1606443 INFO (qtp1004936765-21166) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1606560 INFO (qtp1004936765-21238) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1606672 INFO (qtp1004936765-21164) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1606788 INFO (qtp1004936765-21166) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1606909 INFO (qtp1004936765-21238) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1607019 INFO (qtp1004936765-21238) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1607133 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1607253 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1607380 INFO (qtp1004936765-21238) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1607492 INFO (qtp1004936765-21167) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1607619 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1607737 INFO (qtp1004936765-21238) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1607848 INFO (qtp1004936765-21238) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1607960 INFO (qtp1004936765-21238) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1608078 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1608192 INFO (qtp1004936765-21164) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1608301 INFO (qtp1004936765-21238) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1608414 INFO (qtp1004936765-21165) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1608526 INFO (qtp1004936765-21164) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard1_replica_n1 ] o.a.s.c.S.Request [checkpointColl_shard1_replica_n1] webapp=/solr path=/stream params={indent=off&action=list&wt=json&version=2.2} status=0 QTime=0
[junit4] 2> 1608643 INFO (qtp1004936765-21238) [n:127.0.0.1:59321_solr c:checkpointColl s:shard1 r:core_node2 x:checkpointColl_shard
[...truncated too long message...]
k2Test, SuggesterWFSTTest, DistributedTermsComponentTest, MultiDestinationAuditLoggerTest, UnloadDistributedZkTest, TestJettySolrRunner, DirectUpdateHandlerTest, IndexBasedSpellCheckerTest, TestRestManager, TestDistribDocBasedVersion, TestSubQueryTransformer, DebugComponentTest, TestReloadDeadlock, SolrMetricManagerTest, SolrJmxReporterTest, TestLegacyNumericUtils, TestSolrDeletionPolicy2, TestBinaryResponseWriter, NodeAddedTriggerTest, ZkCollectionPropsCachingTest, TestSortByMinMaxFunction, SolrInfoBeanTest, TestLRUStatsCache, CollectionStateFormat2Test, ExitableDirectoryReaderTest, TestBackupRepositoryFactory, DistributedIntervalFacetingTest, DynamicMapsTest, RandomizedTaggerTest, ClassificationUpdateProcessorTest, TestUseDocValuesAsStored, TestPostingsSolrHighlighter, SegmentsInfoRequestHandlerTest, TestConfigSetImmutable, IndexSizeTriggerSizeEstimationTest, CollectionReloadTest, URLClassifyProcessorTest, TestExceedMaxTermLength, UpdateLogTest, CoreAdminHandlerTest, ComputePlanActionTest, BooleanFieldTest, TestSolr4Spatial, QueryEqualityTest, DistributedQueryComponentCustomSortTest, SplitShardTest, TestStressRecovery, TriggerSetPropertiesIntegrationTest, HdfsRecoverLeaseTest, TestRuleBasedAuthorizationPlugin, TestPivotHelperCode, ByteBuffersDirectoryFactoryTest, BlockDirectoryTest, PrimitiveFieldTypeTest, MultiSolrCloudTestCaseTest, TestSchemaField, ResponseHeaderTest, TestJsonFacetErrors, TestSolrTestCaseJ4, TestSolrConfigHandlerConcurrent, TestCoreBackup, TestNumericTokenStream, RequestLoggingTest, TestDocumentBuilder, TestGroupingSearch, TestJoin, TestRandomDVFaceting, TestRandomFaceting, TestSimpleTrackingShardHandler, TestEmbeddedSolrServerAdminHandler, TestEmbeddedSolrServerConstructors, AliasIntegrationTest, ChaosMonkeySafeLeaderWithPullReplicasTest, DeleteStatusTest, DistribDocExpirationUpdateProcessorTest, LeaderFailoverAfterPartitionTest, MetricsHistoryIntegrationTest, MigrateRouteKeyTest, ReplaceNodeNoTargetTest, ReplaceNodeTest, SharedFSAutoReplicaFailoverTest, SliceStateTest, SolrCLIZkUtilsTest, SolrCloudExampleTest, TestCloudInspectUtil, TestCloudPhrasesIdentificationComponent, TestCloudPseudoReturnFields, TestCloudSearcherWarming, TestRandomRequestDistribution, TestSolrCloudWithKerberosAlt, TestSolrCloudWithSecureImpersonation, TestStressInPlaceUpdates, ConcurrentDeleteAndCreateCollectionTest, CustomCollectionTest, TestCollectionAPI, IndexSizeTriggerMixedBoundsTest, TestSimExecutePlanAction, TestSimGenericDistributedQueue, TestSimTriggerIntegration, CdcrReplicationHandlerTest, CdcrRequestHandlerTest, CdcrVersionReplicationTest, HdfsNNFailoverTest, TestCorePropertiesReload, TestCustomStream, TestMergePolicyConfig, TestNRTOpen, TestReloadAndDeleteDocs, TestSolrDeletionPolicy1, TestSolrCoreSnapshots, TestDistribPackageStore, TestRestoreCore, V2StandaloneTest, DaemonStreamApiTest, MetricsHandlerTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=MetricsHandlerTest -Dtests.seed=CEDFF848383AA49 -Dtests.slow=true -Dtests.locale=ro-MD -Dtests.timezone=Africa/Luanda -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J0 | MetricsHandlerTest (suite) <<<
[junit4] > Throwable #1: java.lang.AssertionError: ObjectTracker found 1 object(s) that were not released!!! [InternalHttpClient]
[junit4] > org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient
[junit4] > at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
[junit4] > at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:339)
[junit4] > at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:348)
[junit4] > at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:286)
[junit4] > at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:273)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.<init>(CloudSolrClient.java:101)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient$Builder.build(CloudSolrClient.java:473)
[junit4] > at org.apache.solr.client.solrj.io.SolrClientCache.getCloudSolrClient(SolrClientCache.java:66)
[junit4] > at org.apache.solr.client.solrj.io.stream.UpdateStream.setCloudSolrClient(UpdateStream.java:290)
[junit4] > at org.apache.solr.client.solrj.io.stream.UpdateStream.open(UpdateStream.java:115)
[junit4] > at org.apache.solr.client.solrj.io.stream.DaemonStream$StreamRunner.stream(DaemonStream.java:335)
[junit4] > at org.apache.solr.client.solrj.io.stream.DaemonStream$StreamRunner.run(DaemonStream.java:319)
[junit4] > at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
[junit4] > at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] > at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:210)
[junit4] > at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
[junit4] > at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:830)
[junit4] > expected null, but was:<ObjectTracker found 1 object(s) that were not released!!! [InternalHttpClient]
[junit4] > org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient
[junit4] > at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
[junit4] > at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:339)
[junit4] > at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:348)
[junit4] > at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:286)
[junit4] > at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:273)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.<init>(CloudSolrClient.java:101)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient$Builder.build(CloudSolrClient.java:473)
[junit4] > at org.apache.solr.client.solrj.io.SolrClientCache.getCloudSolrClient(SolrClientCache.java:66)
[junit4] > at org.apache.solr.client.solrj.io.stream.UpdateStream.setCloudSolrClient(UpdateStream.java:290)
[junit4] > at org.apache.solr.client.solrj.io.stream.UpdateStream.open(UpdateStream.java:115)
[junit4] > at org.apache.solr.client.solrj.io.stream.DaemonStream$StreamRunner.stream(DaemonStream.java:335)
[junit4] > at org.apache.solr.client.solrj.io.stream.DaemonStream$StreamRunner.run(DaemonStream.java:319)
[junit4] > at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
[junit4] > at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
[junit4] > at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:210)
[junit4] > at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
[junit4] > at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:830)
[junit4] > >
[junit4] > at __randomizedtesting.SeedInfo.seed([CEDFF848383AA49]:0)
[junit4] > at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:334)
[junit4] > at jdk.internal.reflect.GeneratedMethodAccessor39.invoke(Unknown Source)
[junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:567)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:830)
[junit4] Completed [682/909 (2!)] on J0 in 71.84s, 5 tests, 1 failure <<< FAILURES!
[...truncated 53312 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/5927/consoleText
[repro] Revision: 13bbe6033378bd9f3af82f8093f870a5e0df1443
[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseParallelGC"
[repro] Repro line: ant test -Dtestcase=DaemonStreamApiTest -Dtests.method=testAPIs -Dtests.seed=CEDFF848383AA49 -Dtests.slow=true -Dtests.locale=dje -Dtests.timezone=Pacific/Kwajalein -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] Repro line: ant test -Dtestcase=DaemonStreamApiTest -Dtests.seed=CEDFF848383AA49 -Dtests.slow=true -Dtests.locale=dje -Dtests.timezone=Pacific/Kwajalein -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] Repro line: ant test -Dtestcase=MetricsHandlerTest -Dtests.seed=CEDFF848383AA49 -Dtests.slow=true -Dtests.locale=ro-MD -Dtests.timezone=Africa/Luanda -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] DaemonStreamApiTest
[repro] MetricsHandlerTest
[repro] ant compile-test
[...truncated 3152 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=10 -Dtests.class="*.DaemonStreamApiTest|*.MetricsHandlerTest" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseParallelGC" -Dtests.seed=CEDFF848383AA49 -Dtests.slow=true -Dtests.locale=dje -Dtests.timezone=Pacific/Kwajalein -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[...truncated 121 lines...]
[repro] Failures w/original seeds:
[repro] 0/5 failed: org.apache.solr.handler.admin.DaemonStreamApiTest
[repro] 0/5 failed: org.apache.solr.handler.admin.MetricsHandlerTest
[repro] Exiting with code 0
[...truncated 73 lines...]