You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2020/05/26 16:01:31 UTC
[JENKINS] Lucene-Solr-master-MacOSX (64bit/jdk-13.0.2) - Build #
6073 - Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/6073/
Java: 64bit/jdk-13.0.2 -XX:-UseCompressedOops -XX:+UseParallelGC
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.client.ref_guide_examples.ZkConfigFilesTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.client.ref_guide_examples.ZkConfigFilesTest: 1) Thread[id=1568, name=SessionTracker, state=TIMED_WAITING, group=TGRP-ZkConfigFilesTest] at java.base@13.0.2/java.lang.Thread.sleep(Native Method) at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.client.ref_guide_examples.ZkConfigFilesTest:
1) Thread[id=1568, name=SessionTracker, state=TIMED_WAITING, group=TGRP-ZkConfigFilesTest]
at java.base@13.0.2/java.lang.Thread.sleep(Native Method)
at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
at __randomizedtesting.SeedInfo.seed([60879343B1E129C6]:0)
FAILED: org.apache.solr.client.solrj.impl.CloudSolrClientTest.testRetryUpdatesWhenClusterStateIsStale
Error Message:
Error from server at http://127.0.0.1:54254/solr/stale_state_test_col: Unable to distribute commit operation. No replicas available of types TLOG or NRT
Stack Trace:
org.apache.solr.client.solrj.impl.BaseHttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:54254/solr/stale_state_test_col: Unable to distribute commit operation. No replicas available of types TLOG or NRT
at __randomizedtesting.SeedInfo.seed([60879343B1E129C6:D4B60BAB52085FEA]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:663)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:265)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1147)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:910)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:1022)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:842)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207)
at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:240)
at org.apache.solr.client.solrj.impl.CloudSolrClientTest.testRetryUpdatesWhenClusterStateIsStale(CloudSolrClientTest.java:906)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:567)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
at org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:239)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
at java.base/java.lang.Thread.run(Thread.java:830)
Build Log:
[...truncated 16708 lines...]
[junit4] Suite: org.apache.solr.client.ref_guide_examples.ZkConfigFilesTest
[junit4] 2> 137091 INFO (SUITE-ZkConfigFilesTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/server/solr/configsets/_default/conf'
[junit4] 2> 137091 INFO (SUITE-ZkConfigFilesTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 137091 INFO (SUITE-ZkConfigFilesTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.client.ref_guide_examples.ZkConfigFilesTest_60879343B1E129C6-001/data-dir-14-001
[junit4] 2> 137092 INFO (SUITE-ZkConfigFilesTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 137093 INFO (SUITE-ZkConfigFilesTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 137094 INFO (SUITE-ZkConfigFilesTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.client.ref_guide_examples.ZkConfigFilesTest_60879343B1E129C6-001/tempDir-001
[junit4] 2> 137095 INFO (SUITE-ZkConfigFilesTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 137095 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
[junit4] 2> 137096 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 137196 INFO (SUITE-ZkConfigFilesTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port: 54607
[junit4] 2> 137197 INFO (SUITE-ZkConfigFilesTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:54607
[junit4] 2> 137197 INFO (SUITE-ZkConfigFilesTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:54607
[junit4] 2> 137197 INFO (SUITE-ZkConfigFilesTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 54607
[junit4] 2> 137200 INFO (SUITE-ZkConfigFilesTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 137207 INFO (zkConnectionManagerCallback-965-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 137208 INFO (SUITE-ZkConfigFilesTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 137213 INFO (SUITE-ZkConfigFilesTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 137218 INFO (zkConnectionManagerCallback-967-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 137218 INFO (SUITE-ZkConfigFilesTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 137219 INFO (SUITE-ZkConfigFilesTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 137226 INFO (zkConnectionManagerCallback-969-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 137226 INFO (SUITE-ZkConfigFilesTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 137357 INFO (jetty-launcher-970-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 137357 INFO (jetty-launcher-970-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 137357 INFO (jetty-launcher-970-thread-1) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 13.0.2+8
[junit4] 2> 137359 INFO (jetty-launcher-970-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 137359 INFO (jetty-launcher-970-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 137359 INFO (jetty-launcher-970-thread-1) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 137360 INFO (jetty-launcher-970-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@150b5756{/solr,null,AVAILABLE}
[junit4] 2> 137363 INFO (jetty-launcher-970-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@76f42325{ssl, (ssl, alpn, http/1.1, h2)}{127.0.0.1:54612}
[junit4] 2> 137363 INFO (jetty-launcher-970-thread-1) [ ] o.e.j.s.Server Started @137483ms
[junit4] 2> 137363 INFO (jetty-launcher-970-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=54612}
[junit4] 2> 137363 ERROR (jetty-launcher-970-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 137363 INFO (jetty-launcher-970-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 137363 INFO (jetty-launcher-970-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 137363 INFO (jetty-launcher-970-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 137363 INFO (jetty-launcher-970-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 137363 INFO (jetty-launcher-970-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-05-26T15:39:40.218995Z
[junit4] 2> 137365 INFO (jetty-launcher-970-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 137369 INFO (zkConnectionManagerCallback-972-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 137369 INFO (jetty-launcher-970-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 137370 INFO (jetty-launcher-970-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 137491 INFO (jetty-launcher-970-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 137493 WARN (jetty-launcher-970-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@5847a661[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 137493 WARN (jetty-launcher-970-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@5847a661[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 137498 WARN (jetty-launcher-970-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@7cf1cac0[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 137498 WARN (jetty-launcher-970-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@7cf1cac0[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 137499 INFO (jetty-launcher-970-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54607/solr
[junit4] 2> 137500 INFO (jetty-launcher-970-thread-1) [n:127.0.0.1:54612_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 137505 INFO (zkConnectionManagerCallback-983-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 137505 INFO (jetty-launcher-970-thread-1) [n:127.0.0.1:54612_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 137806 INFO (jetty-launcher-970-thread-1) [n:127.0.0.1:54612_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:54612_solr
[junit4] 2> 137810 INFO (jetty-launcher-970-thread-1) [n:127.0.0.1:54612_solr ] o.a.s.c.Overseer Overseer (id=72108871613939716-127.0.0.1:54612_solr-n_0000000000) starting
[junit4] 2> 137828 INFO (OverseerStateUpdate-72108871613939716-127.0.0.1:54612_solr-n_0000000000) [n:127.0.0.1:54612_solr ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:54612_solr
[junit4] 2> 137830 INFO (jetty-launcher-970-thread-1) [n:127.0.0.1:54612_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54612_solr
[junit4] 2> 137835 INFO (OverseerStateUpdate-72108871613939716-127.0.0.1:54612_solr-n_0000000000) [n:127.0.0.1:54612_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 137851 INFO (jetty-launcher-970-thread-1) [n:127.0.0.1:54612_solr ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 137852 WARN (jetty-launcher-970-thread-1) [n:127.0.0.1:54612_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 137885 INFO (jetty-launcher-970-thread-1) [n:127.0.0.1:54612_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 137929 INFO (jetty-launcher-970-thread-1) [n:127.0.0.1:54612_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54612.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61efaf17
[junit4] 2> 137939 INFO (jetty-launcher-970-thread-1) [n:127.0.0.1:54612_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54612.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61efaf17
[junit4] 2> 137939 INFO (jetty-launcher-970-thread-1) [n:127.0.0.1:54612_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_54612.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@61efaf17
[junit4] 2> 137941 INFO (jetty-launcher-970-thread-1) [n:127.0.0.1:54612_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J0/temp/solr.client.ref_guide_examples.ZkConfigFilesTest_60879343B1E129C6-001/tempDir-001/node1/.
[junit4] 2> 137952 INFO (SUITE-ZkConfigFilesTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=1
[junit4] 2> 137953 INFO (SUITE-ZkConfigFilesTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 137961 INFO (zkConnectionManagerCallback-1000-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 137961 INFO (SUITE-ZkConfigFilesTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 137968 INFO (SUITE-ZkConfigFilesTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 137985 INFO (SUITE-ZkConfigFilesTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:54607/solr ready
[junit4] 2> 138013 INFO (TEST-ZkConfigFilesTest.testCanUploadConfigToZk-seed#[60879343B1E129C6]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCanUploadConfigToZk
[junit4] 2> 138169 INFO (TEST-ZkConfigFilesTest.testCanUploadConfigToZk-seed#[60879343B1E129C6]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 138174 INFO (zkConnectionManagerCallback-1002-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 138174 INFO (TEST-ZkConfigFilesTest.testCanUploadConfigToZk-seed#[60879343B1E129C6]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 138767 INFO (TEST-ZkConfigFilesTest.testCanUploadConfigToZk-seed#[60879343B1E129C6]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testCanUploadConfigToZk
[junit4] 2> 138873 INFO (jetty-closer-1003-thread-1) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1581760106
[junit4] 2> 138873 INFO (jetty-closer-1003-thread-1) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:54612_solr
[junit4] 2> 138874 INFO (jetty-closer-1003-thread-1) [ ] o.a.s.c.ZkController Publish this node as DOWN...
[junit4] 2> 138874 INFO (jetty-closer-1003-thread-1) [ ] o.a.s.c.ZkController Publish node=127.0.0.1:54612_solr as DOWN
[junit4] 2> 138880 INFO (jetty-closer-1003-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 1000 transient cores
[junit4] 2> 138881 INFO (jetty-closer-1003-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
[junit4] 2> 138881 INFO (jetty-closer-1003-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@55f3fed1: rootName = solr_54612, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@51589fc9
[junit4] 2> 138886 INFO (jetty-closer-1003-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
[junit4] 2> 138886 INFO (jetty-closer-1003-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@80157f5: rootName = solr_54612, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@b63bd10
[junit4] 2> 138888 INFO (jetty-closer-1003-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
[junit4] 2> 138888 INFO (jetty-closer-1003-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@702cc258: rootName = solr_54612, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@7d668d16
[junit4] 2> 138888 INFO (jetty-closer-1003-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
[junit4] 2> 138889 INFO (closeThreadPool-1008-thread-2) [ ] o.a.s.c.Overseer Overseer (id=72108871613939716-127.0.0.1:54612_solr-n_0000000000) closing
[junit4] 2> 138889 INFO (OverseerStateUpdate-72108871613939716-127.0.0.1:54612_solr-n_0000000000) [n:127.0.0.1:54612_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:54612_solr
[junit4] 2> 138890 INFO (OverseerAutoScalingTriggerThread-72108871613939716-127.0.0.1:54612_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 138894 INFO (closeThreadPool-1008-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72108871613939716-127.0.0.1:54612_solr-n_0000000000) closing
[junit4] 2> 139008 INFO (jetty-closer-1003-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72108871613939716-127.0.0.1:54612_solr-n_0000000000) closing
[junit4] 2> 139011 INFO (jetty-closer-1003-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@76f42325{ssl, (ssl, alpn, http/1.1, h2)}{127.0.0.1:0}
[junit4] 2> 139012 INFO (jetty-closer-1003-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@150b5756{/solr,null,UNAVAILABLE}
[junit4] 2> 139012 INFO (jetty-closer-1003-thread-1) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 139013 INFO (SUITE-ZkConfigFilesTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
[junit4] 2> 139235 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 2 /solr/aliases.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 2 /solr/clusterstate.json
[junit4] 2> 2 /solr/clusterprops.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/live_nodes
[junit4] 2> 2 /solr/overseer/queue
[junit4] 2> 2 /solr/collections
[junit4] 2>
[junit4] 2> 139238 INFO (SUITE-ZkConfigFilesTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:54607
[junit4] 2> 139238 INFO (SUITE-ZkConfigFilesTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:54607
[junit4] 2> 139238 INFO (SUITE-ZkConfigFilesTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 54607
[junit4] 2> 139238 INFO (SUITE-ZkConfigFilesTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
[junit4] 2> May 26, 2020 3:39:42 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> May 26, 2020 3:39:52 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.client.ref_guide_examples.ZkConfigFilesTest:
[junit4] 2> 1) Thread[id=1568, name=SessionTracker, state=TIMED_WAITING, group=TGRP-ZkConfigFilesTest]
[junit4] 2> at java.base@13.0.2/java.lang.Thread.sleep(Native Method)
[junit4] 2> at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
[junit4] 2> May 26, 2020 3:39:52 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=1568, name=SessionTracker, state=TIMED_WAITING, group=TGRP-ZkConfigFilesTest]
[junit4] 2> 149279 ERROR (SessionTracker) [ ] o.a.z.s.ZooKeeperCriticalThread Severe unrecoverable error, from thread : SessionTracker
[junit4] 2> => java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.base/java.lang.Thread.sleep(Native Method)
[junit4] 2> java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method) [?:?]
[junit4] 2> at org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) ~[zookeeper-3.5.7.jar:3.5.7]
[junit4] 2> May 26, 2020 3:39:52 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: All leaked threads terminated.
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene86): {}, docValues:{}, maxPointsInLeafNode=963, maxMBSortInHeap=5.583817402382175, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@784ad0c1), locale=ug-CN, timezone=CNT
[junit4] 2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 13.0.2 (64-bit)/cpus=6,threads=1,free=134559824,total=298319872
[junit4] 2> NOTE: All tests run in this JVM: [LessThanEqualToEvaluatorTest, ConcurrentUpdateHttp2SolrClientMultiCollectionTest, GraphTest, SolrQueryTest, SolrDocumentTest, CloudHttp2SolrClientMultiConstructorTest, TermsResponseTest, TestCoreAdmin, GetByIdTest, JsonRequestApiHeatmapFacetingTest, TestSolrJErrorHandling, SolrExampleStreamingBinaryHttp2Test, FacetFieldTest, TestJsonRecordReader, HeatmapFacetMapTest, TestV1toV2ApiMapper, GreaterThanEvaluatorTest, MathExpressionTest, QueryFacetMapTest, HttpSolrClientBuilderTest, TestTimeSource, ZkConfigFilesTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ZkConfigFilesTest -Dtests.seed=60879343B1E129C6 -Dtests.slow=true -Dtests.locale=ug-CN -Dtests.timezone=CNT -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J0 | ZkConfigFilesTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.client.ref_guide_examples.ZkConfigFilesTest:
[junit4] > 1) Thread[id=1568, name=SessionTracker, state=TIMED_WAITING, group=TGRP-ZkConfigFilesTest]
[junit4] > at java.base@13.0.2/java.lang.Thread.sleep(Native Method)
[junit4] > at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151)
[junit4] > at __randomizedtesting.SeedInfo.seed([60879343B1E129C6]:0)
[junit4] Completed [74/208 (1!)] on J0 in 12.48s, 1 test, 1 error <<< FAILURES!
[...truncated 132 lines...]
[junit4] Suite: org.apache.solr.client.solrj.impl.CloudSolrClientTest
[junit4] 2> 93518 INFO (SUITE-CloudSolrClientTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/server/solr/configsets/_default/conf'
[junit4] 2> 93518 INFO (SUITE-CloudSolrClientTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 93522 INFO (SUITE-CloudSolrClientTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J3/temp/solr.client.solrj.impl.CloudSolrClientTest_60879343B1E129C6-001/data-dir-6-001
[junit4] 2> 93522 WARN (SUITE-CloudSolrClientTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=109 numCloses=109
[junit4] 2> 93522 INFO (SUITE-CloudSolrClientTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 93523 INFO (SUITE-CloudSolrClientTest-seed#[60879343B1E129C6]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 93528 INFO (TEST-CloudSolrClientTest.testOverwriteOption-seed#[60879343B1E129C6]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testOverwriteOption
[junit4] 2> 93529 INFO (TEST-CloudSolrClientTest.testOverwriteOption-seed#[60879343B1E129C6]) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J3/temp/solr.client.solrj.impl.CloudSolrClientTest_60879343B1E129C6-001/tempDir-001
[junit4] 2> 93529 INFO (TEST-CloudSolrClientTest.testOverwriteOption-seed#[60879343B1E129C6]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 93530 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
[junit4] 2> 93530 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 93633 INFO (TEST-CloudSolrClientTest.testOverwriteOption-seed#[60879343B1E129C6]) [ ] o.a.s.c.ZkTestServer start zk server on port: 53658
[junit4] 2> 93634 INFO (TEST-CloudSolrClientTest.testOverwriteOption-seed#[60879343B1E129C6]) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:53658
[junit4] 2> 93634 INFO (TEST-CloudSolrClientTest.testOverwriteOption-seed#[60879343B1E129C6]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:53658
[junit4] 2> 93634 INFO (TEST-CloudSolrClientTest.testOverwriteOption-seed#[60879343B1E129C6]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 53658
[junit4] 2> 93639 INFO (TEST-CloudSolrClientTest.testOverwriteOption-seed#[60879343B1E129C6]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 93645 INFO (zkConnectionManagerCallback-388-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 93646 INFO (TEST-CloudSolrClientTest.testOverwriteOption-seed#[60879343B1E129C6]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 93654 INFO (TEST-CloudSolrClientTest.testOverwriteOption-seed#[60879343B1E129C6]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 93773 INFO (zkConnectionManagerCallback-390-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 93776 INFO (TEST-CloudSolrClientTest.testOverwriteOption-seed#[60879343B1E129C6]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 93778 INFO (TEST-CloudSolrClientTest.testOverwriteOption-seed#[60879343B1E129C6]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 93783 INFO (zkConnectionManagerCallback-392-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 93783 INFO (TEST-CloudSolrClientTest.testOverwriteOption-seed#[60879343B1E129C6]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 93893 INFO (jetty-launcher-393-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 93893 INFO (jetty-launcher-393-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 93893 INFO (jetty-launcher-393-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 93893 INFO (jetty-launcher-393-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 93893 INFO (jetty-launcher-393-thread-2) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 13.0.2+8
[junit4] 2> 93893 INFO (jetty-launcher-393-thread-3) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 13.0.2+8
[junit4] 2> 93893 INFO (jetty-launcher-393-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 93893 INFO (jetty-launcher-393-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 93893 INFO (jetty-launcher-393-thread-1) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 13.0.2+8
[junit4] 2> 93898 INFO (jetty-launcher-393-thread-3) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 93898 INFO (jetty-launcher-393-thread-3) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 93898 INFO (jetty-launcher-393-thread-3) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 93898 INFO (jetty-launcher-393-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 93899 INFO (jetty-launcher-393-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 93899 INFO (jetty-launcher-393-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 93899 INFO (jetty-launcher-393-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 93899 INFO (jetty-launcher-393-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 93899 INFO (jetty-launcher-393-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@55f98c1d{/solr,null,AVAILABLE}
[junit4] 2> 93899 INFO (jetty-launcher-393-thread-2) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 93899 INFO (jetty-launcher-393-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6e52f8e{/solr,null,AVAILABLE}
[junit4] 2> 93899 INFO (jetty-launcher-393-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5a82411e{/solr,null,AVAILABLE}
[junit4] 2> 93904 INFO (jetty-launcher-393-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6f3d2563{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:53672}
[junit4] 2> 93904 INFO (jetty-launcher-393-thread-2) [ ] o.e.j.s.Server Started @93984ms
[junit4] 2> 93904 INFO (jetty-launcher-393-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=53672}
[junit4] 2> 93904 INFO (jetty-launcher-393-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6180b21e{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:53673}
[junit4] 2> 93904 INFO (jetty-launcher-393-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@ac82677{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:53671}
[junit4] 2> 93904 INFO (jetty-launcher-393-thread-3) [ ] o.e.j.s.Server Started @93985ms
[junit4] 2> 93904 INFO (jetty-launcher-393-thread-1) [ ] o.e.j.s.Server Started @93985ms
[junit4] 2> 93904 INFO (jetty-launcher-393-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=53673}
[junit4] 2> 93904 INFO (jetty-launcher-393-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=53671}
[junit4] 2> 93905 ERROR (jetty-launcher-393-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 93905 INFO (jetty-launcher-393-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 93905 ERROR (jetty-launcher-393-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 93905 INFO (jetty-launcher-393-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 93905 INFO (jetty-launcher-393-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 93905 INFO (jetty-launcher-393-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 93905 INFO (jetty-launcher-393-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 93905 INFO (jetty-launcher-393-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 93905 INFO (jetty-launcher-393-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 93905 ERROR (jetty-launcher-393-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 93905 INFO (jetty-launcher-393-thread-3) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 93905 INFO (jetty-launcher-393-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 93905 INFO (jetty-launcher-393-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-05-26T15:38:56.721265Z
[junit4] 2> 93905 INFO (jetty-launcher-393-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-05-26T15:38:56.721302Z
[junit4] 2> 93905 INFO (jetty-launcher-393-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 93905 INFO (jetty-launcher-393-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 93905 INFO (jetty-launcher-393-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 93905 INFO (jetty-launcher-393-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-05-26T15:38:56.721416Z
[junit4] 2> 93906 INFO (jetty-launcher-393-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 93906 INFO (jetty-launcher-393-thread-3) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 93907 INFO (jetty-launcher-393-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 93911 INFO (zkConnectionManagerCallback-399-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 93911 INFO (jetty-launcher-393-thread-3) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 93912 INFO (zkConnectionManagerCallback-396-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 93912 INFO (jetty-launcher-393-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 93912 INFO (zkConnectionManagerCallback-397-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 93912 INFO (jetty-launcher-393-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 93914 INFO (jetty-launcher-393-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 93914 INFO (jetty-launcher-393-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 93915 INFO (jetty-launcher-393-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 94036 INFO (jetty-launcher-393-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 94039 WARN (jetty-launcher-393-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@35409[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 94040 WARN (jetty-launcher-393-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@35409[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 94045 WARN (jetty-launcher-393-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@34d671b9[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 94045 WARN (jetty-launcher-393-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@34d671b9[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 94046 INFO (jetty-launcher-393-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53658/solr
[junit4] 2> 94047 INFO (jetty-launcher-393-thread-2) [n:127.0.0.1:53672_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 94051 INFO (zkConnectionManagerCallback-410-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 94051 INFO (jetty-launcher-393-thread-2) [n:127.0.0.1:53672_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 94139 INFO (jetty-launcher-393-thread-3) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 94141 WARN (jetty-launcher-393-thread-3) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@4b6ae21a[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 94141 WARN (jetty-launcher-393-thread-3) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@4b6ae21a[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 94146 WARN (jetty-launcher-393-thread-3) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@181aaf2d[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 94146 WARN (jetty-launcher-393-thread-3) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@181aaf2d[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 94147 INFO (jetty-launcher-393-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53658/solr
[junit4] 2> 94148 INFO (jetty-launcher-393-thread-3) [n:127.0.0.1:53671_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 94152 INFO (zkConnectionManagerCallback-421-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 94152 INFO (jetty-launcher-393-thread-3) [n:127.0.0.1:53671_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 94248 INFO (jetty-launcher-393-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 94250 WARN (jetty-launcher-393-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@32749e59[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 94250 WARN (jetty-launcher-393-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@32749e59[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 94256 WARN (jetty-launcher-393-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@646de286[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 94256 WARN (jetty-launcher-393-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@646de286[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 94257 INFO (jetty-launcher-393-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53658/solr
[junit4] 2> 94258 INFO (jetty-launcher-393-thread-1) [n:127.0.0.1:53673_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 94263 INFO (zkConnectionManagerCallback-432-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 94263 INFO (jetty-launcher-393-thread-1) [n:127.0.0.1:53673_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 94837 INFO (jetty-launcher-393-thread-2) [n:127.0.0.1:53672_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:53672_solr
[junit4] 2> 94841 INFO (jetty-launcher-393-thread-2) [n:127.0.0.1:53672_solr ] o.a.s.c.Overseer Overseer (id=72108868756439046-127.0.0.1:53672_solr-n_0000000000) starting
[junit4] 2> 94877 INFO (OverseerStateUpdate-72108868756439046-127.0.0.1:53672_solr-n_0000000000) [n:127.0.0.1:53672_solr ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:53672_solr
[junit4] 2> 94884 INFO (jetty-launcher-393-thread-2) [n:127.0.0.1:53672_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53672_solr
[junit4] 2> 94902 INFO (zkCallback-409-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 94914 INFO (jetty-launcher-393-thread-2) [n:127.0.0.1:53672_solr ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 94915 WARN (jetty-launcher-393-thread-2) [n:127.0.0.1:53672_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 94967 INFO (jetty-launcher-393-thread-2) [n:127.0.0.1:53672_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 95018 INFO (jetty-launcher-393-thread-1) [n:127.0.0.1:53673_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 95030 INFO (jetty-launcher-393-thread-2) [n:127.0.0.1:53672_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53672.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40da8a30
[junit4] 2> 95114 INFO (jetty-launcher-393-thread-2) [n:127.0.0.1:53672_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53672.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40da8a30
[junit4] 2> 95114 INFO (jetty-launcher-393-thread-2) [n:127.0.0.1:53672_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53672.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40da8a30
[junit4] 2> 95116 INFO (jetty-launcher-393-thread-2) [n:127.0.0.1:53672_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J3/temp/solr.client.solrj.impl.CloudSolrClientTest_60879343B1E129C6-001/tempDir-001/node2/.
[junit4] 2> 95162 INFO (jetty-launcher-393-thread-1) [n:127.0.0.1:53673_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:53673_solr as DOWN
[junit4] 2> 95178 INFO (jetty-launcher-393-thread-3) [n:127.0.0.1:53671_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 95187 INFO (jetty-launcher-393-thread-1) [n:127.0.0.1:53673_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 1000 transient cores
[junit4] 2> 95187 INFO (jetty-launcher-393-thread-1) [n:127.0.0.1:53673_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53673_solr
[junit4] 2> 95205 INFO (zkCallback-409-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 95207 INFO (zkCallback-431-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 95220 INFO (zkCallback-420-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 95226 INFO (jetty-launcher-393-thread-1) [n:127.0.0.1:53673_solr ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 95227 WARN (jetty-launcher-393-thread-1) [n:127.0.0.1:53673_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 95268 INFO (jetty-launcher-393-thread-3) [n:127.0.0.1:53671_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:53671_solr as DOWN
[junit4] 2> 95285 INFO (jetty-launcher-393-thread-1) [n:127.0.0.1:53673_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 95286 INFO (jetty-launcher-393-thread-3) [n:127.0.0.1:53671_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 1000 transient cores
[junit4] 2> 95287 INFO (jetty-launcher-393-thread-3) [n:127.0.0.1:53671_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53671_solr
[junit4] 2> 95301 INFO (zkCallback-409-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 95301 INFO (zkCallback-431-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 95303 INFO (zkCallback-420-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 95337 INFO (jetty-launcher-393-thread-3) [n:127.0.0.1:53671_solr ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 95338 WARN (jetty-launcher-393-thread-3) [n:127.0.0.1:53671_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 95362 INFO (jetty-launcher-393-thread-1) [n:127.0.0.1:53673_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53673.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40da8a30
[junit4] 2> 95371 INFO (jetty-launcher-393-thread-3) [n:127.0.0.1:53671_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 95413 INFO (jetty-launcher-393-thread-1) [n:127.0.0.1:53673_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53673.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40da8a30
[junit4] 2> 95413 INFO (jetty-launcher-393-thread-1) [n:127.0.0.1:53673_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53673.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40da8a30
[junit4] 2> 95414 INFO (jetty-launcher-393-thread-1) [n:127.0.0.1:53673_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J3/temp/solr.client.solrj.impl.CloudSolrClientTest_60879343B1E129C6-001/tempDir-001/node1/.
[junit4] 2> 95423 INFO (jetty-launcher-393-thread-3) [n:127.0.0.1:53671_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53671.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40da8a30
[junit4] 2> 95439 INFO (jetty-launcher-393-thread-3) [n:127.0.0.1:53671_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53671.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40da8a30
[junit4] 2> 95440 INFO (jetty-launcher-393-thread-3) [n:127.0.0.1:53671_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53671.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40da8a30
[junit4] 2> 95442 INFO (jetty-launcher-393-thread-3) [n:127.0.0.1:53671_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J3/temp/solr.client.solrj.impl.CloudSolrClientTest_60879343B1E129C6-001/tempDir-001/node3/.
[junit4] 2> 95455 INFO (TEST-CloudSolrClientTest.testOverwriteOption-seed#[60879343B1E129C6]) [ ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=3
[junit4] 2> 95457 INFO (TEST-CloudSolrClientTest.testOverwriteOption-seed#[60879343B1E129C6]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 95460 INFO (zkConnectionManagerCallback-465-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 95461 INFO (TEST-CloudSolrClientTest.testOverwriteOption-seed#[60879343B1E129C6]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 95469 INFO (TEST-CloudSolrClientTest.testOverwriteOption-seed#[60879343B1E129C6]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 95491 INFO (TEST-CloudSolrClientTest.testOverwriteOption-seed#[60879343B1E129C6]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:53658/solr ready
[junit4] 2> 95533 INFO (qtp1643829036-773) [n:127.0.0.1:53672_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 95540 INFO (qtp1643829036-773) [n:127.0.0.1:53672_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=7
[junit4] 2> 95545 INFO (qtp1643829036-779) [n:127.0.0.1:53672_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=3320c025-466c-4c31-a311-710001f27bde&collection.configName=conf&name=overwrite&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 95556 INFO (qtp1643829036-779) [n:127.0.0.1:53672_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=3320c025-466c-4c31-a311-710001f27bde&collection.configName=conf&name=overwrite&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=11
[junit4] 2> 95559 INFO (qtp1643829036-770) [n:127.0.0.1:53672_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=3320c025-466c-4c31-a311-710001f27bde&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 95577 INFO (qtp1643829036-770) [n:127.0.0.1:53672_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=3320c025-466c-4c31-a311-710001f27bde&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=18
[junit4] 2> 95578 INFO (OverseerThreadFactory-443-thread-1-processing-n:127.0.0.1:53672_solr) [n:127.0.0.1:53672_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection overwrite
[junit4] 2> 95721 INFO (qtp1643829036-777) [n:127.0.0.1:53672_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 1000 transient cores
[junit4] 2> 95721 INFO (qtp1643829036-777) [n:127.0.0.1:53672_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 95724 INFO (qtp1866944902-772) [n:127.0.0.1:53673_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 95727 INFO (qtp68147334-768) [n:127.0.0.1:53671_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 95730 INFO (qtp1643829036-779) [n:127.0.0.1:53672_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 95732 INFO (qtp1866944902-775) [n:127.0.0.1:53673_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 95733 INFO (qtp68147334-771) [n:127.0.0.1:53671_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 95761 INFO (OverseerStateUpdate-72108868756439046-127.0.0.1:53672_solr-n_0000000000) [n:127.0.0.1:53672_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"overwrite",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"overwrite_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:53671/solr",
[junit4] 2> "node_name":"127.0.0.1:53671_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 95974 INFO (qtp68147334-774) [n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf&newCollection=true&collection=overwrite&version=2&replicaType=NRT&async=3320c025-466c-4c31-a311-710001f27bde782392329995725&coreNodeName=core_node2&name=overwrite_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin} status=0 QTime=2
[junit4] 2> 95975 INFO (parallelCoreAdminExecutor-455-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 CREATE) [n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf&newCollection=true&collection=overwrite&version=2&replicaType=NRT&async=3320c025-466c-4c31-a311-710001f27bde782392329995725&coreNodeName=core_node2&name=overwrite_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin
[junit4] 2> 95997 INFO (qtp68147334-771) [n:127.0.0.1:53671_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 3320c025-466c-4c31-a311-710001f27bde782392329995725
[junit4] 2> 96000 INFO (qtp68147334-771) [n:127.0.0.1:53671_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=3320c025-466c-4c31-a311-710001f27bde782392329995725&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 96029 INFO (parallelCoreAdminExecutor-455-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 CREATE) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 96046 INFO (parallelCoreAdminExecutor-455-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 CREATE) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=test
[junit4] 2> 96249 WARN (parallelCoreAdminExecutor-455-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 CREATE) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiople copyFields (2)
[junit4] 2> 96249 WARN (parallelCoreAdminExecutor-455-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 CREATE) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiople copyFields (3)
[junit4] 2> 96250 INFO (parallelCoreAdminExecutor-455-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 CREATE) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 96250 INFO (parallelCoreAdminExecutor-455-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 CREATE) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'overwrite_shard1_replica_n1' using configuration from configset conf, trusted=true
[junit4] 2> 96250 INFO (parallelCoreAdminExecutor-455-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 CREATE) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53671.solr.core.overwrite.shard1.replica_n1' (registry 'solr.core.overwrite.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@40da8a30
[junit4] 2> 96256 INFO (parallelCoreAdminExecutor-455-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 CREATE) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.c.SolrCore [[overwrite_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J3/temp/solr.client.solrj.impl.CloudSolrClientTest_60879343B1E129C6-001/tempDir-001/node3/./overwrite_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J3/temp/solr.client.solrj.impl.CloudSolrClientTest_60879343B1E129C6-001/tempDir-001/node3/./overwrite_shard1_replica_n1/data/]
[junit4] 2> 96525 INFO (parallelCoreAdminExecutor-455-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 CREATE) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 96525 INFO (parallelCoreAdminExecutor-455-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 CREATE) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 96528 INFO (parallelCoreAdminExecutor-455-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 CREATE) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 96528 INFO (parallelCoreAdminExecutor-455-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 CREATE) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 96548 INFO (parallelCoreAdminExecutor-455-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 CREATE) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 96554 INFO (parallelCoreAdminExecutor-455-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 CREATE) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 96560 INFO (parallelCoreAdminExecutor-455-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 CREATE) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
[junit4] 2> 96560 INFO (parallelCoreAdminExecutor-455-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 CREATE) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1667768033608728576
[junit4] 2> 96575 INFO (searcherExecutor-468-thread-1-processing-x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 r:core_node2 CREATE n:127.0.0.1:53671_solr c:overwrite s:shard1) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.c.SolrCore [overwrite_shard1_replica_n1] Registered new searcher autowarm time: 0 ms: Collection: 'overwrite'
[junit4] 2> 96580 INFO (qtp1643829036-770) [n:127.0.0.1:53672_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=3320c025-466c-4c31-a311-710001f27bde&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 96584 INFO (qtp1643829036-770) [n:127.0.0.1:53672_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=3320c025-466c-4c31-a311-710001f27bde&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=4
[junit4] 2> 96604 INFO (parallelCoreAdminExecutor-455-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 CREATE) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/overwrite/terms/shard1 to Terms{values={core_node2=0}, version=0}
[junit4] 2> 96604 INFO (parallelCoreAdminExecutor-455-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 CREATE) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/overwrite/leaders/shard1
[junit4] 2> 96653 INFO (parallelCoreAdminExecutor-455-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 CREATE) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 96658 INFO (parallelCoreAdminExecutor-455-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 CREATE) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 96659 INFO (parallelCoreAdminExecutor-455-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 CREATE) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:53671/solr/overwrite_shard1_replica_n1/
[junit4] 2> 96663 INFO (parallelCoreAdminExecutor-455-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 CREATE) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 96666 INFO (parallelCoreAdminExecutor-455-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 CREATE) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.c.SyncStrategy http://127.0.0.1:53671/solr/overwrite_shard1_replica_n1/ has no replicas
[junit4] 2> 96667 INFO (parallelCoreAdminExecutor-455-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 CREATE) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/overwrite/leaders/shard1/leader after winning as /collections/overwrite/leader_elect/shard1/election/72108868756439047-core_node2-n_0000000000
[junit4] 2> 96687 INFO (parallelCoreAdminExecutor-455-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 CREATE) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:53671/solr/overwrite_shard1_replica_n1/ shard1
[junit4] 2> 96795 INFO (zkCallback-420-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/overwrite/state.json] for collection [overwrite] has occurred - updating... (live nodes size: [3])
[junit4] 2> 96795 INFO (zkCallback-420-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/overwrite/state.json] for collection [overwrite] has occurred - updating... (live nodes size: [3])
[junit4] 2> 96802 INFO (parallelCoreAdminExecutor-455-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 3320c025-466c-4c31-a311-710001f27bde782392329995725 CREATE) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 96913 INFO (zkCallback-420-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/overwrite/state.json] for collection [overwrite] has occurred - updating... (live nodes size: [3])
[junit4] 2> 96914 INFO (zkCallback-420-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/overwrite/state.json] for collection [overwrite] has occurred - updating... (live nodes size: [3])
[junit4] 2> 96914 INFO (zkCallback-420-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/overwrite/state.json] for collection [overwrite] has occurred - updating... (live nodes size: [3])
[junit4] 2> 97016 INFO (qtp68147334-774) [n:127.0.0.1:53671_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 3320c025-466c-4c31-a311-710001f27bde782392329995725
[junit4] 2> 97018 INFO (qtp68147334-774) [n:127.0.0.1:53671_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=3320c025-466c-4c31-a311-710001f27bde782392329995725&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 97036 INFO (OverseerThreadFactory-443-thread-1-processing-n:127.0.0.1:53672_solr) [n:127.0.0.1:53672_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 97587 INFO (qtp1643829036-773) [n:127.0.0.1:53672_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=3320c025-466c-4c31-a311-710001f27bde&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 97588 INFO (OverseerCollectionConfigSetProcessor-72108868756439046-127.0.0.1:53672_solr-n_0000000000) [n:127.0.0.1:53672_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 97590 INFO (qtp1643829036-773) [n:127.0.0.1:53672_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=3320c025-466c-4c31-a311-710001f27bde&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 97591 INFO (qtp1643829036-777) [n:127.0.0.1:53672_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :deletestatus with params requestid=3320c025-466c-4c31-a311-710001f27bde&action=DELETESTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 97594 INFO (qtp1643829036-777) [n:127.0.0.1:53672_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=3320c025-466c-4c31-a311-710001f27bde&action=DELETESTATUS&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 97594 INFO (TEST-CloudSolrClientTest.testOverwriteOption-seed#[60879343B1E129C6]) [ ] o.a.s.c.MiniSolrCloudCluster waitForActiveCollection: overwrite
[junit4] 2> 97611 INFO (qtp68147334-768) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/overwrite/terms/shard1 to Terms{values={core_node2=1}, version=1}
[junit4] 2> 97611 INFO (qtp68147334-768) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.c.S.Request [overwrite_shard1_replica_n1] webapp=/solr path=/update params={_stateVer_=overwrite:4&wt=javabin&version=2} status=0 QTime=10
[junit4] 2> 97655 INFO (searcherExecutor-468-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 c:overwrite s:shard1 r:core_node2) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.c.SolrCore [overwrite_shard1_replica_n1] Registered new searcher autowarm time: 0 ms: Collection: 'overwrite'
[junit4] 2> 97656 INFO (qtp68147334-771) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.c.S.Request [overwrite_shard1_replica_n1] webapp=/solr path=/update params={_stateVer_=overwrite:4&commit=true&wt=javabin&version=2} status=0 QTime=42
[junit4] 2> 97658 INFO (qtp68147334-774) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.c.S.Request [overwrite_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&_stateVer_=overwrite:4&wt=javabin&version=2} hits=1 status=0 QTime=1
[junit4] 2> 97670 INFO (qtp68147334-765) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.c.S.Request [overwrite_shard1_replica_n1] webapp=/solr path=/update params={_stateVer_=overwrite:4&wt=javabin&version=2} status=0 QTime=8
[junit4] 2> 97694 INFO (searcherExecutor-468-thread-1-processing-n:127.0.0.1:53671_solr x:overwrite_shard1_replica_n1 c:overwrite s:shard1 r:core_node2) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.c.SolrCore [overwrite_shard1_replica_n1] Registered new searcher autowarm time: 0 ms: Collection: 'overwrite'
[junit4] 2> 97695 INFO (qtp68147334-768) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.c.S.Request [overwrite_shard1_replica_n1] webapp=/solr path=/update params={_stateVer_=overwrite:4&commit=true&wt=javabin&version=2} status=0 QTime=23
[junit4] 2> 97698 INFO (qtp1866944902-769) [n:127.0.0.1:53673_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&collection=overwrite&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 97704 INFO (qtp1866944902-769) [n:127.0.0.1:53673_solr c:overwrite ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&collection=overwrite&wt=javabin&version=2} status=0 QTime=6
[junit4] 2> 97705 INFO (qtp1866944902-772) [n:127.0.0.1:53673_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&collection=overwrite&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 97711 INFO (qtp1866944902-772) [n:127.0.0.1:53673_solr c:overwrite ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&collection=overwrite&wt=javabin&version=2} status=0 QTime=6
[junit4] 2> 97713 INFO (qtp1866944902-775) [n:127.0.0.1:53673_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&collection=overwrite&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 97718 INFO (qtp1866944902-775) [n:127.0.0.1:53673_solr c:overwrite ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&collection=overwrite&wt=javabin&version=2} status=0 QTime=5
[junit4] 2> 97720 INFO (qtp1866944902-776) [n:127.0.0.1:53673_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&collection=overwrite&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 97727 INFO (qtp1866944902-776) [n:127.0.0.1:53673_solr c:overwrite ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&collection=overwrite&wt=javabin&version=2} status=0 QTime=7
[junit4] 2> 97731 INFO (qtp68147334-774) [n:127.0.0.1:53671_solr c:overwrite s:shard1 r:core_node2 x:overwrite_shard1_replica_n1 ] o.a.s.c.S.Request [overwrite_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=3 status=0 QTime=0
[junit4] 2> 97848 INFO (jetty-closer-473-thread-1) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1128222673
[junit4] 2> 97848 INFO (jetty-closer-473-thread-1) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:53672_solr
[junit4] 2> 97849 INFO (jetty-closer-473-thread-2) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=984108817
[junit4] 2> 97849 INFO (jetty-closer-473-thread-2) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:53673_solr
[junit4] 2> 97851 INFO (jetty-closer-473-thread-3) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2077922654
[junit4] 2> 97851 INFO (jetty-closer-473-thread-3) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:53671_solr
[junit4] 2> 97852 INFO (jetty-closer-473-thread-1) [ ] o.a.s.c.ZkController Publish this node as DOWN...
[junit4] 2> 97852 INFO (jetty-closer-473-thread-1) [ ] o.a.s.c.ZkController Publish node=127.0.0.1:53672_solr as DOWN
[junit4] 2> 97854 INFO (jetty-closer-473-thread-2) [ ] o.a.s.c.ZkController Publish this node as DOWN...
[junit4] 2> 97854 INFO (jetty-closer-473-thread-2) [ ] o.a.s.c.ZkController Publish node=127.0.0.1:53673_solr as DOWN
[junit4] 2> 97855 INFO (jetty-closer-473-thread-3) [ ] o.a.s.c.ZkController Publish this node as DOWN...
[junit4] 2> 97855 INFO (jetty-closer-473-thread-3) [ ] o.a.s.c.ZkController Publish node=127.0.0.1:53671_solr as DOWN
[junit4] 2> 97878 INFO (jetty-closer-473-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
[junit4] 2> 97879 INFO (jetty-closer-473-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
[junit4] 2> 97881 INFO (coreCloseExecutor-485-thread-1) [n:127.0.0.1:53671_solr ] o.a.s.c.SolrCore [overwrite_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@6c4b8a22
[junit4] 2> 97881 INFO (coreCloseExecutor-485-thread-1) [n:127.0.0.1:53671_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.overwrite.shard1.replica_n1 tag=SolrCore@6c4b8a22
[junit4] 2> 97881 INFO (coreCloseExecutor-485-thread-1) [n:127.0.0.1:53671_solr ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@76acc1af: rootName = solr_53671, domain = solr.core.overwrite.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.overwrite.shard1.replica_n1/com.codahale.metrics.MetricRegistry@5fc2c909
[junit4] 2> 97878 INFO (jetty-closer-473-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@67d13086: rootName = solr_53672, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@556ea932
[junit4] 2> 97879 INFO (jetty-closer-473-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5f77a581: rootName = solr_53673, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@fcc709
[junit4] 2> 97987 INFO (zkCallback-420-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/overwrite/state.json] for collection [overwrite] has occurred - updating... (live nodes size: [3])
[junit4] 2> 97987 INFO (zkCallback-420-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/overwrite/state.json] for collection [overwrite] has occurred - updating... (live nodes size: [3])
[junit4] 2> 97987 INFO (zkCallback-420-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/overwrite/state.json] for collection [overwrite] has occurred - updating... (live nodes size: [3])
[junit4] 2> 98111 INFO (jetty-closer-473-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
[junit4] 2> 98111 INFO (jetty-closer-473-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@908e61e: rootName = solr_53673, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@112c7d31
[junit4] 2> 98172 INFO (jetty-closer-473-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
[junit4] 2> 98172 INFO (jetty-closer-473-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3a6d6738: rootName = solr_53672, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@112c7d31
[junit4] 2> 98181 INFO (jetty-closer-473-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
[junit4] 2> 98181 INFO (jetty-closer-473-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@46920cc: rootName = solr_53673, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@36a37c4a
[junit4] 2> 98181 INFO (jetty-closer-473-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
[junit4] 2> 98189 INFO (zkCallback-409-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 98189 INFO (zkCallback-420-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 98197 INFO (jetty-closer-473-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
[junit4] 2> 98197 INFO (jetty-closer-473-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2682dc01: rootName = solr_53672, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@36a37c4a
[junit4] 2> 98197 INFO (jetty-closer-473-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
[junit4] 2> 98203 INFO (closeThreadPool-487-thread-2) [ ] o.a.s.c.Overseer Overseer (id=72108868756439046-127.0.0.1:53672_solr-n_0000000000) closing
[junit4] 2> 98206 INFO (OverseerStateUpdate-72108868756439046-127.0.0.1:53672_solr-n_0000000000) [n:127.0.0.1:53672_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:53672_solr
[junit4] 2> 98207 INFO (OverseerAutoScalingTriggerThread-72108868756439046-127.0.0.1:53672_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 98217 INFO (coreCloseExecutor-485-thread-1) [n:127.0.0.1:53671_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.overwrite.shard1.leader tag=SolrCore@6c4b8a22
[junit4] 2> 98219 INFO (closeThreadPool-487-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72108868756439046-127.0.0.1:53672_solr-n_0000000000) closing
[junit4] 2> 98220 INFO (coreCloseExecutor-485-thread-1) [n:127.0.0.1:53671_solr ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close() ... SKIPPED (unnecessary).
[junit4] 2> 98225 INFO (jetty-closer-473-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
[junit4] 2> 98225 INFO (jetty-closer-473-thread-3) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7bb5038c: rootName = solr_53671, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@6e1f117b
[junit4] 2> 98233 INFO (jetty-closer-473-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
[junit4] 2> 98233 INFO (jetty-closer-473-thread-3) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@60140ddc: rootName = solr_53671, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@112c7d31
[junit4] 2> 98235 INFO (jetty-closer-473-thread-3) [ ] o.a.s.m
[...truncated too long message...]
junit4] 2> 196681 INFO (jetty-closer-2449-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4a7c3a96: rootName = solr_55440, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@36a37c4a
[junit4] 2> 196681 INFO (jetty-closer-2449-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
[junit4] 2> 196692 INFO (closeThreadPool-2465-thread-2) [ ] o.a.s.c.Overseer Overseer (id=72108875182964744-127.0.0.1:55440_solr-n_0000000000) closing
[junit4] 2> 196692 INFO (OverseerStateUpdate-72108875182964744-127.0.0.1:55440_solr-n_0000000000) [n:127.0.0.1:55440_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:55440_solr
[junit4] 2> 196692 INFO (OverseerAutoScalingTriggerThread-72108875182964744-127.0.0.1:55440_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 196722 INFO (zkCallback-2395-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 196722 INFO (jetty-closer-2449-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null
[junit4] 2> 196722 INFO (jetty-closer-2449-thread-3) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4eafbf87: rootName = solr_55439, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@199d456e
[junit4] 2> 196725 INFO (zkCallback-2380-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 196727 INFO (jetty-closer-2449-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null
[junit4] 2> 196727 INFO (jetty-closer-2449-thread-3) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@adcf7ec: rootName = solr_55439, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@112c7d31
[junit4] 2> 196730 INFO (jetty-closer-2449-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null
[junit4] 2> 196730 INFO (jetty-closer-2449-thread-3) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@21b765fd: rootName = solr_55439, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@36a37c4a
[junit4] 2> 196730 INFO (jetty-closer-2449-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
[junit4] 2> 196732 INFO (zkCallback-2380-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 196732 INFO (closeThreadPool-2465-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72108875182964744-127.0.0.1:55440_solr-n_0000000000) closing
[junit4] 2> 196823 INFO (jetty-closer-2449-thread-2) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@65a7326{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
[junit4] 2> 196826 INFO (jetty-closer-2449-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4c0b0997{/solr,null,UNAVAILABLE}
[junit4] 2> 196828 INFO (jetty-closer-2449-thread-2) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 196838 INFO (jetty-closer-2449-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72108875182964744-127.0.0.1:55440_solr-n_0000000000) closing
[junit4] 2> 196850 INFO (jetty-closer-2449-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@218698bc{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
[junit4] 2> 196852 INFO (jetty-closer-2449-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@64a462a6{/solr,null,UNAVAILABLE}
[junit4] 2> 196856 INFO (jetty-closer-2449-thread-1) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 196966 INFO (jetty-closer-2449-thread-3) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@78dd5da1{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
[junit4] 2> 196967 INFO (jetty-closer-2449-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2f37d20a{/solr,null,UNAVAILABLE}
[junit4] 2> 196967 INFO (jetty-closer-2449-thread-3) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 196980 INFO (TEST-CloudSolrClientTest.singleShardedPreferenceRules-seed#[60879343B1E129C6]) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
[junit4] 2> 197200 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 11 /solr/collections/singleShardPreferenceTestColl/terms/shard1
[junit4] 2> 4 /solr/aliases.json
[junit4] 2> 4 /solr/clusterprops.json
[junit4] 2> 3 /solr/packages.json
[junit4] 2> 3 /solr/security.json
[junit4] 2> 3 /solr/configs/conf
[junit4] 2> 2 /solr/collections/singleShardPreferenceTestColl/collectionprops.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 27 /solr/collections/singleShardPreferenceTestColl/state.json
[junit4] 2> 4 /solr/clusterstate.json
[junit4] 2> 2 /solr/overseer_elect/election/72108875182964744-127.0.0.1:55440_solr-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 23 /solr/overseer/queue
[junit4] 2> 13 /solr/live_nodes
[junit4] 2> 8 /solr/collections
[junit4] 2> 3 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> 197204 INFO (TEST-CloudSolrClientTest.singleShardedPreferenceRules-seed#[60879343B1E129C6]) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:55418
[junit4] 2> 197204 INFO (TEST-CloudSolrClientTest.singleShardedPreferenceRules-seed#[60879343B1E129C6]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:55418
[junit4] 2> 197204 INFO (TEST-CloudSolrClientTest.singleShardedPreferenceRules-seed#[60879343B1E129C6]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 55418
[junit4] 2> 197205 INFO (TEST-CloudSolrClientTest.singleShardedPreferenceRules-seed#[60879343B1E129C6]) [ ] o.a.s.SolrTestCaseJ4 ###Ending singleShardedPreferenceRules
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-solrj/test/J3/temp/solr.client.solrj.impl.CloudSolrClientTest_60879343B1E129C6-001
[junit4] 2> May 26, 2020 3:40:40 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene86): {multiDefault=PostingsFormat(name=Direct), a_t=PostingsFormat(name=Direct), title_s=PostingsFormat(name=Direct), id=Lucene84, text=PostingsFormat(name=Asserting)}, docValues:{_version_=DocValuesFormat(name=Asserting), multiDefault=DocValuesFormat(name=Asserting), title_s=DocValuesFormat(name=Asserting), intDefault=DocValuesFormat(name=Asserting), id=DocValuesFormat(name=Lucene80), timestamp=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=1423, maxMBSortInHeap=6.806971018780143, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@1912b280), locale=ro, timezone=Pacific/Midway
[junit4] 2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 13.0.2 (64-bit)/cpus=6,threads=1,free=30506552,total=324534272
[junit4] 2> NOTE: All tests run in this JVM: [ArcTangentEvaluatorTest, TestRetryUtil, SolrExampleEmbeddedTest, TestHash, MultiplyEvaluatorTest, SolrExampleStreamingTest, StreamExpressionParserTest, TangentEvaluatorTest, HttpClientUtilTest, MoveReplicaSuggesterTest, TestCollectionAdminRequest, CommonParamsTest, StreamExpressionTest, CloudSolrClientTest]
[junit4] Completed [118/208 (2!)] on J3 in 104.04s, 18 tests, 1 error <<< FAILURES!
[...truncated 51462 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/6073/consoleText
[repro] Revision: 46ca7686875243a09aecfbfb49b05f457ad68751
[repro] Ant options: "-Dargs=-XX:-UseCompressedOops -XX:+UseParallelGC"
[repro] Repro line: ant test -Dtestcase=ZkConfigFilesTest -Dtests.seed=60879343B1E129C6 -Dtests.slow=true -Dtests.locale=ug-CN -Dtests.timezone=CNT -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[repro] Repro line: ant test -Dtestcase=CloudSolrClientTest -Dtests.method=testRetryUpdatesWhenClusterStateIsStale -Dtests.seed=60879343B1E129C6 -Dtests.slow=true -Dtests.locale=ro -Dtests.timezone=Pacific/Midway -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/solrj
[repro] CloudSolrClientTest
[repro] ZkConfigFilesTest
[repro] ant compile-test
[...truncated 2349 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=10 -Dtests.class="*.CloudSolrClientTest|*.ZkConfigFilesTest" -Dtests.showOutput=onerror "-Dargs=-XX:-UseCompressedOops -XX:+UseParallelGC" -Dtests.seed=60879343B1E129C6 -Dtests.slow=true -Dtests.locale=ro -Dtests.timezone=Pacific/Midway -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[...truncated 186 lines...]
[repro] Failures w/original seeds:
[repro] 0/5 failed: org.apache.solr.client.ref_guide_examples.ZkConfigFilesTest
[repro] 0/5 failed: org.apache.solr.client.solrj.impl.CloudSolrClientTest
[repro] Exiting with code 0
[...truncated 73 lines...]
[JENKINS] Lucene-Solr-master-MacOSX (64bit/jdk-14) - Build # 6077 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/6077/
Java: 64bit/jdk-14 -XX:+UseCompressedOops -XX:+UseParallelGC
1 tests failed.
FAILED: org.apache.solr.cloud.BasicDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=4927, name=testExecutor-2930-thread-3, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=4927, name=testExecutor-2930-thread-3, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
at __randomizedtesting.SeedInfo.seed([26AA266CA92B13EB:AEFE19B607D77E13]:0)
Caused by: org.apache.solr.client.solrj.impl.BaseHttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:55398: ADDREPLICA failed to create replica
at __randomizedtesting.SeedInfo.seed([26AA266CA92B13EB]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:663)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:265)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:224)
at org.apache.solr.cloud.BasicDistributedZkTest.lambda$createCollectionInOneInstance$2(BasicDistributedZkTest.java:760)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:210)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
at java.base/java.lang.Thread.run(Thread.java:832)
Build Log:
[...truncated 13243 lines...]
[junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4] 2> 392758 INFO (SUITE-BasicDistributedZkTest-seed#[26AA266CA92B13EB]-worker) [ ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/server/solr/configsets/_default/conf'
[junit4] 2> 392760 INFO (SUITE-BasicDistributedZkTest-seed#[26AA266CA92B13EB]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/data-dir-33-001
[junit4] 2> 392763 WARN (SUITE-BasicDistributedZkTest-seed#[26AA266CA92B13EB]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=49 numCloses=49
[junit4] 2> 392763 INFO (SUITE-BasicDistributedZkTest-seed#[26AA266CA92B13EB]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 392783 INFO (SUITE-BasicDistributedZkTest-seed#[26AA266CA92B13EB]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="https://issues.apache.org/jira/browse/SOLR-5776") w/ MAC_OS_X supressed clientAuth
[junit4] 2> 392783 INFO (SUITE-BasicDistributedZkTest-seed#[26AA266CA92B13EB]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 392783 INFO (SUITE-BasicDistributedZkTest-seed#[26AA266CA92B13EB]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 392802 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 392809 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
[junit4] 2> 392809 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 392908 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.ZkTestServer start zk server on port: 55350
[junit4] 2> 392908 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:55350
[junit4] 2> 392908 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:55350
[junit4] 2> 392908 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 55350
[junit4] 2> 392914 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 392929 INFO (zkConnectionManagerCallback-2652-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 392930 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 392978 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 392993 INFO (zkConnectionManagerCallback-2654-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 392993 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 393115 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 393307 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 393370 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 393394 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 393425 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 393456 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 393466 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 393482 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 393495 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 393506 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 393518 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 393538 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 394462 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 394468 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 394468 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14+36
[junit4] 2> 394483 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 394483 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 394483 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 394485 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@78a9619a{/,null,AVAILABLE}
[junit4] 2> 394499 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7e1b8760{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:55358}
[junit4] 2> 394499 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.e.j.s.Server Started @394569ms
[junit4] 2> 394499 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/tempDir-001/control/data, hostPort=55358, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/control-001/cores, replicaType=NRT}
[junit4] 2> 394503 ERROR (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 394503 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 394503 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 9.0.0
[junit4] 2> 394503 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 394503 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 394503 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-05-27T14:42:44.072907Z
[junit4] 2> 394509 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 394515 INFO (zkConnectionManagerCallback-2656-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 394515 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 394625 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 394625 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/control-001/solr.xml
[junit4] 2> 394636 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@60d32a50, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 394806 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 394811 WARN (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@19eb25b0[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 394811 WARN (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@19eb25b0[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 394824 WARN (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@274a6fa[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 394824 WARN (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@274a6fa[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 394826 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55350/solr
[junit4] 2> 394840 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 394846 INFO (zkConnectionManagerCallback-2667-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 394848 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 394959 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [n:127.0.0.1:55358_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 394964 INFO (zkConnectionManagerCallback-2669-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 394964 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [n:127.0.0.1:55358_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 396181 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [n:127.0.0.1:55358_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:55358_
[junit4] 2> 396187 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [n:127.0.0.1:55358_ ] o.a.s.c.Overseer Overseer (id=72114309951913988-127.0.0.1:55358_-n_0000000000) starting
[junit4] 2> 396275 INFO (OverseerStateUpdate-72114309951913988-127.0.0.1:55358_-n_0000000000) [n:127.0.0.1:55358_ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:55358_
[junit4] 2> 396277 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [n:127.0.0.1:55358_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55358_
[junit4] 2> 396293 INFO (OverseerStateUpdate-72114309951913988-127.0.0.1:55358_-n_0000000000) [n:127.0.0.1:55358_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 396344 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [n:127.0.0.1:55358_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 396348 WARN (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [n:127.0.0.1:55358_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 396451 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [n:127.0.0.1:55358_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 396512 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [n:127.0.0.1:55358_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@60d32a50
[junit4] 2> 396530 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [n:127.0.0.1:55358_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@60d32a50
[junit4] 2> 396531 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [n:127.0.0.1:55358_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@60d32a50
[junit4] 2> 396534 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [n:127.0.0.1:55358_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/control-001/cores
[junit4] 2> 396560 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 396566 INFO (zkConnectionManagerCallback-2686-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 396566 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 396579 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 396600 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:55350/solr ready
[junit4] 2> 396609 INFO (qtp69039065-4323) [n:127.0.0.1:55358_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:55358_&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 396635 INFO (OverseerThreadFactory-2676-thread-1-processing-n:127.0.0.1:55358_) [n:127.0.0.1:55358_ ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 396802 INFO (qtp69039065-4325) [n:127.0.0.1:55358_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 396802 INFO (qtp69039065-4325) [n:127.0.0.1:55358_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=1
[junit4] 2> 396814 INFO (qtp69039065-4322) [n:127.0.0.1:55358_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=1
[junit4] 2> 396838 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ x:control_collection_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 398008 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 398059 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=test
[junit4] 2> 398270 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 398391 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from configset conf1, trusted=true
[junit4] 2> 398392 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@60d32a50
[junit4] 2> 398392 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 398395 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=19, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.31989159506261655]
[junit4] 2> 398402 WARN (qtp69039065-4324) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A, b=B}}}
[junit4] 2> 398547 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 398547 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 398556 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 398556 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 398564 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=93.9111328125, floorSegmentMB=0.30078125, forceMergeDeletesPctAllowed=21.746796288767857, segmentsPerTier=19.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4048053727089266, deletesPctAllowed=32.76596606252731
[junit4] 2> 398578 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 398581 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 398582 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
[junit4] 2> 398582 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1667855095589502976
[junit4] 2> 398589 INFO (searcherExecutor-2688-thread-1-processing-n:127.0.0.1:55358_ x:control_collection_shard1_replica_n1 c:control_collection s:shard1) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher autowarm time: 0 ms: Collection: 'control_collection'
[junit4] 2> 398602 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, version=0}
[junit4] 2> 398602 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/control_collection/leaders/shard1
[junit4] 2> 398628 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 398628 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 398628 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:55358/control_collection_shard1_replica_n1/
[junit4] 2> 398629 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 398631 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy http://127.0.0.1:55358/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 398631 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/72114309951913988-core_node2-n_0000000000
[junit4] 2> 398640 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:55358/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 398748 INFO (zkCallback-2668-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 398749 INFO (zkCallback-2668-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 398751 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 398756 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1918
[junit4] 2> 398762 INFO (qtp69039065-4323) [n:127.0.0.1:55358_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 398863 INFO (zkCallback-2668-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 398863 INFO (zkCallback-2668-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 398863 INFO (zkCallback-2668-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 398865 INFO (qtp69039065-4323) [n:127.0.0.1:55358_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:55358_&wt=javabin&version=2} status=0 QTime=2256
[junit4] 2> 398865 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Waiting to see 1 active replicas in collection: control_collection
[junit4] 2> 398990 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 399015 INFO (zkConnectionManagerCallback-2697-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 399017 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 399040 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 399054 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:55350/solr ready
[junit4] 2> 399054 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 399057 INFO (qtp69039065-4323) [n:127.0.0.1:55358_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 399073 INFO (OverseerThreadFactory-2676-thread-2-processing-n:127.0.0.1:55358_) [n:127.0.0.1:55358_ ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 399073 INFO (OverseerCollectionConfigSetProcessor-72114309951913988-127.0.0.1:55358_-n_0000000000) [n:127.0.0.1:55358_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 399306 WARN (OverseerThreadFactory-2676-thread-2-processing-n:127.0.0.1:55358_) [n:127.0.0.1:55358_ ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 399321 INFO (qtp69039065-4323) [n:127.0.0.1:55358_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 399332 INFO (qtp69039065-4323) [n:127.0.0.1:55358_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=274
[junit4] 2> 399342 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 2 expected: 2
[junit4] 2> 399342 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 399343 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 2 expected: 2
[junit4] 2> 399343 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 399343 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 2 expected: 2
[junit4] 2> 399343 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 399343 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating jetty instances pullReplicaCount=0 numOtherReplicas=4
[junit4] 2> 400725 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/shard-1-001 of type NRT for shard2
[junit4] 2> 400727 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 400727 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 400727 INFO (closeThreadPool-2698-thread-1) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14+36
[junit4] 2> 400730 INFO (closeThreadPool-2698-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 400730 INFO (closeThreadPool-2698-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 400730 INFO (closeThreadPool-2698-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 400731 INFO (closeThreadPool-2698-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@332caea{/,null,AVAILABLE}
[junit4] 2> 400733 INFO (closeThreadPool-2698-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4e9c30d{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:55398}
[junit4] 2> 400733 INFO (closeThreadPool-2698-thread-1) [ ] o.e.j.s.Server Started @400802ms
[junit4] 2> 400733 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/tempDir-001/jetty1, hostPort=55398, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/shard-1-001/cores, replicaType=NRT}
[junit4] 2> 400733 ERROR (closeThreadPool-2698-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 400733 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 400733 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 9.0.0
[junit4] 2> 400733 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 400733 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 400734 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-05-27T14:42:50.303022Z
[junit4] 2> 400735 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 400739 INFO (zkConnectionManagerCallback-2700-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 400739 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 400843 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 400843 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/shard-1-001/solr.xml
[junit4] 2> 400850 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@60d32a50, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 401039 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 401043 WARN (closeThreadPool-2698-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@2e7ac3b7[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 401043 WARN (closeThreadPool-2698-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@2e7ac3b7[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 401055 WARN (closeThreadPool-2698-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@139973a6[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 401055 WARN (closeThreadPool-2698-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@139973a6[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 401057 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55350/solr
[junit4] 2> 401060 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 401064 INFO (zkConnectionManagerCallback-2711-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 401065 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 401177 INFO (OverseerCollectionConfigSetProcessor-72114309951913988-127.0.0.1:55358_-n_0000000000) [n:127.0.0.1:55358_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 401179 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55398_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 401182 INFO (zkConnectionManagerCallback-2713-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 401183 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55398_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 401206 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55398_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 401226 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55398_ ] o.a.s.c.ZkController Publish node=127.0.0.1:55398_ as DOWN
[junit4] 2> 401230 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55398_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 401231 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55398_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55398_
[junit4] 2> 401236 INFO (zkCallback-2668-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 401237 INFO (zkCallback-2696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 401237 INFO (zkCallback-2712-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 401243 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55398_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 401244 WARN (closeThreadPool-2698-thread-1) [n:127.0.0.1:55398_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 401299 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55398_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 401327 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55398_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@60d32a50
[junit4] 2> 401342 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55398_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@60d32a50
[junit4] 2> 401343 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55398_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@60d32a50
[junit4] 2> 401346 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55398_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/shard-1-001/cores
[junit4] 2> 401452 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:55398_
[junit4] 2> 401483 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/shard-2-001 of type NRT for shard1
[junit4] 2> 401484 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 401485 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 401485 INFO (closeThreadPool-2698-thread-1) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14+36
[junit4] 2> 401489 INFO (closeThreadPool-2698-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 401489 INFO (closeThreadPool-2698-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 401489 INFO (closeThreadPool-2698-thread-1) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 401490 INFO (closeThreadPool-2698-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@53aaf051{/,null,AVAILABLE}
[junit4] 2> 401492 INFO (closeThreadPool-2698-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@11db4dae{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:55402}
[junit4] 2> 401492 INFO (closeThreadPool-2698-thread-1) [ ] o.e.j.s.Server Started @401562ms
[junit4] 2> 401492 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/tempDir-001/jetty2, hostPort=55402, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/shard-2-001/cores}
[junit4] 2> 401493 ERROR (closeThreadPool-2698-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 401493 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 401493 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 9.0.0
[junit4] 2> 401493 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 401493 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 401493 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-05-27T14:42:51.062953Z
[junit4] 2> 401496 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 401501 INFO (zkConnectionManagerCallback-2723-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 401501 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 401608 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 401608 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/shard-2-001/solr.xml
[junit4] 2> 401615 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@60d32a50, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 401729 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 401732 WARN (closeThreadPool-2698-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@15703830[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 401732 WARN (closeThreadPool-2698-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@15703830[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 401738 WARN (closeThreadPool-2698-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@56ecc0e6[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 401738 WARN (closeThreadPool-2698-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@56ecc0e6[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 401742 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55350/solr
[junit4] 2> 401745 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 401749 INFO (zkConnectionManagerCallback-2734-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 401749 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 401860 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55402_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 401864 INFO (zkConnectionManagerCallback-2736-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 401864 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55402_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 401907 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55402_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 401934 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55402_ ] o.a.s.c.ZkController Publish node=127.0.0.1:55402_ as DOWN
[junit4] 2> 401945 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55402_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 401945 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55402_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55402_
[junit4] 2> 401947 INFO (zkCallback-2712-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 401947 INFO (zkCallback-2696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 401947 INFO (zkCallback-2668-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 401953 INFO (zkCallback-2735-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 401972 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55402_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 401972 WARN (closeThreadPool-2698-thread-1) [n:127.0.0.1:55402_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 402005 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55402_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 402013 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/shard-3-001 of type NRT for shard2
[junit4] 2> 402015 INFO (closeThreadPool-2698-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 402015 INFO (closeThreadPool-2698-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 402015 INFO (closeThreadPool-2698-thread-2) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14+36
[junit4] 2> 402017 INFO (closeThreadPool-2698-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 402017 INFO (closeThreadPool-2698-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 402017 INFO (closeThreadPool-2698-thread-2) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 402017 INFO (closeThreadPool-2698-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1d96719e{/,null,AVAILABLE}
[junit4] 2> 402018 INFO (closeThreadPool-2698-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@420e47{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:55409}
[junit4] 2> 402018 INFO (closeThreadPool-2698-thread-2) [ ] o.e.j.s.Server Started @402088ms
[junit4] 2> 402018 INFO (closeThreadPool-2698-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/tempDir-001/jetty3, hostPort=55409, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/shard-3-001/cores, replicaType=NRT}
[junit4] 2> 402019 ERROR (closeThreadPool-2698-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 402019 INFO (closeThreadPool-2698-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 402019 INFO (closeThreadPool-2698-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 9.0.0
[junit4] 2> 402019 INFO (closeThreadPool-2698-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 402019 INFO (closeThreadPool-2698-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 402019 INFO (closeThreadPool-2698-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-05-27T14:42:51.588515Z
[junit4] 2> 402020 INFO (closeThreadPool-2698-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 402035 INFO (zkConnectionManagerCallback-2745-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 402036 INFO (closeThreadPool-2698-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 402043 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55402_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@60d32a50
[junit4] 2> 402053 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55402_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@60d32a50
[junit4] 2> 402054 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55402_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@60d32a50
[junit4] 2> 402058 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55402_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/shard-2-001/cores
[junit4] 2> 402074 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:55402_
[junit4] 2> 402165 INFO (closeThreadPool-2698-thread-2) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 402165 INFO (closeThreadPool-2698-thread-2) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/shard-3-001/solr.xml
[junit4] 2> 402169 INFO (closeThreadPool-2698-thread-2) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@60d32a50, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 402278 INFO (closeThreadPool-2698-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 402280 WARN (closeThreadPool-2698-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@2e4086f9[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 402280 WARN (closeThreadPool-2698-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@2e4086f9[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 402285 WARN (closeThreadPool-2698-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@6c1398f4[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 402286 WARN (closeThreadPool-2698-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@6c1398f4[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 402287 INFO (closeThreadPool-2698-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55350/solr
[junit4] 2> 402290 INFO (closeThreadPool-2698-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 402293 INFO (zkConnectionManagerCallback-2757-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 402293 INFO (closeThreadPool-2698-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 402402 INFO (closeThreadPool-2698-thread-2) [n:127.0.0.1:55409_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 402406 INFO (zkConnectionManagerCallback-2759-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 402406 INFO (closeThreadPool-2698-thread-2) [n:127.0.0.1:55409_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 402431 INFO (closeThreadPool-2698-thread-2) [n:127.0.0.1:55409_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 402448 INFO (closeThreadPool-2698-thread-2) [n:127.0.0.1:55409_ ] o.a.s.c.ZkController Publish node=127.0.0.1:55409_ as DOWN
[junit4] 2> 402453 INFO (closeThreadPool-2698-thread-2) [n:127.0.0.1:55409_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 402453 INFO (closeThreadPool-2698-thread-2) [n:127.0.0.1:55409_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55409_
[junit4] 2> 402462 INFO (zkCallback-2712-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 402462 INFO (zkCallback-2735-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 402462 INFO (zkCallback-2696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 402462 INFO (zkCallback-2668-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 402463 INFO (zkCallback-2758-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 402470 INFO (closeThreadPool-2698-thread-2) [n:127.0.0.1:55409_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 402471 WARN (closeThreadPool-2698-thread-2) [n:127.0.0.1:55409_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 402507 INFO (closeThreadPool-2698-thread-2) [n:127.0.0.1:55409_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 402525 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 4 in directory /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/shard-4-001 of type NRT for shard1
[junit4] 2> 402526 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 402526 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 402526 INFO (closeThreadPool-2698-thread-1) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14+36
[junit4] 2> 402529 INFO (closeThreadPool-2698-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 402529 INFO (closeThreadPool-2698-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 402529 INFO (closeThreadPool-2698-thread-1) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 402529 INFO (closeThreadPool-2698-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1227ead3{/,null,AVAILABLE}
[junit4] 2> 402531 INFO (closeThreadPool-2698-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3be315ca{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:55415}
[junit4] 2> 402531 INFO (closeThreadPool-2698-thread-1) [ ] o.e.j.s.Server Started @402601ms
[junit4] 2> 402531 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/tempDir-001/jetty4, hostPort=55415, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/shard-4-001/cores, replicaType=NRT}
[junit4] 2> 402532 ERROR (closeThreadPool-2698-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 402532 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 402532 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 9.0.0
[junit4] 2> 402532 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 402532 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 402532 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-05-27T14:42:52.101537Z
[junit4] 2> 402534 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 402537 INFO (zkConnectionManagerCallback-2768-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 402537 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 402538 INFO (closeThreadPool-2698-thread-2) [n:127.0.0.1:55409_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@60d32a50
[junit4] 2> 402561 INFO (closeThreadPool-2698-thread-2) [n:127.0.0.1:55409_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@60d32a50
[junit4] 2> 402562 INFO (closeThreadPool-2698-thread-2) [n:127.0.0.1:55409_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@60d32a50
[junit4] 2> 402563 INFO (closeThreadPool-2698-thread-2) [n:127.0.0.1:55409_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/shard-3-001/cores
[junit4] 2> 402649 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 402649 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/shard-4-001/solr.xml
[junit4] 2> 402654 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@60d32a50, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 402657 INFO (closeThreadPool-2698-thread-2) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:55409_
[junit4] 2> 402829 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 402832 WARN (closeThreadPool-2698-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@6b6806cc[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 402832 WARN (closeThreadPool-2698-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@6b6806cc[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 402851 WARN (closeThreadPool-2698-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@589390dc[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 402851 WARN (closeThreadPool-2698-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@589390dc[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 402853 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55350/solr
[junit4] 2> 402855 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 402859 INFO (zkConnectionManagerCallback-2780-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 402862 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 402982 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55415_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 402986 INFO (zkConnectionManagerCallback-2782-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 402989 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55415_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 403032 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55415_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 403062 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55415_ ] o.a.s.c.ZkController Publish node=127.0.0.1:55415_ as DOWN
[junit4] 2> 403067 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55415_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 403067 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55415_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55415_
[junit4] 2> 403075 INFO (zkCallback-2668-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 403076 INFO (zkCallback-2758-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 403076 INFO (zkCallback-2735-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 403076 INFO (zkCallback-2712-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 403076 INFO (zkCallback-2696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 403082 INFO (zkCallback-2781-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 403092 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55415_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 403093 WARN (closeThreadPool-2698-thread-1) [n:127.0.0.1:55415_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 403141 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55415_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 403184 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55415_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@60d32a50
[junit4] 2> 403193 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55415_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@60d32a50
[junit4] 2> 403193 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55415_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@60d32a50
[junit4] 2> 403196 INFO (closeThreadPool-2698-thread-1) [n:127.0.0.1:55415_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/shard-4-001/cores
[junit4] 2> 403207 INFO (closeThreadPool-2698-thread-1) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:55415_
[junit4] 2> 403216 INFO (qtp69039065-4322) [n:127.0.0.1:55358_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:55398_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 403216 INFO (qtp69039065-4324) [n:127.0.0.1:55358_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:55402_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 403217 INFO (qtp69039065-4325) [n:127.0.0.1:55358_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:55409_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 403218 INFO (qtp69039065-4323) [n:127.0.0.1:55358_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:55415_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 403233 INFO (qtp69039065-4498) [n:127.0.0.1:55358_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.control_collection.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
[junit4] 2> 403236 INFO (qtp69039065-4498) [n:127.0.0.1:55358_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 403240 INFO (qtp14043087-4380) [n:127.0.0.1:55398_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 403243 INFO (qtp174844195-4409) [n:127.0.0.1:55402_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 403248 INFO (qtp75340304-4435) [n:127.0.0.1:55409_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=1
[junit4] 2> 403252 INFO (qtp1378159989-4464) [n:127.0.0.1:55415_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 403255 INFO (qtp69039065-4498) [n:127.0.0.1:55358_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.control_collection.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=1
[junit4] 2> 403257 INFO (qtp69039065-4498) [n:127.0.0.1:55358_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 403260 INFO (qtp14043087-4381) [n:127.0.0.1:55398_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=1
[junit4] 2> 403262 INFO (qtp174844195-4410) [n:127.0.0.1:55402_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 403265 INFO (qtp75340304-4436) [n:127.0.0.1:55409_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=1
[junit4] 2> 403267 INFO (qtp1378159989-4465) [n:127.0.0.1:55415_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 403268 INFO (OverseerThreadFactory-2676-thread-3-processing-n:127.0.0.1:55358_) [n:127.0.0.1:55358_ c:collection1 s:shard2 ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:55398_ for creating new replica of shard shard2 for collection collection1
[junit4] 2> 403270 INFO (qtp69039065-4498) [n:127.0.0.1:55358_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.control_collection.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
[junit4] 2> 403272 INFO (qtp69039065-4498) [n:127.0.0.1:55358_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 403275 INFO (qtp14043087-4382) [n:127.0.0.1:55398_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=2
[junit4] 2> 403278 INFO (qtp174844195-4411) [n:127.0.0.1:55402_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=1
[junit4] 2> 403280 INFO (qtp75340304-4437) [n:127.0.0.1:55409_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 403282 INFO (OverseerThreadFactory-2676-thread-3-processing-n:127.0.0.1:55358_) [n:127.0.0.1:55358_ c:collection1 s:shard2 ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 403284 INFO (qtp1378159989-4466) [n:127.0.0.1:55415_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=2
[junit4] 2> 403288 INFO (OverseerThreadFactory-2676-thread-4-processing-n:127.0.0.1:55358_) [n:127.0.0.1:55358_ c:collection1 s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:55402_ for creating new replica of shard shard1 for collection collection1
[junit4] 2> 403298 INFO (OverseerThreadFactory-2676-thread-4-processing-n:127.0.0.1:55358_) [n:127.0.0.1:55358_ c:collection1 s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 403298 INFO (qtp14043087-4381) [n:127.0.0.1:55398_ x:collection1_shard2_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n1&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 403308 INFO (qtp174844195-4410) [n:127.0.0.1:55402_ x:collection1_shard1_replica_n2 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n2&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 404320 INFO (qtp14043087-4381) [n:127.0.0.1:55398_ c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 404334 INFO (qtp174844195-4410) [n:127.0.0.1:55402_ c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 404344 INFO (qtp14043087-4381) [n:127.0.0.1:55398_ c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.s.IndexSchema Schema name=test
[junit4] 2> 404355 INFO (qtp174844195-4410) [n:127.0.0.1:55402_ c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.s.IndexSchema Schema name=test
[junit4] 2> 404441 INFO (qtp174844195-4410) [n:127.0.0.1:55402_ c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 404448 INFO (qtp14043087-4381) [n:127.0.0.1:55398_ c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 404484 INFO (qtp174844195-4410) [n:127.0.0.1:55402_ c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n2' using configuration from configset conf1, trusted=true
[junit4] 2> 404484 INFO (qtp174844195-4410) [n:127.0.0.1:55402_ c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n2' (registry 'solr.core.collection1.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@60d32a50
[junit4] 2> 404484 INFO (qtp174844195-4410) [n:127.0.0.1:55402_ c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.c.SolrCore [[collection1_shard1_replica_n2] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/shard-2-001/cores/collection1_shard1_replica_n2], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/shard-2-001/cores/collection1_shard1_replica_n2/data/]
[junit4] 2> 404487 INFO (qtp174844195-4410) [n:127.0.0.1:55402_ c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=19, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.31989159506261655]
[junit4] 2> 404489 INFO (qtp14043087-4381) [n:127.0.0.1:55398_ c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n1' using configuration from configset conf1, trusted=true
[junit4] 2> 404490 INFO (qtp14043087-4381) [n:127.0.0.1:55398_ c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n1' (registry 'solr.core.collection1.shard2.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@60d32a50
[junit4] 2> 404490 INFO (qtp14043087-4381) [n:127.0.0.1:55398_ c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.c.SolrCore [[collection1_shard2_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/shard-1-001/cores/collection1_shard2_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest_26AA266CA92B13EB-001/shard-1-001/cores/collection1_shard2_replica_n1/data/]
[junit4] 2> 404490 WARN (qtp174844195-4410) [n:127.0.0.1:55402_ c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A, b=B}}}
[junit4] 2> 404492 INFO (qtp14043087-4381) [n:127.0.0.1:55398_ c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=19, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.31989159506261655]
[junit4] 2> 404492 WARN (qtp14043087-4381) [n:127.0.0.1:55398_ c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A, b=B}}}
[junit4] 2> 404549 INFO (qtp174844195-4410) [n:127.0.0.1:55402_ c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 404549 INFO (qtp174844195-4410) [n:127.0.0.1:55402_ c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 404551 INFO (qtp174844195-4410) [n:127.0.0.1:55402_ c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 404551 INFO (qtp174844195-4410) [n:127.0.0.1:55402_ c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 404552 INFO (qtp174844195-4410) [n:127.0.0.1:55402_ c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=93.9111328125, floorSegmentMB=0.30078125, forceMergeDeletesPctAllowed=21.746796288767857, segmentsPerTier=19.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4048053727089266, deletesPctAllowed=32.76596606252731
[junit4] 2> 404555 INFO (qtp174844195-4410) [n:127.0.0.1:55402_ c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 404555 INFO (qtp174844195-4410) [n:127.0.0.1:55402_ c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 404556 INFO (qtp174844195-4410) [n:127.0.0.1:55402_ c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
[junit4] 2> 404556 INFO (qtp174844195-4410) [n:127.0.0.1:55402_ c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1667855101853696000
[junit4] 2> 404559 INFO (searcherExecutor-2793-thread-1-processing-n:127.0.0.1:55402_ x:collection1_shard1_replica_n2 c:collection1 s:shard1) [n:127.0.0.1:55402_ c:collection1 s:shard1 x:collection1_shard1_replica_n2 ] o.a.s.c.SolrCore [collection1_shard1_replica_n2] Registered new searcher autowarm time: 0 ms: Collection: 'collection1'
[junit4] 2> 404563 INFO (qtp14043087-4381) [n:127.0.0.1:55398_ c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 404563 INFO (qtp14043087-4381) [n:127.0.0.1:55398_ c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 404565 INFO (qtp14043087-4381) [n:127.0.0.1:55398_ c:collection1 s:shard2 x:collection1_shard2_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 404
[...truncated too long message...]
r Stopped ServerConnector@155c7aea{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:55398}
[junit4] 2> 552261 INFO (closeThreadPool-3074-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@30fe6306{/,null,UNAVAILABLE}
[junit4] 2> 552261 INFO (closeThreadPool-3074-thread-1) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 552265 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
[junit4] 2> 552486 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 23 /solr/collections/collection1/state.json
[junit4] 2> 11 /solr/collections/collection3/terms/shard1
[junit4] 2> 9 /solr/aliases.json
[junit4] 2> 8 /solr/collections/collection2/terms/shard2
[junit4] 2> 8 /solr/collections/collection2/collectionprops.json
[junit4] 2> 8 /solr/collections/collection3/collectionprops.json
[junit4] 2> 8 /solr/collections/collection3/terms/shard2
[junit4] 2> 8 /solr/collections/collection1/terms/shard2
[junit4] 2> 7 /solr/collections/collection2/terms/shard1
[junit4] 2> 7 /solr/collections/collection1/terms/shard1
[junit4] 2> 6 /solr/collections/oneInstanceCollection2/terms/shard1
[junit4] 2> 6 /solr/packages.json
[junit4] 2> 6 /solr/security.json
[junit4] 2> 6 /solr/configs/conf1
[junit4] 2> 5 /solr/collections/collection1/collectionprops.json
[junit4] 2> 5 /solr/collections/oneInstanceCollection2/terms/shard2
[junit4] 2> 5 /solr/collections/multiunload2/terms/shard1
[junit4] 2> 5 /solr/collections/oneInstanceCollection/terms/shard1
[junit4] 2> 5 /solr/collections/oneInstanceCollection/terms/shard2
[junit4] 2> 3 /solr/collections/control_collection/terms/shard1
[junit4] 2> 2 /solr/collections/multiunload2/collectionprops.json
[junit4] 2> 2 /solr/collections/oneInstanceCollection2/collectionprops.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 188 /solr/collections/collection3/state.json
[junit4] 2> 167 /solr/collections/collection2/state.json
[junit4] 2> 105 /solr/clusterstate.json
[junit4] 2> 82 /solr/collections/oneInstanceCollection/state.json
[junit4] 2> 66 /solr/collections/oneInstanceCollection2/state.json
[junit4] 2> 38 /solr/collections/multiunload2/state.json
[junit4] 2> 12 /solr/collections/control_collection/state.json
[junit4] 2> 9 /solr/clusterprops.json
[junit4] 2> 2 /solr/overseer_elect/election/72114309951913999-127.0.0.1:55409_-n_0000000003
[junit4] 2> 2 /solr/overseer_elect/election/72114309951913988-127.0.0.1:55358_-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 214 /solr/overseer/queue
[junit4] 2> 79 /solr/overseer/collection-queue-work
[junit4] 2> 51 /solr/live_nodes
[junit4] 2> 44 /solr/collections
[junit4] 2>
[junit4] 2> 552490 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:55350
[junit4] 2> 552490 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:55350
[junit4] 2> 552490 INFO (TEST-BasicDistributedZkTest.test-seed#[26AA266CA92B13EB]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 55350
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=BasicDistributedZkTest -Dtests.method=test -Dtests.seed=26AA266CA92B13EB -Dtests.slow=true -Dtests.locale=sq -Dtests.timezone=America/Thunder_Bay -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 160s J2 | BasicDistributedZkTest.test <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=4927, name=testExecutor-2930-thread-3, state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
[junit4] > at __randomizedtesting.SeedInfo.seed([26AA266CA92B13EB:AEFE19B607D77E13]:0)
[junit4] > Caused by: org.apache.solr.client.solrj.impl.BaseHttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:55398: ADDREPLICA failed to create replica
[junit4] > at __randomizedtesting.SeedInfo.seed([26AA266CA92B13EB]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:663)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:265)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:224)
[junit4] > at org.apache.solr.cloud.BasicDistributedZkTest.lambda$createCollectionInOneInstance$2(BasicDistributedZkTest.java:760)
[junit4] > at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:210)
[junit4] > at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] > at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:832)
[junit4] 2> 552495 INFO (SUITE-BasicDistributedZkTest-seed#[26AA266CA92B13EB]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene86): {regex_dup_A_s=PostingsFormat(name=Direct), regex_dup_B_s=PostingsFormat(name=Asserting), SubjectTerms_mfacet=PostingsFormat(name=Asserting), multiDefault=Lucene84, _root_=PostingsFormat(name=Asserting), genre_s=PostingsFormat(name=Direct), author_t=Lucene84, series_t=Lucene84, rnd_b=Lucene84, oddField_s=PostingsFormat(name=Direct), a_t=PostingsFormat(name=Asserting), cat=PostingsFormat(name=Asserting), foo_b=PostingsFormat(name=Direct), name=Lucene84, inStock=PostingsFormat(name=Direct), id=Lucene84, text=PostingsFormat(name=Direct), t_sortable=Lucene84}, docValues:{other_tl1=DocValuesFormat(name=Asserting), range_facet_l_dv=DocValuesFormat(name=Lucene80), n_l1=DocValuesFormat(name=Asserting), intDefault=DocValuesFormat(name=Asserting), n_td1=DocValuesFormat(name=Asserting), n_d1=DocValuesFormat(name=Asserting), range_facet_l=DocValuesFormat(name=Asserting), n_f1=DocValuesFormat(name=Asserting), n_tl1=DocValuesFormat(name=Asserting), n_tf1=DocValuesFormat(name=Asserting), price=DocValuesFormat(name=Lucene80), sequence_i=DocValuesFormat(name=Lucene80), intDvoDefault=DocValuesFormat(name=Lucene80), t_sortable=DocValuesFormat(name=Lucene80), timestamp=DocValuesFormat(name=Asserting), foo_i=DocValuesFormat(name=Asserting), val_i=DocValuesFormat(name=Lucene80), n_dt1=DocValuesFormat(name=Asserting), a_i1=DocValuesFormat(name=Asserting), n_ti1=DocValuesFormat(name=Lucene80), _version_=DocValuesFormat(name=Asserting), n_tdt1=DocValuesFormat(name=Asserting), id_i1=DocValuesFormat(name=Asserting), foo_d=DocValuesFormat(name=Lucene80), range_facet_i_dv=DocValuesFormat(name=Asserting), foo_f=DocValuesFormat(name=Lucene80)}, maxPointsInLeafNode=998, maxMBSortInHeap=6.223605277386307, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@d4ec369), locale=sq, timezone=America/Thunder_Bay
[junit4] 2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 14 (64-bit)/cpus=6,threads=1,free=51761048,total=407371776
[junit4] 2> NOTE: All tests run in this JVM: [ZkCLITest, TestCloudNestedDocsSort, ClusterStateTest, SolrMetricReporterTest, AddSchemaFieldsUpdateProcessorFactoryTest, SolrSlf4jReporterTest, TestSweetSpotSimilarityFactory, TestPHPSerializedResponseWriter, TestCollectionsAPIViaSolrCloudCluster, TestEmbeddedSolrServerAdminHandler, TestClassicSimilarityFactory, TestDocumentBuilder, SOLR749Test, IgnoreLargeDocumentProcessorFactoryTest, HdfsLockFactoryTest, BJQFilterAccessibleTest, SolrPluginUtilsTest, TestNumericTerms32, TestTrackingShardHandlerFactory, MetricTriggerIntegrationTest, TestHttpServletCarrier, DistributedFacetSimpleRefinementLongTailTest, ChaosMonkeySafeLeaderWithPullReplicasTest, SortSpecParsingTest, LeaderElectionTest, TestPullReplicaErrorHandling, BasicDistributedZkTest]
[junit4] Completed [147/913 (1!)] on J2 in 160.28s, 1 test, 1 error <<< FAILURES!
[...truncated 47565 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/6077/consoleText
[repro] Revision: ac80fb9979c26e357a561a609ecd754a1c33c561
[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseParallelGC"
[repro] Repro line: ant test -Dtestcase=BasicDistributedZkTest -Dtests.method=test -Dtests.seed=26AA266CA92B13EB -Dtests.slow=true -Dtests.locale=sq -Dtests.timezone=America/Thunder_Bay -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] BasicDistributedZkTest
[repro] ant compile-test
[...truncated 3158 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.BasicDistributedZkTest" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseParallelGC" -Dtests.seed=26AA266CA92B13EB -Dtests.slow=true -Dtests.locale=sq -Dtests.timezone=America/Thunder_Bay -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[...truncated 89 lines...]
[repro] Failures w/original seeds:
[repro] 0/5 failed: org.apache.solr.cloud.BasicDistributedZkTest
[repro] Exiting with code 0
[...truncated 73 lines...]
[JENKINS-Experimental-GC] Lucene-Solr-master-MacOSX (64bit/jdk-14)
- Build # 6076 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/6076/
Java: 64bit/jdk-14 -XX:+UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseZGC
2 tests failed.
FAILED: org.apache.solr.cloud.MultiThreadedOCPTest.test
Error Message:
acoll: 1590570918071 bcoll: 1590570918236
Stack Trace:
java.lang.AssertionError: acoll: 1590570918071 bcoll: 1590570918236
at __randomizedtesting.SeedInfo.seed([40CC6A9814639198:C8985542BA9FFC60]:0)
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.apache.solr.cloud.MultiThreadedOCPTest.testFillWorkQueue(MultiThreadedOCPTest.java:113)
at org.apache.solr.cloud.MultiThreadedOCPTest.test(MultiThreadedOCPTest.java:68)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1081)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1053)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
at java.base/java.lang.Thread.run(Thread.java:832)
FAILED: org.apache.solr.cloud.PeerSyncReplicationTest.test
Error Message:
expected:<0> but was:<1>
Stack Trace:
java.lang.AssertionError: expected:<0> but was:<1>
at __randomizedtesting.SeedInfo.seed([40CC6A9814639198:C8985542BA9FFC60]:0)
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:834)
at org.junit.Assert.assertEquals(Assert.java:645)
at org.junit.Assert.assertEquals(Assert.java:631)
at org.apache.solr.cloud.PeerSyncReplicationTest.test(PeerSyncReplicationTest.java:202)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1081)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1053)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
at java.base/java.lang.Thread.run(Thread.java:832)
Build Log:
[...truncated 14334 lines...]
[junit4] Suite: org.apache.solr.cloud.MultiThreadedOCPTest
[junit4] 2> 1162905 INFO (SUITE-MultiThreadedOCPTest-seed#[40CC6A9814639198]-worker) [ ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/server/solr/configsets/_default/conf'
[junit4] 2> 1162913 INFO (SUITE-MultiThreadedOCPTest-seed#[40CC6A9814639198]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1162961 INFO (SUITE-MultiThreadedOCPTest-seed#[40CC6A9814639198]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_40CC6A9814639198-001/data-dir-86-001
[junit4] 2> 1162961 WARN (SUITE-MultiThreadedOCPTest-seed#[40CC6A9814639198]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=358 numCloses=358
[junit4] 2> 1162962 INFO (SUITE-MultiThreadedOCPTest-seed#[40CC6A9814639198]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 1162963 INFO (SUITE-MultiThreadedOCPTest-seed#[40CC6A9814639198]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 1162964 INFO (SUITE-MultiThreadedOCPTest-seed#[40CC6A9814639198]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 1162996 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1163058 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
[junit4] 2> 1163058 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1163208 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.ZkTestServer start zk server on port: 53436
[junit4] 2> 1163208 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:53436
[junit4] 2> 1163208 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:53436
[junit4] 2> 1163208 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 53436
[junit4] 2> 1163404 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1163678 INFO (zkConnectionManagerCallback-9776-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1163680 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1163847 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1163885 INFO (zkConnectionManagerCallback-9778-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1163885 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1163971 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1164111 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1164177 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1164336 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1164376 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1164401 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1164420 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1164435 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1164462 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1164486 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1164503 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1164520 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1164526 INFO (zkConnectionManagerCallback-9782-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1164526 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1164644 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 1166503 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 1166503 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 1166503 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14+36
[junit4] 2> 1166513 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1166513 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1166513 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 1166515 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@37f2bb10{/,null,AVAILABLE}
[junit4] 2> 1166522 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@2afde5b9{ssl, (ssl, alpn, http/1.1, h2)}{127.0.0.1:53452}
[junit4] 2> 1166522 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.e.j.s.Server Started @1166626ms
[junit4] 2> 1166522 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_40CC6A9814639198-001/tempDir-001/control/data, hostPort=53452, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_40CC6A9814639198-001/control-001/cores}
[junit4] 2> 1166523 ERROR (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1166523 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1166523 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 1166523 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1166523 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 1166523 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-05-27T09:13:45.357498Z
[junit4] 2> 1166566 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1166595 INFO (zkConnectionManagerCallback-9784-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1166597 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1166798 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1166798 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_40CC6A9814639198-001/control-001/solr.xml
[junit4] 2> 1166817 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@e65ee7b, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1167034 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 1167051 WARN (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3036a64c[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1167051 WARN (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3036a64c[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1167061 WARN (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@164a91a5[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1167063 WARN (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@164a91a5[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1167083 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53436/solr
[junit4] 2> 1167115 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1167120 INFO (zkConnectionManagerCallback-9795-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1167122 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1167297 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [n:127.0.0.1:53452_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1167324 INFO (zkConnectionManagerCallback-9797-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1167324 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [n:127.0.0.1:53452_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1170649 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [n:127.0.0.1:53452_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:53452_
[junit4] 2> 1170655 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [n:127.0.0.1:53452_ ] o.a.s.c.Overseer Overseer (id=72113016244207621-127.0.0.1:53452_-n_0000000000) starting
[junit4] 2> 1170676 INFO (OverseerStateUpdate-72113016244207621-127.0.0.1:53452_-n_0000000000) [n:127.0.0.1:53452_ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:53452_
[junit4] 2> 1170676 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [n:127.0.0.1:53452_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53452_
[junit4] 2> 1170688 INFO (zkCallback-9796-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1170703 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [n:127.0.0.1:53452_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 1170704 WARN (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [n:127.0.0.1:53452_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 1170742 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [n:127.0.0.1:53452_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1170793 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [n:127.0.0.1:53452_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e65ee7b
[junit4] 2> 1170839 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [n:127.0.0.1:53452_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e65ee7b
[junit4] 2> 1170840 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [n:127.0.0.1:53452_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e65ee7b
[junit4] 2> 1170842 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [n:127.0.0.1:53452_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_40CC6A9814639198-001/control-001/cores
[junit4] 2> 1170874 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1170881 INFO (zkConnectionManagerCallback-9814-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1170881 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1170888 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1170893 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:53436/solr ready
[junit4] 2> 1170934 INFO (qtp352470617-14403) [n:127.0.0.1:53452_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:53452_&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1170945 INFO (OverseerThreadFactory-9804-thread-1-processing-n:127.0.0.1:53452_) [n:127.0.0.1:53452_ ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 1171116 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1171119 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=5
[junit4] 2> 1171128 INFO (qtp352470617-14408) [n:127.0.0.1:53452_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=1
[junit4] 2> 1171145 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ x:control_collection_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1172187 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 1172216 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=test
[junit4] 2> 1172380 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 1172561 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from configset conf1, trusted=true
[junit4] 2> 1172562 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e65ee7b
[junit4] 2> 1172562 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_40CC6A9814639198-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_40CC6A9814639198-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 1172567 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=27, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1172595 WARN (qtp352470617-14406) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A, b=B}}}
[junit4] 2> 1172923 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1172929 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1173081 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1173081 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1173222 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=28, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6794251971153137]
[junit4] 2> 1173227 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1173228 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1173235 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
[junit4] 2> 1173235 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1667834400807583744
[junit4] 2> 1173240 INFO (searcherExecutor-9816-thread-1-processing-n:127.0.0.1:53452_ x:control_collection_shard1_replica_n1 c:control_collection s:shard1) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher autowarm time: 0 ms: Collection: 'control_collection'
[junit4] 2> 1173323 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, version=0}
[junit4] 2> 1173323 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/control_collection/leaders/shard1
[junit4] 2> 1173455 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1173455 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1173455 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:53452/control_collection_shard1_replica_n1/
[junit4] 2> 1173456 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1173458 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy https://127.0.0.1:53452/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 1173458 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/72113016244207621-core_node2-n_0000000000
[junit4] 2> 1173483 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:53452/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 1173553 INFO (zkCallback-9796-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1173553 INFO (zkCallback-9796-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1173572 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1173586 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2441
[junit4] 2> 1173620 INFO (qtp352470617-14403) [n:127.0.0.1:53452_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 1173716 INFO (zkCallback-9796-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1173718 INFO (zkCallback-9796-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1173718 INFO (zkCallback-9796-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1173738 INFO (qtp352470617-14403) [n:127.0.0.1:53452_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:53452_&wt=javabin&version=2} status=0 QTime=2805
[junit4] 2> 1173749 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Waiting to see 1 active replicas in collection: control_collection
[junit4] 2> 1174070 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1174138 INFO (zkConnectionManagerCallback-9825-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1174138 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1174213 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1174315 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:53436/solr ready
[junit4] 2> 1174315 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1174336 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1174450 INFO (OverseerThreadFactory-9804-thread-2-processing-n:127.0.0.1:53452_) [n:127.0.0.1:53452_ ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 1174510 INFO (OverseerCollectionConfigSetProcessor-72113016244207621-127.0.0.1:53452_-n_0000000000) [n:127.0.0.1:53452_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1174970 WARN (OverseerThreadFactory-9804-thread-2-processing-n:127.0.0.1:53452_) [n:127.0.0.1:53452_ ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 1174982 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 1174984 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=648
[junit4] 2> 1174992 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 2 expected: 2
[junit4] 2> 1174992 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 1174992 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 2 expected: 2
[junit4] 2> 1174992 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 1174992 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.SolrCloudTestCase active slice count: 2 expected: 2
[junit4] 2> 1174992 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.SolrCloudTestCase active replica count: 0 expected replica count: 0
[junit4] 2> 1174992 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating jetty instances pullReplicaCount=0 numOtherReplicas=3
[junit4] 2> 1176637 INFO (OverseerCollectionConfigSetProcessor-72113016244207621-127.0.0.1:53452_-n_0000000000) [n:127.0.0.1:53452_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1177367 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_40CC6A9814639198-001/shard-1-001 of type NRT for shard2
[junit4] 2> 1177412 INFO (closeThreadPool-9826-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 1177412 INFO (closeThreadPool-9826-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 1177412 INFO (closeThreadPool-9826-thread-1) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14+36
[junit4] 2> 1177490 INFO (closeThreadPool-9826-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1177490 INFO (closeThreadPool-9826-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1177490 INFO (closeThreadPool-9826-thread-1) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 1177501 INFO (closeThreadPool-9826-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@747790e4{/,null,AVAILABLE}
[junit4] 2> 1177523 INFO (closeThreadPool-9826-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@251f321d{ssl, (ssl, alpn, http/1.1, h2)}{127.0.0.1:53461}
[junit4] 2> 1177523 INFO (closeThreadPool-9826-thread-1) [ ] o.e.j.s.Server Started @1177627ms
[junit4] 2> 1177523 INFO (closeThreadPool-9826-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_40CC6A9814639198-001/tempDir-001/jetty1, hostPort=53461, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_40CC6A9814639198-001/shard-1-001/cores}
[junit4] 2> 1177523 ERROR (closeThreadPool-9826-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1177523 INFO (closeThreadPool-9826-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1177524 INFO (closeThreadPool-9826-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 1177524 INFO (closeThreadPool-9826-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1177524 INFO (closeThreadPool-9826-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 1177524 INFO (closeThreadPool-9826-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-05-27T09:13:56.358111Z
[junit4] 2> 1177527 INFO (closeThreadPool-9826-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1177538 INFO (zkConnectionManagerCallback-9828-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1177549 INFO (closeThreadPool-9826-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1177746 INFO (closeThreadPool-9826-thread-1) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1177746 INFO (closeThreadPool-9826-thread-1) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_40CC6A9814639198-001/shard-1-001/solr.xml
[junit4] 2> 1177790 INFO (closeThreadPool-9826-thread-1) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@e65ee7b, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1178583 INFO (closeThreadPool-9826-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 1178593 WARN (closeThreadPool-9826-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@555abefe[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1178593 WARN (closeThreadPool-9826-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@555abefe[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1178613 WARN (closeThreadPool-9826-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@7dd189de[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1178613 WARN (closeThreadPool-9826-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@7dd189de[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1178623 INFO (closeThreadPool-9826-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53436/solr
[junit4] 2> 1178648 INFO (closeThreadPool-9826-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1178661 INFO (zkConnectionManagerCallback-9839-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1178661 INFO (closeThreadPool-9826-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1178783 INFO (closeThreadPool-9826-thread-1) [n:127.0.0.1:53461_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1178794 INFO (zkConnectionManagerCallback-9841-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1178794 INFO (closeThreadPool-9826-thread-1) [n:127.0.0.1:53461_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1178890 INFO (closeThreadPool-9826-thread-1) [n:127.0.0.1:53461_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1178958 INFO (closeThreadPool-9826-thread-1) [n:127.0.0.1:53461_ ] o.a.s.c.ZkController Publish node=127.0.0.1:53461_ as DOWN
[junit4] 2> 1178967 INFO (closeThreadPool-9826-thread-1) [n:127.0.0.1:53461_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1178967 INFO (closeThreadPool-9826-thread-1) [n:127.0.0.1:53461_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53461_
[junit4] 2> 1178987 INFO (zkCallback-9796-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1178988 INFO (zkCallback-9824-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1178992 INFO (zkCallback-9840-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1179037 INFO (closeThreadPool-9826-thread-1) [n:127.0.0.1:53461_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 1179038 WARN (closeThreadPool-9826-thread-1) [n:127.0.0.1:53461_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 1179079 INFO (closeThreadPool-9826-thread-1) [n:127.0.0.1:53461_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1179139 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_40CC6A9814639198-001/shard-2-001 of type NRT for shard1
[junit4] 2> 1179155 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 1179155 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 1179155 INFO (closeThreadPool-9826-thread-2) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14+36
[junit4] 2> 1179158 INFO (closeThreadPool-9826-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1179158 INFO (closeThreadPool-9826-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1179158 INFO (closeThreadPool-9826-thread-2) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 1179159 INFO (closeThreadPool-9826-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4b0707be{/,null,AVAILABLE}
[junit4] 2> 1179161 INFO (closeThreadPool-9826-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@af57b7a{ssl, (ssl, alpn, http/1.1, h2)}{127.0.0.1:53465}
[junit4] 2> 1179166 INFO (closeThreadPool-9826-thread-2) [ ] o.e.j.s.Server Started @1179271ms
[junit4] 2> 1179166 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_40CC6A9814639198-001/tempDir-001/jetty2, hostPort=53465, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_40CC6A9814639198-001/shard-2-001/cores}
[junit4] 2> 1179167 ERROR (closeThreadPool-9826-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1179167 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1179167 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 1179167 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1179167 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 1179167 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-05-27T09:13:58.001707Z
[junit4] 2> 1179169 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1179170 INFO (closeThreadPool-9826-thread-1) [n:127.0.0.1:53461_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e65ee7b
[junit4] 2> 1179174 INFO (zkConnectionManagerCallback-9850-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1179174 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1179187 INFO (closeThreadPool-9826-thread-1) [n:127.0.0.1:53461_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e65ee7b
[junit4] 2> 1179188 INFO (closeThreadPool-9826-thread-1) [n:127.0.0.1:53461_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e65ee7b
[junit4] 2> 1179190 INFO (closeThreadPool-9826-thread-1) [n:127.0.0.1:53461_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_40CC6A9814639198-001/shard-1-001/cores
[junit4] 2> 1179291 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1179291 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_40CC6A9814639198-001/shard-2-001/solr.xml
[junit4] 2> 1179302 INFO (closeThreadPool-9826-thread-1) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:53461_
[junit4] 2> 1179304 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@e65ee7b, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1179438 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 1179440 WARN (closeThreadPool-9826-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@4b25cb76[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1179441 WARN (closeThreadPool-9826-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@4b25cb76[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1179464 WARN (closeThreadPool-9826-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@1e5aba51[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1179464 WARN (closeThreadPool-9826-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@1e5aba51[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1179467 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53436/solr
[junit4] 2> 1179475 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1179484 INFO (zkConnectionManagerCallback-9862-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1179517 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1179684 INFO (closeThreadPool-9826-thread-2) [n:127.0.0.1:53465_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1179705 INFO (zkConnectionManagerCallback-9864-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1179710 INFO (closeThreadPool-9826-thread-2) [n:127.0.0.1:53465_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1179830 INFO (closeThreadPool-9826-thread-2) [n:127.0.0.1:53465_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1179951 INFO (closeThreadPool-9826-thread-2) [n:127.0.0.1:53465_ ] o.a.s.c.ZkController Publish node=127.0.0.1:53465_ as DOWN
[junit4] 2> 1179979 INFO (closeThreadPool-9826-thread-2) [n:127.0.0.1:53465_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1179979 INFO (closeThreadPool-9826-thread-2) [n:127.0.0.1:53465_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53465_
[junit4] 2> 1179997 INFO (zkCallback-9840-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1180029 INFO (zkCallback-9796-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1180033 INFO (zkCallback-9863-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1180069 INFO (zkCallback-9824-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1180101 INFO (closeThreadPool-9826-thread-2) [n:127.0.0.1:53465_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 1180102 WARN (closeThreadPool-9826-thread-2) [n:127.0.0.1:53465_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 1180144 INFO (closeThreadPool-9826-thread-2) [n:127.0.0.1:53465_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1180192 INFO (closeThreadPool-9826-thread-2) [n:127.0.0.1:53465_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e65ee7b
[junit4] 2> 1180211 INFO (closeThreadPool-9826-thread-2) [n:127.0.0.1:53465_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e65ee7b
[junit4] 2> 1180212 INFO (closeThreadPool-9826-thread-2) [n:127.0.0.1:53465_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e65ee7b
[junit4] 2> 1180217 INFO (closeThreadPool-9826-thread-2) [n:127.0.0.1:53465_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_40CC6A9814639198-001/shard-2-001/cores
[junit4] 2> 1180257 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:53465_
[junit4] 2> 1180687 INFO (TEST-MultiThreadedOCPTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_40CC6A9814639198-001/shard-3-001 of type NRT for shard2
[junit4] 2> 1180698 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 1180698 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 1180698 INFO (closeThreadPool-9826-thread-2) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14+36
[junit4] 2> 1180729 INFO (closeThreadPool-9826-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1180729 INFO (closeThreadPool-9826-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1180729 INFO (closeThreadPool-9826-thread-2) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 1180730 INFO (closeThreadPool-9826-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2788c0f2{/,null,AVAILABLE}
[junit4] 2> 1180743 INFO (closeThreadPool-9826-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4a318272{ssl, (ssl, alpn, http/1.1, h2)}{127.0.0.1:53469}
[junit4] 2> 1180743 INFO (closeThreadPool-9826-thread-2) [ ] o.e.j.s.Server Started @1180848ms
[junit4] 2> 1180743 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, solrconfig=solrconfig.xml, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_40CC6A9814639198-001/tempDir-001/jetty3, hostPort=53469, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_40CC6A9814639198-001/shard-3-001/cores}
[junit4] 2> 1180744 ERROR (closeThreadPool-9826-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1180744 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1180744 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 1180744 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1180744 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 1180744 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-05-27T09:13:59.578509Z
[junit4] 2> 1180747 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1180781 INFO (zkConnectionManagerCallback-9874-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1180795 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1180961 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1180961 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_40CC6A9814639198-001/shard-3-001/solr.xml
[junit4] 2> 1180968 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@e65ee7b, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1181152 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 1181157 WARN (closeThreadPool-9826-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@61dfbf0e[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1181157 WARN (closeThreadPool-9826-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@61dfbf0e[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1181176 WARN (closeThreadPool-9826-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@40109a62[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1181176 WARN (closeThreadPool-9826-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@40109a62[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1181177 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53436/solr
[junit4] 2> 1181182 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1181216 INFO (zkConnectionManagerCallback-9885-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1181236 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1181377 INFO (closeThreadPool-9826-thread-2) [n:127.0.0.1:53469_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1181390 INFO (zkConnectionManagerCallback-9887-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1181391 INFO (closeThreadPool-9826-thread-2) [n:127.0.0.1:53469_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1181721 INFO (closeThreadPool-9826-thread-2) [n:127.0.0.1:53469_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1181943 INFO (closeThreadPool-9826-thread-2) [n:127.0.0.1:53469_ ] o.a.s.c.ZkController Publish node=127.0.0.1:53469_ as DOWN
[junit4] 2> 1181964 INFO (closeThreadPool-9826-thread-2) [n:127.0.0.1:53469_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1181964 INFO (closeThreadPool-9826-thread-2) [n:127.0.0.1:53469_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53469_
[junit4] 2> 1182038 INFO (zkCallback-9863-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1182038 INFO (zkCallback-9796-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1182039 INFO (zkCallback-9840-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1182040 INFO (zkCallback-9824-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1182042 INFO (zkCallback-9886-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1182081 INFO (closeThreadPool-9826-thread-2) [n:127.0.0.1:53469_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 1182082 WARN (closeThreadPool-9826-thread-2) [n:127.0.0.1:53469_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 1182130 INFO (closeThreadPool-9826-thread-2) [n:127.0.0.1:53469_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1182212 INFO (closeThreadPool-9826-thread-2) [n:127.0.0.1:53469_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e65ee7b
[junit4] 2> 1182259 INFO (closeThreadPool-9826-thread-2) [n:127.0.0.1:53469_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e65ee7b
[junit4] 2> 1182260 INFO (closeThreadPool-9826-thread-2) [n:127.0.0.1:53469_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e65ee7b
[junit4] 2> 1182262 INFO (closeThreadPool-9826-thread-2) [n:127.0.0.1:53469_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_40CC6A9814639198-001/shard-3-001/cores
[junit4] 2> 1182289 INFO (closeThreadPool-9826-thread-2) [ ] o.a.s.c.AbstractFullDistribZkTestBase waitForLiveNode: 127.0.0.1:53469_
[junit4] 2> 1182310 INFO (qtp352470617-14403) [n:127.0.0.1:53452_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:53465_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1182327 INFO (qtp352470617-14408) [n:127.0.0.1:53452_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:53469_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1182355 INFO (qtp352470617-14407) [n:127.0.0.1:53452_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:53461_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1182389 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.control_collection.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=12
[junit4] 2> 1182394 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=1
[junit4] 2> 1182439 INFO (qtp1679964198-14466) [n:127.0.0.1:53461_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=1
[junit4] 2> 1182471 INFO (qtp2050599408-14492) [n:127.0.0.1:53465_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=1
[junit4] 2> 1182498 INFO (qtp204917369-14525) [n:127.0.0.1:53469_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=1
[junit4] 2> 1182539 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.control_collection.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=5
[junit4] 2> 1182547 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=1
[junit4] 2> 1182553 INFO (qtp1679964198-14463) [n:127.0.0.1:53461_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 1182564 INFO (qtp2050599408-14490) [n:127.0.0.1:53465_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 1182570 INFO (qtp204917369-14523) [n:127.0.0.1:53469_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 1182577 INFO (OverseerThreadFactory-9804-thread-3-processing-n:127.0.0.1:53452_) [n:127.0.0.1:53452_ c:collection1 s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:53465_ for creating new replica of shard shard1 for collection collection1
[junit4] 2> 1182598 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.control_collection.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=13
[junit4] 2> 1182608 INFO (qtp352470617-14406) [n:127.0.0.1:53452_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=4
[junit4] 2> 1182616 INFO (qtp1679964198-14464) [n:127.0.0.1:53461_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 1182621 INFO (qtp2050599408-14491) [n:127.0.0.1:53465_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=1
[junit4] 2> 1182631 INFO (qtp204917369-14524) [n:127.0.0.1:53469_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 1182636 INFO (OverseerThreadFactory-9804-thread-4-processing-n:127.0.0.1:53452_) [n:127.0.0.1:53452_ c:collection1 s:shard2 ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:53469_ for creating new replica of shard shard2 for collection collection1
[junit4] 2> 1182739 INFO (OverseerThreadFactory-9804-thread-3-processing-n:127.0.0.1:53452_) [n:127.0.0.1:53452_ c:collection1 s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 1182777 INFO (OverseerThreadFactory-9804-thread-4-processing-n:127.0.0.1:53452_) [n:127.0.0.1:53452_ c:collection1 s:shard2 ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 1182919 INFO (qtp204917369-14523) [n:127.0.0.1:53469_ x:collection1_shard2_replica_n2 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n2&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1183002 INFO (qtp2050599408-14490) [n:127.0.0.1:53465_ x:collection1_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n1&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1184802 INFO (qtp204917369-14523) [n:127.0.0.1:53469_ c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 1184807 INFO (qtp2050599408-14490) [n:127.0.0.1:53465_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 1184869 INFO (qtp2050599408-14490) [n:127.0.0.1:53465_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=test
[junit4] 2> 1184873 INFO (qtp204917369-14523) [n:127.0.0.1:53469_ c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.s.IndexSchema Schema name=test
[junit4] 2> 1187781 INFO (qtp2050599408-14490) [n:127.0.0.1:53465_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 1187861 INFO (qtp204917369-14523) [n:127.0.0.1:53469_ c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 1188149 INFO (qtp2050599408-14490) [n:127.0.0.1:53465_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n1' using configuration from configset conf1, trusted=true
[junit4] 2> 1188150 INFO (qtp2050599408-14490) [n:127.0.0.1:53465_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n1' (registry 'solr.core.collection1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e65ee7b
[junit4] 2> 1188150 INFO (qtp2050599408-14490) [n:127.0.0.1:53465_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SolrCore [[collection1_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_40CC6A9814639198-001/shard-2-001/cores/collection1_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_40CC6A9814639198-001/shard-2-001/cores/collection1_shard1_replica_n1/data/]
[junit4] 2> 1188156 INFO (qtp2050599408-14490) [n:127.0.0.1:53465_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=27, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1188167 WARN (qtp2050599408-14490) [n:127.0.0.1:53465_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A, b=B}}}
[junit4] 2> 1188383 INFO (qtp204917369-14523) [n:127.0.0.1:53469_ c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n2' using configuration from configset conf1, trusted=true
[junit4] 2> 1188384 INFO (qtp204917369-14523) [n:127.0.0.1:53469_ c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n2' (registry 'solr.core.collection1.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e65ee7b
[junit4] 2> 1188384 INFO (qtp204917369-14523) [n:127.0.0.1:53469_ c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.c.SolrCore [[collection1_shard2_replica_n2] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_40CC6A9814639198-001/shard-3-001/cores/collection1_shard2_replica_n2], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.MultiThreadedOCPTest_40CC6A9814639198-001/shard-3-001/cores/collection1_shard2_replica_n2/data/]
[junit4] 2> 1188387 INFO (qtp204917369-14523) [n:127.0.0.1:53469_ c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=27, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1188392 WARN (qtp204917369-14523) [n:127.0.0.1:53469_ c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A, b=B}}}
[junit4] 2> 1188409 INFO (qtp2050599408-14490) [n:127.0.0.1:53465_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1188409 INFO (qtp2050599408-14490) [n:127.0.0.1:53465_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1188411 INFO (qtp2050599408-14490) [n:127.0.0.1:53465_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1188411 INFO (qtp2050599408-14490) [n:127.0.0.1:53465_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1188421 INFO (qtp2050599408-14490) [n:127.0.0.1:53465_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=28, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6794251971153137]
[junit4] 2> 1188457 INFO (qtp2050599408-14490) [n:127.0.0.1:53465_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1188467 INFO (qtp2050599408-14490) [n:127.0.0.1:53465_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1188468 INFO (qtp2050599408-14490) [n:127.0.0.1:53465_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
[junit4] 2> 1188473 INFO (qtp2050599408-14490) [n:127.0.0.1:53465_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1667834416785784832
[junit4] 2> 1188486 INFO (searcherExecutor-9898-thread-1-processing-n:127.0.0.1:53465_ x:collection1_shard1_replica_n1 c:collection1 s:shard1) [n:127.0.0.1:53465_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SolrCore [collection1_shard1_replica_n1] Registered new searcher autowarm time: 0 ms: Collection: 'collection1'
[junit4] 2> 1188538 INFO (qtp204917369-14523) [n:127.0.0.1:53469_ c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1188538 INFO (qtp204917369-14523) [n:127.0.0.1:53469_ c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1188553 INFO (qtp204917369-14523) [n:127.0.0.1:53469_ c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1188553 INFO (qtp204917369-14523) [n:127.0.0.1:53469_ c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1188563 INFO (qtp204917369-14523) [n:127.0.0.1:53469_ c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=28, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6794251971153137]
[junit4] 2> 1188576 INFO (qtp204917369-14523) [n:127.0.0.1:53469_ c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1188578 INFO (qtp204917369-14523) [n:127.0.0.1:53469_ c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1188579 INFO (qtp204917369-14523) [n:127.0.0.1:53469_ c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
[junit4] 2> 1188579 INFO (qtp204917369-14523) [n:127.0.0.1:53469_ c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1667834416896933888
[junit4] 2> 1188581 INFO (qtp2050599408-14490) [n:127.0.0.1:53465_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard1 to Terms{values={core_node3=0}, version=0}
[junit4] 2> 1188581 INFO (qtp2050599408-14490) [n:127.0.0.1:53465_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard1
[junit4] 2> 1188590 INFO (searcherExecutor-9901-thread-1-processing-n:127.0.0.1:53469_ x:collection1_shard2_replica_n2 c:collection1 s:shard2) [n:127.0.0.1:53469_ c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.c.SolrCore [collection1_shard2_replica_n2] Registered new searcher autowarm time: 0 ms: Collection: 'collection1'
[junit4] 2> 1188771 INFO (qtp204917369-14523) [n:127.0.0.1:53469_ c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/collection1/terms/shard2 to Terms{values={core_node4=0}, version=0}
[junit4] 2> 1188771 INFO (qtp204917369-14523) [n:127.0.0.1:53469_ c:collection1 s:shard2 x:collection1_shard2_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/collection1/leaders/shard2
[junit4] 2> 1188792 INFO (qtp2050599408-14490) [n:127.0.0.1:53465_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1188792 INFO (qtp2050599408-14490) [n:127.0.0.1:53465_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1188792 INFO (qtp2050599408-14490) [n:127.0.0.1:53465_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:53465/collection1_shard1_replica_n1/
[junit4] 2> 1188792 INFO (qtp2050599408-14490) [n:127.0.0.1:53465_ c:collection1 s:shard1 x:collection1_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1188792 INFO (qtp2050599408-14490) [n:1
[...truncated too long message...]
,
[junit4] 1> "actions":[
[junit4] 1> {
[junit4] 1> "name":"inactive_shard_plan",
[junit4] 1> "class":"solr.InactiveShardPlanAction"},
[junit4] 1> {
[junit4] 1> "name":"inactive_markers_plan",
[junit4] 1> "class":"solr.InactiveMarkersPlanAction"},
[junit4] 1> {
[junit4] 1> "name":"execute_plan",
[junit4] 1> "class":"solr.ExecutePlanAction"}]}},
[junit4] 1> "listeners":{
[junit4] 1> ".auto_add_replicas.system":{
[junit4] 1> "beforeAction":[],
[junit4] 1> "afterAction":[],
[junit4] 1> "stage":[
[junit4] 1> "STARTED",
[junit4] 1> "ABORTED",
[junit4] 1> "SUCCEEDED",
[junit4] 1> "FAILED",
[junit4] 1> "BEFORE_ACTION",
[junit4] 1> "AFTER_ACTION",
[junit4] 1> "IGNORED"],
[junit4] 1> "trigger":".auto_add_replicas",
[junit4] 1> "class":"org.apache.solr.cloud.autoscaling.SystemLogListener"},
[junit4] 1> ".scheduled_maintenance.system":{
[junit4] 1> "beforeAction":[],
[junit4] 1> "afterAction":[],
[junit4] 1> "stage":[
[junit4] 1> "STARTED",
[junit4] 1> "ABORTED",
[junit4] 1> "SUCCEEDED",
[junit4] 1> "FAILED",
[junit4] 1> "BEFORE_ACTION",
[junit4] 1> "AFTER_ACTION",
[junit4] 1> "IGNORED"],
[junit4] 1> "trigger":".scheduled_maintenance",
[junit4] 1> "class":"org.apache.solr.cloud.autoscaling.SystemLogListener"}},
[junit4] 1> "properties":{}}
[junit4] 1> /solr/clusterprops.json (0)
[junit4] 1> DATA:
[junit4] 1> {"legacyCloud":"true"}
[junit4] 1>
[junit4] 2> 1809403 INFO (TEST-PeerSyncReplicationTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
[junit4] 2> 1809616 INFO (TEST-PeerSyncReplicationTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:57396
[junit4] 2> 1809616 INFO (TEST-PeerSyncReplicationTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:57396
[junit4] 2> 1809616 INFO (TEST-PeerSyncReplicationTest.test-seed#[40CC6A9814639198]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 57396
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=PeerSyncReplicationTest -Dtests.method=test -Dtests.seed=40CC6A9814639198 -Dtests.slow=true -Dtests.locale=en-FI -Dtests.timezone=Europe/Mariehamn -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] FAILURE 98.0s J4 | PeerSyncReplicationTest.test <<<
[junit4] > Throwable #1: java.lang.AssertionError: expected:<0> but was:<1>
[junit4] > at __randomizedtesting.SeedInfo.seed([40CC6A9814639198:C8985542BA9FFC60]:0)
[junit4] > at org.apache.solr.cloud.PeerSyncReplicationTest.test(PeerSyncReplicationTest.java:202)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:564)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1081)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1053)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:832)
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.PeerSyncReplicationTest_40CC6A9814639198-001
[junit4] 2> May 27, 2020 9:24:28 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene86): {rnd_s=Lucene84, multiDefault=Lucene84, a_t=PostingsFormat(name=LuceneVarGapFixedInterval), _root_=PostingsFormat(name=LuceneVarGapFixedInterval), id=FST50, text=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene84))}, docValues:{other_tl1=DocValuesFormat(name=Asserting), range_facet_l_dv=DocValuesFormat(name=Lucene80), _version_=DocValuesFormat(name=Asserting), intDefault=DocValuesFormat(name=Asserting), id_i1=DocValuesFormat(name=Asserting), a_i1=DocValuesFormat(name=Asserting), range_facet_i_dv=DocValuesFormat(name=Asserting), intDvoDefault=DocValuesFormat(name=Lucene80), timestamp=DocValuesFormat(name=Asserting), range_facet_l=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=1994, maxMBSortInHeap=6.636845380568779, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@42d14e42), locale=en-FI, timezone=Europe/Mariehamn
[junit4] 2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 14 (64-bit)/cpus=6,threads=1,free=243269632,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [TriggerIntegrationTest, TestSerializedLuceneMatchVersion, AnalyticsMergeStrategyTest, MoreLikeThisComponentTest, TestUtilizeNode, DeleteNodeTest, JSONWriterTest, PeerSyncWithIndexFingerprintCachingTest, TestRTGBase, TestReplicationHandlerDiskOverFlow, OutOfBoxZkACLAndCredentialsProvidersTest, DistributedSpellCheckComponentTest, TestDistributedGrouping, IndexBasedSpellCheckerTest, ScriptEngineTest, LeaderFailureAfterFreshStartTest, TestCloudPivotFacet, LargeFieldTest, DisMaxRequestHandlerTest, CurrencyFieldTypeTest, SolrXmlInZkTest, SolrCoreTest, SpatialHeatmapFacetsTest, DistributedFacetPivotWhiteBoxTest, TaggingAttributeTest, TestMinHashQParser, AutoScalingHandlerTest, BlockDirectoryTest, RemoteQueryErrorTest, TestConfigReload, JavabinLoaderTest, TestDFRSimilarityFactory, TestCoreDiscovery, SuggestComponentTest, CoreAdminCreateDiscoverTest, TestRSAKeyPair, TestNonDefinedSimilarityFactory, TestSortableTextField, TestValueSourceCache, TestFastOutputStream, ManagedSchemaRoundRobinCloudTest, NodeAddedTriggerIntegrationTest, TestExpandComponent, SecurityConfHandlerTest, SolrShardReporterTest, V2StandaloneTest, TestLocalFSCloudBackupRestore, SparseHLLTest, TestRawResponseWriter, TestDocTermOrdsUninvertLimit, TestQuerySenderNoQuery, BadCopyFieldTest, RollingRestartTest, TriLevelCompositeIdRoutingTest, UpdateLogTest, CustomHighlightComponentTest, NestedAtomicUpdateTest, TestOmitPositions, TestScoreJoinQPNoScore, TestStressLiveNodes, OverseerSolrResponseTest, CleanupOldIndexTest, TestExactSharedStatsCacheCloud, TestPKIAuthenticationPlugin, TestDynamicLoadingUrl, ConcurrentCreateCollectionTest, TestDynamicFieldCollectionResource, ForceLeaderTest, SuggesterWFSTTest, TestSolrConfigHandlerCloud, DirectoryFactoryTest, LukeRequestHandlerTest, DistributedFacetExistsSmallTest, TestSimUtils, HdfsThreadLeakTest, PingRequestHandlerTest, TestSolrCoreProperties, TestEmbeddedSolrServerSchemaAPI, TestSlowCompositeReaderWrapper, SolrCmdDistributorTest, DaemonStreamApiTest, TestOnReconnectListenerSupport, SimpleCollectionCreateDeleteTest, DistanceFunctionTest, SubstringBytesRefFilterTest, TestSuggestSpellingConverter, TestFreeTextSuggestions, TestDocBasedVersionConstraints, ShardRoutingTest, TestDocumentBuilder, TestGroupingSearch, TestHighlightDedupGrouping, TestTrie, PathHierarchyTokenizerFactoryTest, TestDeprecatedFilters, TestReversedWildcardFilterFactory, TestWordDelimiterFilterFactory, AliasIntegrationTest, ConfigSetsAPITest, DeleteStatusTest, DistribDocExpirationUpdateProcessorTest, LeaderElectionTest, MissingSegmentRecoveryTest, OverseerTest, PackageManagerCLITest, PeerSyncReplicationTest]
[junit4] Completed [518/913 (2!)] on J4 in 98.89s, 1 test, 1 failure <<< FAILURES!
[...truncated 46192 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/6076/consoleText
[repro] Revision: ac80fb9979c26e357a561a609ecd754a1c33c561
[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseZGC"
[repro] Repro line: ant test -Dtestcase=MultiThreadedOCPTest -Dtests.method=test -Dtests.seed=40CC6A9814639198 -Dtests.slow=true -Dtests.locale=en-VG -Dtests.timezone=PST8PDT -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[repro] Repro line: ant test -Dtestcase=PeerSyncReplicationTest -Dtests.method=test -Dtests.seed=40CC6A9814639198 -Dtests.slow=true -Dtests.locale=en-FI -Dtests.timezone=Europe/Mariehamn -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] MultiThreadedOCPTest
[repro] PeerSyncReplicationTest
[repro] ant compile-test
[...truncated 3158 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=10 -Dtests.class="*.MultiThreadedOCPTest|*.PeerSyncReplicationTest" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseZGC" -Dtests.seed=40CC6A9814639198 -Dtests.slow=true -Dtests.locale=en-VG -Dtests.timezone=PST8PDT -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[...truncated 110 lines...]
[repro] Failures w/original seeds:
[repro] 0/5 failed: org.apache.solr.cloud.MultiThreadedOCPTest
[repro] 0/5 failed: org.apache.solr.cloud.PeerSyncReplicationTest
[repro] Exiting with code 0
[...truncated 73 lines...]
[JENKINS] Lucene-Solr-master-MacOSX (64bit/jdk-14) - Build # 6075 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/6075/
Java: 64bit/jdk-14 -XX:+UseCompressedOops -XX:+UseG1GC
2 tests failed.
FAILED: org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitAfterFailedSplit
Error Message:
Shard split did not succeed after a previous failed split attempt left sub-shards in construction state
Stack Trace:
java.lang.AssertionError: Shard split did not succeed after a previous failed split attempt left sub-shards in construction state
at __randomizedtesting.SeedInfo.seed([B7C0DF610159713C:4E8D4CCE3D2C3CB6]:0)
at org.junit.Assert.fail(Assert.java:88)
at org.apache.solr.cloud.api.collections.ShardSplitTest.splitAfterFailedSplit(ShardSplitTest.java:331)
at org.apache.solr.cloud.api.collections.ShardSplitTest.testSplitAfterFailedSplit(ShardSplitTest.java:293)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1081)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1053)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
at java.base/java.lang.Thread.run(Thread.java:832)
FAILED: org.apache.solr.cloud.autoscaling.MetricTriggerIntegrationTest.testMetricTrigger
Error Message:
The trigger did not fire at all
Stack Trace:
java.lang.AssertionError: The trigger did not fire at all
at __randomizedtesting.SeedInfo.seed([B7C0DF610159713C:DCCE8EE5EB1A773]:0)
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.apache.solr.cloud.autoscaling.MetricTriggerIntegrationTest.testMetricTrigger(MetricTriggerIntegrationTest.java:150)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
at java.base/java.lang.Thread.run(Thread.java:832)
Build Log:
[...truncated 14863 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.MetricTriggerIntegrationTest
[junit4] 2> 1942893 INFO (SUITE-MetricTriggerIntegrationTest-seed#[B7C0DF610159713C]-worker) [ ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/server/solr/configsets/_default/conf'
[junit4] 2> 1942893 INFO (SUITE-MetricTriggerIntegrationTest-seed#[B7C0DF610159713C]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1942894 INFO (SUITE-MetricTriggerIntegrationTest-seed#[B7C0DF610159713C]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.autoscaling.MetricTriggerIntegrationTest_B7C0DF610159713C-001/data-dir-129-001
[junit4] 2> 1942894 WARN (SUITE-MetricTriggerIntegrationTest-seed#[B7C0DF610159713C]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=27 numCloses=27
[junit4] 2> 1942895 INFO (SUITE-MetricTriggerIntegrationTest-seed#[B7C0DF610159713C]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 1942896 INFO (SUITE-MetricTriggerIntegrationTest-seed#[B7C0DF610159713C]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 1942896 INFO (SUITE-MetricTriggerIntegrationTest-seed#[B7C0DF610159713C]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.autoscaling.MetricTriggerIntegrationTest_B7C0DF610159713C-001/tempDir-001
[junit4] 2> 1942896 INFO (SUITE-MetricTriggerIntegrationTest-seed#[B7C0DF610159713C]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1942897 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
[junit4] 2> 1942897 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1943007 INFO (SUITE-MetricTriggerIntegrationTest-seed#[B7C0DF610159713C]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port: 51142
[junit4] 2> 1943007 INFO (SUITE-MetricTriggerIntegrationTest-seed#[B7C0DF610159713C]-worker) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:51142
[junit4] 2> 1943007 INFO (SUITE-MetricTriggerIntegrationTest-seed#[B7C0DF610159713C]-worker) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:51142
[junit4] 2> 1943007 INFO (SUITE-MetricTriggerIntegrationTest-seed#[B7C0DF610159713C]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 51142
[junit4] 2> 1943009 INFO (SUITE-MetricTriggerIntegrationTest-seed#[B7C0DF610159713C]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1943013 INFO (zkConnectionManagerCallback-21199-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1943013 INFO (SUITE-MetricTriggerIntegrationTest-seed#[B7C0DF610159713C]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1943016 INFO (SUITE-MetricTriggerIntegrationTest-seed#[B7C0DF610159713C]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1943019 INFO (zkConnectionManagerCallback-21201-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1943019 INFO (SUITE-MetricTriggerIntegrationTest-seed#[B7C0DF610159713C]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1943020 INFO (SUITE-MetricTriggerIntegrationTest-seed#[B7C0DF610159713C]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1943023 INFO (zkConnectionManagerCallback-21203-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1943023 INFO (SUITE-MetricTriggerIntegrationTest-seed#[B7C0DF610159713C]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1943135 INFO (jetty-launcher-21204-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 1943135 INFO (jetty-launcher-21204-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 1943135 INFO (jetty-launcher-21204-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 1943135 INFO (jetty-launcher-21204-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 1943135 INFO (jetty-launcher-21204-thread-1) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14+36
[junit4] 2> 1943135 INFO (jetty-launcher-21204-thread-2) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14+36
[junit4] 2> 1943138 INFO (jetty-launcher-21204-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1943138 INFO (jetty-launcher-21204-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1943138 INFO (jetty-launcher-21204-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1943138 INFO (jetty-launcher-21204-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1943138 INFO (jetty-launcher-21204-thread-1) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 1943138 INFO (jetty-launcher-21204-thread-2) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 1943139 INFO (jetty-launcher-21204-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3a2454f0{/solr,null,AVAILABLE}
[junit4] 2> 1943139 INFO (jetty-launcher-21204-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2281e26c{/solr,null,AVAILABLE}
[junit4] 2> 1943139 INFO (jetty-launcher-21204-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@52991709{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:51147}
[junit4] 2> 1943139 INFO (jetty-launcher-21204-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6bf039db{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:51148}
[junit4] 2> 1943139 INFO (jetty-launcher-21204-thread-1) [ ] o.e.j.s.Server Started @1943224ms
[junit4] 2> 1943139 INFO (jetty-launcher-21204-thread-2) [ ] o.e.j.s.Server Started @1943224ms
[junit4] 2> 1943139 INFO (jetty-launcher-21204-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=51148}
[junit4] 2> 1943139 INFO (jetty-launcher-21204-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=51147}
[junit4] 2> 1943140 ERROR (jetty-launcher-21204-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1943140 ERROR (jetty-launcher-21204-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1943140 INFO (jetty-launcher-21204-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1943140 INFO (jetty-launcher-21204-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1943140 INFO (jetty-launcher-21204-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 9.0.0
[junit4] 2> 1943140 INFO (jetty-launcher-21204-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 9.0.0
[junit4] 2> 1943140 INFO (jetty-launcher-21204-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1943140 INFO (jetty-launcher-21204-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1943140 INFO (jetty-launcher-21204-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 1943140 INFO (jetty-launcher-21204-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 1943140 INFO (jetty-launcher-21204-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-05-27T03:30:29.851156Z
[junit4] 2> 1943140 INFO (jetty-launcher-21204-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-05-27T03:30:29.851158Z
[junit4] 2> 1943140 INFO (jetty-launcher-21204-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1943141 INFO (jetty-launcher-21204-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1943143 INFO (zkConnectionManagerCallback-21208-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1943143 INFO (jetty-launcher-21204-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1943143 INFO (zkConnectionManagerCallback-21207-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1943144 INFO (jetty-launcher-21204-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1943144 INFO (jetty-launcher-21204-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1943144 INFO (jetty-launcher-21204-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1943268 INFO (jetty-launcher-21204-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 1943269 WARN (jetty-launcher-21204-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@56f40603[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1943270 WARN (jetty-launcher-21204-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@56f40603[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1943273 WARN (jetty-launcher-21204-thread-1) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@66c2d55c[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1943273 WARN (jetty-launcher-21204-thread-1) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@66c2d55c[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1943274 INFO (jetty-launcher-21204-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51142/solr
[junit4] 2> 1943275 INFO (jetty-launcher-21204-thread-1) [n:127.0.0.1:51147_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1943278 INFO (zkConnectionManagerCallback-21219-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1943278 INFO (jetty-launcher-21204-thread-1) [n:127.0.0.1:51147_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1943377 INFO (jetty-launcher-21204-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 1943379 WARN (jetty-launcher-21204-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@4c395212[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1943379 WARN (jetty-launcher-21204-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@4c395212[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1943383 WARN (jetty-launcher-21204-thread-2) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@d9a8f4a[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1943383 WARN (jetty-launcher-21204-thread-2) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@d9a8f4a[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1943384 INFO (jetty-launcher-21204-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51142/solr
[junit4] 2> 1943385 INFO (jetty-launcher-21204-thread-2) [n:127.0.0.1:51148_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1943390 INFO (zkConnectionManagerCallback-21232-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1943390 INFO (jetty-launcher-21204-thread-2) [n:127.0.0.1:51148_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1943430 INFO (jetty-launcher-21204-thread-2) [n:127.0.0.1:51148_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:51148_solr
[junit4] 2> 1943433 INFO (jetty-launcher-21204-thread-2) [n:127.0.0.1:51148_solr ] o.a.s.c.Overseer Overseer (id=72111666702188550-127.0.0.1:51148_solr-n_0000000000) starting
[junit4] 2> 1943455 INFO (jetty-launcher-21204-thread-2) [n:127.0.0.1:51148_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51148_solr
[junit4] 2> 1943455 INFO (OverseerStateUpdate-72111666702188550-127.0.0.1:51148_solr-n_0000000000) [n:127.0.0.1:51148_solr ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:51148_solr
[junit4] 2> 1943455 DEBUG (OverseerAutoScalingTriggerThread-72111666702188550-127.0.0.1:51148_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
[junit4] 2> 1943460 DEBUG (OverseerAutoScalingTriggerThread-72111666702188550-127.0.0.1:51148_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 1943460 INFO (OverseerStateUpdate-72111666702188550-127.0.0.1:51148_solr-n_0000000000) [n:127.0.0.1:51148_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1943460 DEBUG (OverseerAutoScalingTriggerThread-72111666702188550-127.0.0.1:51148_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 0
[junit4] 2> 1943460 DEBUG (OverseerAutoScalingTriggerThread-72111666702188550-127.0.0.1:51148_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 1943467 INFO (jetty-launcher-21204-thread-2) [n:127.0.0.1:51148_solr ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 1943468 WARN (jetty-launcher-21204-thread-2) [n:127.0.0.1:51148_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 1943476 DEBUG (OverseerAutoScalingTriggerThread-72111666702188550-127.0.0.1:51148_solr-n_0000000000) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:51148_solr]
[junit4] 2> 1943478 DEBUG (OverseerAutoScalingTriggerThread-72111666702188550-127.0.0.1:51148_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded markers
[junit4] 2> 1943480 DEBUG (ScheduledTrigger-21237-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1 and last live nodes: 1
[junit4] 2> 1943480 DEBUG (OverseerAutoScalingTriggerThread-72111666702188550-127.0.0.1:51148_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 1943509 INFO (jetty-launcher-21204-thread-2) [n:127.0.0.1:51148_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1943532 INFO (jetty-launcher-21204-thread-1) [n:127.0.0.1:51147_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1943536 INFO (jetty-launcher-21204-thread-2) [n:127.0.0.1:51148_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51148.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f4881f5
[junit4] 2> 1943546 INFO (jetty-launcher-21204-thread-1) [n:127.0.0.1:51147_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:51147_solr as DOWN
[junit4] 2> 1943548 INFO (jetty-launcher-21204-thread-2) [n:127.0.0.1:51148_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51148.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f4881f5
[junit4] 2> 1943549 INFO (jetty-launcher-21204-thread-2) [n:127.0.0.1:51148_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51148.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f4881f5
[junit4] 2> 1943549 INFO (jetty-launcher-21204-thread-1) [n:127.0.0.1:51147_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 1000 transient cores
[junit4] 2> 1943549 INFO (jetty-launcher-21204-thread-1) [n:127.0.0.1:51147_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51147_solr
[junit4] 2> 1943550 INFO (jetty-launcher-21204-thread-2) [n:127.0.0.1:51148_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.autoscaling.MetricTriggerIntegrationTest_B7C0DF610159713C-001/tempDir-001/node2/.
[junit4] 2> 1943553 INFO (zkCallback-21231-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1943554 INFO (zkCallback-21218-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1943558 INFO (jetty-launcher-21204-thread-1) [n:127.0.0.1:51147_solr ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 1943559 WARN (jetty-launcher-21204-thread-1) [n:127.0.0.1:51147_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 1943581 INFO (jetty-launcher-21204-thread-1) [n:127.0.0.1:51147_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1943603 INFO (jetty-launcher-21204-thread-1) [n:127.0.0.1:51147_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51147.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f4881f5
[junit4] 2> 1943612 INFO (jetty-launcher-21204-thread-1) [n:127.0.0.1:51147_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51147.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f4881f5
[junit4] 2> 1943613 INFO (jetty-launcher-21204-thread-1) [n:127.0.0.1:51147_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51147.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f4881f5
[junit4] 2> 1943614 INFO (jetty-launcher-21204-thread-1) [n:127.0.0.1:51147_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.autoscaling.MetricTriggerIntegrationTest_B7C0DF610159713C-001/tempDir-001/node1/.
[junit4] 2> 1943627 INFO (SUITE-MetricTriggerIntegrationTest-seed#[B7C0DF610159713C]-worker) [ ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=2
[junit4] 2> 1943628 INFO (SUITE-MetricTriggerIntegrationTest-seed#[B7C0DF610159713C]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1943635 INFO (zkConnectionManagerCallback-21255-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1943636 INFO (SUITE-MetricTriggerIntegrationTest-seed#[B7C0DF610159713C]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1943639 INFO (SUITE-MetricTriggerIntegrationTest-seed#[B7C0DF610159713C]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1943643 INFO (SUITE-MetricTriggerIntegrationTest-seed#[B7C0DF610159713C]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:51142/solr ready
[junit4] 2> 1943658 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 1943663 INFO (qtp1549726450-34534) [n:127.0.0.1:51147_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 1943666 INFO (qtp1698155277-34535) [n:127.0.0.1:51148_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 1000 transient cores
[junit4] 2> 1943667 INFO (qtp1698155277-34535) [n:127.0.0.1:51148_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=1
[junit4] 2> 1943668 DEBUG (qtp1549726450-34538) [n:127.0.0.1:51147_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 1943670 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=11
[junit4] 2> 1943671 DEBUG (zkCallback-21231-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 1943672 DEBUG (OverseerAutoScalingTriggerThread-72111666702188550-127.0.0.1:51148_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 1943688 DEBUG (OverseerAutoScalingTriggerThread-72111666702188550-127.0.0.1:51148_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded markers
[junit4] 2> 1943693 DEBUG (OverseerAutoScalingTriggerThread-72111666702188550-127.0.0.1:51148_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 1943739 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testMetricTrigger
[junit4] 2> 1943741 INFO (qtp1549726450-34540) [n:127.0.0.1:51147_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf&maxShardsPerNode=2&name=testMetricTrigger&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1943749 INFO (OverseerThreadFactory-21239-thread-1-processing-n:127.0.0.1:51148_solr) [n:127.0.0.1:51148_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection testMetricTrigger
[junit4] 2> 1943872 DEBUG (OverseerThreadFactory-21239-thread-1-processing-n:127.0.0.1:51148_solr) [n:127.0.0.1:51148_solr ] o.a.s.c.s.c.a.PolicyHelper Creating a new session
[junit4] 2> 1943874 INFO (qtp1549726450-34534) [n:127.0.0.1:51147_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 1943877 INFO (qtp1698155277-34539) [n:127.0.0.1:51148_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 1943877 DEBUG (OverseerThreadFactory-21239-thread-1-processing-n:127.0.0.1:51148_solr) [n:127.0.0.1:51148_solr ] o.a.s.c.s.c.a.PolicyHelper New session created
[junit4] 2> 1943879 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 1943881 INFO (qtp1698155277-34533) [n:127.0.0.1:51148_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 1943886 DEBUG (OverseerThreadFactory-21239-thread-1-processing-n:127.0.0.1:51148_solr) [n:127.0.0.1:51148_solr ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 825084364 sessionWrapper.createTime 825084355421100, this.sessionWrapper.createTime 825084355421100
[junit4] 2> 1943895 INFO (OverseerStateUpdate-72111666702188550-127.0.0.1:51148_solr-n_0000000000) [n:127.0.0.1:51148_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testMetricTrigger",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testMetricTrigger_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:51148/solr",
[junit4] 2> "node_name":"127.0.0.1:51148_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1943902 INFO (OverseerStateUpdate-72111666702188550-127.0.0.1:51148_solr-n_0000000000) [n:127.0.0.1:51148_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testMetricTrigger",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testMetricTrigger_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:51147/solr",
[junit4] 2> "node_name":"127.0.0.1:51147_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1943909 INFO (OverseerStateUpdate-72111666702188550-127.0.0.1:51148_solr-n_0000000000) [n:127.0.0.1:51148_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testMetricTrigger",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"testMetricTrigger_shard2_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:51147/solr",
[junit4] 2> "node_name":"127.0.0.1:51147_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1943916 INFO (OverseerStateUpdate-72111666702188550-127.0.0.1:51148_solr-n_0000000000) [n:127.0.0.1:51148_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testMetricTrigger",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"testMetricTrigger_shard2_replica_n6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:51148/solr",
[junit4] 2> "node_name":"127.0.0.1:51148_solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1944123 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr x:testMetricTrigger_shard1_replica_n2 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testMetricTrigger_shard1_replica_n2&action=CREATE&numShards=2&collection=testMetricTrigger&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1944123 INFO (qtp1698155277-34535) [n:127.0.0.1:51148_solr x:testMetricTrigger_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testMetricTrigger_shard1_replica_n1&action=CREATE&numShards=2&collection=testMetricTrigger&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1944124 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr x:testMetricTrigger_shard2_replica_n4 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=testMetricTrigger_shard2_replica_n4&action=CREATE&numShards=2&collection=testMetricTrigger&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1944124 INFO (qtp1698155277-34539) [n:127.0.0.1:51148_solr x:testMetricTrigger_shard2_replica_n6 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=testMetricTrigger_shard2_replica_n6&action=CREATE&numShards=2&collection=testMetricTrigger&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1944144 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 1944144 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 1944144 INFO (qtp1698155277-34539) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 1944148 INFO (qtp1698155277-34535) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 1944159 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.s.IndexSchema Schema name=minimal
[junit4] 2> 1944159 INFO (qtp1698155277-34539) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.s.IndexSchema Schema name=minimal
[junit4] 2> 1944159 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.s.IndexSchema Schema name=minimal
[junit4] 2> 1944170 INFO (qtp1698155277-34535) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=minimal
[junit4] 2> 1944170 INFO (qtp1698155277-34539) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1944170 INFO (qtp1698155277-34539) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.c.CoreContainer Creating SolrCore 'testMetricTrigger_shard2_replica_n6' using configuration from configset conf, trusted=true
[junit4] 2> 1944170 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1944170 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.c.CoreContainer Creating SolrCore 'testMetricTrigger_shard1_replica_n2' using configuration from configset conf, trusted=true
[junit4] 2> 1944170 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1944170 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.CoreContainer Creating SolrCore 'testMetricTrigger_shard2_replica_n4' using configuration from configset conf, trusted=true
[junit4] 2> 1944171 INFO (qtp1698155277-34539) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51148.solr.core.testMetricTrigger.shard2.replica_n6' (registry 'solr.core.testMetricTrigger.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f4881f5
[junit4] 2> 1944171 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51147.solr.core.testMetricTrigger.shard1.replica_n2' (registry 'solr.core.testMetricTrigger.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f4881f5
[junit4] 2> 1944171 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51147.solr.core.testMetricTrigger.shard2.replica_n4' (registry 'solr.core.testMetricTrigger.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f4881f5
[junit4] 2> 1944171 INFO (qtp1698155277-34539) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.c.SolrCore [[testMetricTrigger_shard2_replica_n6] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.autoscaling.MetricTriggerIntegrationTest_B7C0DF610159713C-001/tempDir-001/node2/./testMetricTrigger_shard2_replica_n6], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.autoscaling.MetricTriggerIntegrationTest_B7C0DF610159713C-001/tempDir-001/node2/./testMetricTrigger_shard2_replica_n6/data/]
[junit4] 2> 1944171 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.c.SolrCore [[testMetricTrigger_shard1_replica_n2] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.autoscaling.MetricTriggerIntegrationTest_B7C0DF610159713C-001/tempDir-001/node1/./testMetricTrigger_shard1_replica_n2], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.autoscaling.MetricTriggerIntegrationTest_B7C0DF610159713C-001/tempDir-001/node1/./testMetricTrigger_shard1_replica_n2/data/]
[junit4] 2> 1944171 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.SolrCore [[testMetricTrigger_shard2_replica_n4] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.autoscaling.MetricTriggerIntegrationTest_B7C0DF610159713C-001/tempDir-001/node1/./testMetricTrigger_shard2_replica_n4], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.autoscaling.MetricTriggerIntegrationTest_B7C0DF610159713C-001/tempDir-001/node1/./testMetricTrigger_shard2_replica_n4/data/]
[junit4] 2> 1944172 INFO (qtp1698155277-34535) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1944172 INFO (qtp1698155277-34535) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'testMetricTrigger_shard1_replica_n1' using configuration from configset conf, trusted=true
[junit4] 2> 1944172 INFO (qtp1698155277-34535) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51148.solr.core.testMetricTrigger.shard1.replica_n1' (registry 'solr.core.testMetricTrigger.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f4881f5
[junit4] 2> 1944172 INFO (qtp1698155277-34535) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.c.SolrCore [[testMetricTrigger_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.autoscaling.MetricTriggerIntegrationTest_B7C0DF610159713C-001/tempDir-001/node2/./testMetricTrigger_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.autoscaling.MetricTriggerIntegrationTest_B7C0DF610159713C-001/tempDir-001/node2/./testMetricTrigger_shard1_replica_n1/data/]
[junit4] 2> 1944261 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1944261 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1944263 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1944263 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1944263 INFO (qtp1698155277-34535) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1944263 INFO (qtp1698155277-34535) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1944263 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1944263 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1944265 INFO (qtp1698155277-34539) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1944265 INFO (qtp1698155277-34539) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1944265 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1944265 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1944266 INFO (qtp1698155277-34535) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1944266 INFO (qtp1698155277-34535) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1944267 INFO (qtp1698155277-34539) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1944267 INFO (qtp1698155277-34539) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1944267 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1944268 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1944268 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1944269 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
[junit4] 2> 1944269 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1667812799000084480
[junit4] 2> 1944269 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1944270 INFO (qtp1698155277-34535) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1944271 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
[junit4] 2> 1944271 INFO (qtp1698155277-34539) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1944271 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1667812799002181632
[junit4] 2> 1944271 INFO (qtp1698155277-34535) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1944272 INFO (qtp1698155277-34535) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
[junit4] 2> 1944272 INFO (qtp1698155277-34535) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1667812799003230208
[junit4] 2> 1944272 INFO (qtp1698155277-34539) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1944273 INFO (qtp1698155277-34539) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
[junit4] 2> 1944274 INFO (qtp1698155277-34539) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1667812799005327360
[junit4] 2> 1944274 INFO (searcherExecutor-21261-thread-1-processing-n:127.0.0.1:51147_solr x:testMetricTrigger_shard2_replica_n4 c:testMetricTrigger s:shard2 r:core_node7) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.SolrCore [testMetricTrigger_shard2_replica_n4] Registered new searcher autowarm time: 0 ms: Collection: 'testMetricTrigger'
[junit4] 2> 1944274 INFO (searcherExecutor-21259-thread-1-processing-n:127.0.0.1:51147_solr x:testMetricTrigger_shard1_replica_n2 c:testMetricTrigger s:shard1 r:core_node5) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.c.SolrCore [testMetricTrigger_shard1_replica_n2] Registered new searcher autowarm time: 0 ms: Collection: 'testMetricTrigger'
[junit4] 2> 1944277 INFO (searcherExecutor-21263-thread-1-processing-n:127.0.0.1:51148_solr x:testMetricTrigger_shard1_replica_n1 c:testMetricTrigger s:shard1 r:core_node3) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.c.SolrCore [testMetricTrigger_shard1_replica_n1] Registered new searcher autowarm time: 0 ms: Collection: 'testMetricTrigger'
[junit4] 2> 1944277 INFO (searcherExecutor-21257-thread-1-processing-n:127.0.0.1:51148_solr x:testMetricTrigger_shard2_replica_n6 c:testMetricTrigger s:shard2 r:core_node8) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.c.SolrCore [testMetricTrigger_shard2_replica_n6] Registered new searcher autowarm time: 0 ms: Collection: 'testMetricTrigger'
[junit4] 2> 1944284 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testMetricTrigger/terms/shard1 to Terms{values={core_node5=0}, version=0}
[junit4] 2> 1944284 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testMetricTrigger/leaders/shard1
[junit4] 2> 1944286 INFO (qtp1698155277-34535) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Failed to save terms, version is not a match, retrying
[junit4] 2> 1944289 INFO (qtp1698155277-34535) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testMetricTrigger/terms/shard1 to Terms{values={core_node3=0, core_node5=0}, version=1}
[junit4] 2> 1944289 INFO (qtp1698155277-34535) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testMetricTrigger/leaders/shard1
[junit4] 2> 1944294 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testMetricTrigger/terms/shard2 to Terms{values={core_node7=0}, version=0}
[junit4] 2> 1944294 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testMetricTrigger/leaders/shard2
[junit4] 2> 1944300 INFO (qtp1698155277-34539) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testMetricTrigger/terms/shard2 to Terms{values={core_node7=0, core_node8=0}, version=1}
[junit4] 2> 1944301 INFO (qtp1698155277-34539) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testMetricTrigger/leaders/shard2
[junit4] 2> 1944305 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1944306 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1944306 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:51147/solr/testMetricTrigger_shard1_replica_n2/
[junit4] 2> 1944307 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.u.PeerSync PeerSync: core=testMetricTrigger_shard1_replica_n2 url=http://127.0.0.1:51147/solr START replicas=[http://127.0.0.1:51148/solr/testMetricTrigger_shard1_replica_n1/] nUpdates=100
[junit4] 2> 1944307 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.u.PeerSync PeerSync: core=testMetricTrigger_shard1_replica_n2 url=http://127.0.0.1:51147/solr DONE. We have no versions. sync failed.
[junit4] 2> 1944309 INFO (qtp1698155277-34533) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard1 r:core_node3 x:testMetricTrigger_shard1_replica_n1 ] o.a.s.c.S.Request [testMetricTrigger_shard1_replica_n1] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1944309 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 1944309 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 1944310 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/testMetricTrigger/leaders/shard1/leader after winning as /collections/testMetricTrigger/leader_elect/shard1/election/72111666702188549-core_node5-n_0000000000
[junit4] 2> 1944315 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1944315 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1944315 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:51147/solr/testMetricTrigger_shard2_replica_n4/
[junit4] 2> 1944316 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:51147/solr/testMetricTrigger_shard1_replica_n2/ shard1
[junit4] 2> 1944317 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.u.PeerSync PeerSync: core=testMetricTrigger_shard2_replica_n4 url=http://127.0.0.1:51147/solr START replicas=[http://127.0.0.1:51148/solr/testMetricTrigger_shard2_replica_n6/] nUpdates=100
[junit4] 2> 1944317 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.u.PeerSync PeerSync: core=testMetricTrigger_shard2_replica_n4 url=http://127.0.0.1:51147/solr DONE. We have no versions. sync failed.
[junit4] 2> 1944318 INFO (qtp1698155277-34537) [n:127.0.0.1:51148_solr c:testMetricTrigger s:shard2 r:core_node8 x:testMetricTrigger_shard2_replica_n6 ] o.a.s.c.S.Request [testMetricTrigger_shard2_replica_n6] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 1944319 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 1944319 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 1944319 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/testMetricTrigger/leaders/shard2/leader after winning as /collections/testMetricTrigger/leader_elect/shard2/election/72111666702188549-core_node7-n_0000000000
[junit4] 2> 1944322 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:51147/solr/testMetricTrigger_shard2_replica_n4/ shard2
[junit4] 2> 1944434 INFO (zkCallback-21218-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testMetricTrigger/state.json] for collection [testMetricTrigger] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1944435 INFO (zkCallback-21218-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testMetricTrigger/state.json] for collection [testMetricTrigger] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1944438 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard1 r:core_node5 x:testMetricTrigger_shard1_replica_n2 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1944440 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr c:testMetricTrigger s:shard2 r:core_node7 x:testMetricTrigger_shard2_replica_n4 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1944444 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=testMetricTrigger_shard1_replica_n2&action=CREATE&numShards=2&collection=testMetricTrigger&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=321
[junit4] 2> 1944445 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=testMetricTrigger_shard2_replica_n4&action=CREATE&numShards=2&collection=testMetricTrigger&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=321
[junit4] 2> 1944483 DEBUG (ScheduledTrigger-21237-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 1
[junit4] 2> 1944557 INFO (zkCallback-21218-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testMetricTrigger/state.json] for collection [testMetricTrigger] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1944557 INFO (zkCallback-21218-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testMetricTrigger/state.json] for collection [testMetricTrigger] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1944558 INFO (zkCallback-21218-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testMetricTrigger/state.json] for collection [testMetricTrigger] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1945320 INFO (qtp1698155277-34535) [n:127.0.0.1:51148_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testMetricTrigger_shard1_replica_n1&action=CREATE&numShards=2&collection=testMetricTrigger&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1196
[junit4] 2> 1945321 INFO (qtp1698155277-34539) [n:127.0.0.1:51148_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=testMetricTrigger_shard2_replica_n6&action=CREATE&numShards=2&collection=testMetricTrigger&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1197
[junit4] 2> 1945322 DEBUG (OverseerThreadFactory-21239-thread-1-processing-n:127.0.0.1:51148_solr) [n:127.0.0.1:51148_solr ] o.a.s.c.s.c.a.PolicyHelper session set to NULL
[junit4] 2> 1945325 INFO (qtp1549726450-34540) [n:127.0.0.1:51147_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 1945424 INFO (zkCallback-21231-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testMetricTrigger/state.json] for collection [testMetricTrigger] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1945424 INFO (zkCallback-21231-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testMetricTrigger/state.json] for collection [testMetricTrigger] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1945424 INFO (zkCallback-21218-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testMetricTrigger/state.json] for collection [testMetricTrigger] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1945424 INFO (zkCallback-21218-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testMetricTrigger/state.json] for collection [testMetricTrigger] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1945425 INFO (zkCallback-21218-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testMetricTrigger/state.json] for collection [testMetricTrigger] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1945427 INFO (qtp1549726450-34540) [n:127.0.0.1:51147_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf&maxShardsPerNode=2&name=testMetricTrigger&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2} status=0 QTime=1685
[junit4] 2> 1945428 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.a.s.c.MiniSolrCloudCluster waitForActiveCollection: testMetricTrigger
[junit4] 2> 1945451 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.testMetricTrigger.shard2.replica_n4:INDEX.sizeInBytes&key=solr.core.testMetricTrigger.shard1.replica_n2:INDEX.sizeInBytes} status=0 QTime=4
[junit4] 2> 1945453 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 1945457 INFO (qtp1698155277-34533) [n:127.0.0.1:51148_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.testMetricTrigger.shard1.replica_n1:INDEX.sizeInBytes&key=solr.core.testMetricTrigger.shard2.replica_n6:INDEX.sizeInBytes} status=0 QTime=3
[junit4] 2> 1945458 INFO (qtp1698155277-34537) [n:127.0.0.1:51148_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 1945459 DEBUG (qtp1549726450-34534) [n:127.0.0.1:51147_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 1945460 INFO (qtp1549726450-34534) [n:127.0.0.1:51147_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=21
[junit4] 2> 1945461 DEBUG (zkCallback-21231-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 1945462 DEBUG (OverseerAutoScalingTriggerThread-72111666702188550-127.0.0.1:51148_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 1945467 INFO (qtp1549726450-34536) [n:127.0.0.1:51147_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.testMetricTrigger.shard2.replica_n4:INDEX.sizeInBytes&key=solr.core.testMetricTrigger.shard1.replica_n2:INDEX.sizeInBytes} status=0 QTime=0
[junit4] 2> 1945467 DEBUG (OverseerAutoScalingTriggerThread-72111666702188550-127.0.0.1:51148_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded markers
[junit4] 2> 1945468 INFO (qtp1549726450-34538) [n:127.0.0.1:51147_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 1945469 DEBUG (OverseerAutoScalingTriggerThread-72111666702188550-127.0.0.1:51148_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 1945470 INFO (qtp1698155277-34539) [n:127.0.0.1:51148_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.testMetricTrigger.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
[junit4] 2> 1945470 INFO (qtp1698155277-34535) [n:127.0.0.1:51148_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.testMetricTrigger.shard1.replica_n1:INDEX.sizeInBytes&key=solr.core.testMetricTrigger.shard2.replica_n6:INDEX.sizeInBytes} status=0 QTime=0
[junit4] 2> 1945471 INFO (qtp1698155277-34533) [n:127.0.0.1:51148_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 1945472 DEBUG (qtp1549726450-34540) [n:127.0.0.1:51147_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 1945472 INFO (qtp1549726450-34534) [n:127.0.0.1:51147_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.testMetricTrigger.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
[junit4] 2> 1945473 INFO (qtp1549726450-34540) [n:127.0.0.1:51147_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=10
[junit4] 2> 1945474 DEBUG (zkCallback-21231-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
[junit4] 2> 1945475 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 1945475 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 1945475 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14+36
[junit4] 2> 1945475 DEBUG (OverseerAutoScalingTriggerThread-72111666702188550-127.0.0.1:51148_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
[junit4] 2> 1945477 DEBUG (OverseerAutoScalingTriggerThread-72111666702188550-127.0.0.1:51148_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded markers
[junit4] 2> 1945477 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1945477 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1945477 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 1945478 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@b441518{/solr,null,AVAILABLE}
[junit4] 2> 1945479 DEBUG (OverseerAutoScalingTriggerThread-72111666702188550-127.0.0.1:51148_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
[junit4] 2> 1945479 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@938b731{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:51161}
[junit4] 2> 1945479 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.e.j.s.Server Started @1945564ms
[junit4] 2> 1945479 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=51161}
[junit4] 2> 1945480 ERROR (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1945480 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1945480 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 9.0.0
[junit4] 2> 1945480 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1945480 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 1945480 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-05-27T03:30:32.191266Z
[junit4] 2> 1945481 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1945484 INFO (zkConnectionManagerCallback-21281-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1945484 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1945484 DEBUG (ScheduledTrigger-21237-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 and last live nodes: 2
[junit4] 2> 1945486 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1945604 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
[junit4] 2> 1945606 WARN (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@743491ee[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1945606 WARN (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@743491ee[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1945606 WARN (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@41ca8fbb[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1945606 WARN (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@41ca8fbb[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 1945611 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51142/solr
[junit4] 2> 1945612 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [n:127.0.0.1:51161_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1945616 INFO (zkConnectionManagerCallback-21292-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1945616 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [n:127.0.0.1:51161_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1945631 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [n:127.0.0.1:51161_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1945640 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [n:127.0.0.1:51161_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:51161_solr as DOWN
[junit4] 2> 1945643 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [n:127.0.0.1:51161_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 1000 transient cores
[junit4] 2> 1945643 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [n:127.0.0.1:51161_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51161_solr
[junit4] 2> 1945645 INFO (zkCallback-21254-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1945646 INFO (zkCallback-21218-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1945646 INFO (zkCallback-21231-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1945646 INFO (zkCallback-21291-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1945650 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [n:127.0.0.1:51161_solr ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 1945650 WARN (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [n:127.0.0.1:51161_solr ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 1945668 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [n:127.0.0.1:51161_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 1945690 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [n:127.0.0.1:51161_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51161.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f4881f5
[junit4] 2> 1945702 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [n:127.0.0.1:51161_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51161.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f4881f5
[junit4] 2> 1945702 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [n:127.0.0.1:51161_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51161.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f4881f5
[junit4] 2> 1945703 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [n:127.0.0.1:51161_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J4/temp/solr.cloud.autoscaling.MetricTriggerIntegrationTest_B7C0DF610159713C-001/tempDir-001/node3/.
[junit4] 2> 1945710 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 1945710 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 1945710 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 14+36
[junit4] 2> 1945712 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1945712 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1945712 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 1945712 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@57e3a1a7{/solr,null,AVAILABLE}
[junit4] 2> 1945713 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@238fb04e{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:51164}
[junit4] 2> 1945713 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.e.j.s.Server Started @1945797ms
[junit4] 2> 1945713 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=51164}
[junit4] 2> 1945713 ERROR (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1945713 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1945713 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 9.0.0
[junit4] 2> 1945713 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1945713 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 1945713 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-seed#[B7C0DF610159713C]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-05-27T03:30:32.424649Z
[junit4] 2> 1945714 INFO (TEST-MetricTriggerIntegrationTest.testMetricTrigger-see
[...truncated too long message...]
ng reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6c590a51: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@1313f3a5
[junit4] 2> 2113386 INFO (closeThreadPool-14960-thread-6) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null
[junit4] 2> 2113423 INFO (zkCallback-14915-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 2113423 INFO (zkCallback-14835-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 2113430 INFO (closeThreadPool-14960-thread-4) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@1e4a51bb{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
[junit4] 2> 2113431 INFO (closeThreadPool-14960-thread-4) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@709c5887{/mi_e,null,UNAVAILABLE}
[junit4] 2> 2113431 INFO (closeThreadPool-14960-thread-4) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 2113476 INFO (closeThreadPool-14960-thread-5) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@39ef09dc{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
[junit4] 2> 2113477 INFO (closeThreadPool-14960-thread-5) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5c0e4850{/mi_e,null,UNAVAILABLE}
[junit4] 2> 2113477 INFO (closeThreadPool-14960-thread-5) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 2113531 INFO (closeThreadPool-14960-thread-3) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@dc7b57d{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
[junit4] 2> 2113532 INFO (closeThreadPool-14960-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2c8c2a16{/mi_e,null,UNAVAILABLE}
[junit4] 2> 2113534 INFO (closeThreadPool-14960-thread-3) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 2113632 INFO (closeThreadPool-14960-thread-6) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@25cc3105{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:52132}
[junit4] 2> 2113632 INFO (closeThreadPool-14960-thread-6) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5c512c0e{/mi_e,null,UNAVAILABLE}
[junit4] 2> 2113632 INFO (closeThreadPool-14960-thread-6) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 2113633 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[B7C0DF610159713C]) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
[junit4] 2> 2113845 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 11 /solr/collections/testSplitStaticIndexReplication_link/terms/shard1_0
[junit4] 2> 9 /solr/aliases.json
[junit4] 2> 6 /solr/packages.json
[junit4] 2> 6 /solr/security.json
[junit4] 2> 6 /solr/configs/conf1
[junit4] 2> 6 /solr/collections/collection1/terms/shard1
[junit4] 2> 5 /solr/collections/collection1/collectionprops.json
[junit4] 2> 5 /solr/collections/collection1/terms/shard2
[junit4] 2> 4 /solr/collections/testSplitStaticIndexReplication_link/terms/shard1
[junit4] 2> 4 /solr/collections/testSplitStaticIndexReplication_link/terms/shard1_1
[junit4] 2> 3 /solr/collections/testSplitStaticIndexReplication_link/collectionprops.json
[junit4] 2> 3 /solr/collections/control_collection/terms/shard1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 141 /solr/collections/collection1/state.json
[junit4] 2> 87 /solr/collections/testSplitStaticIndexReplication_link/state.json
[junit4] 2> 12 /solr/collections/control_collection/state.json
[junit4] 2> 9 /solr/clusterprops.json
[junit4] 2> 9 /solr/clusterstate.json
[junit4] 2> 2 /solr/overseer_elect/election/72111675919040521-127.0.0.1:52125_mi_e-n_0000000001
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 90 /solr/overseer/queue
[junit4] 2> 50 /solr/live_nodes
[junit4] 2> 23 /solr/overseer/collection-queue-work
[junit4] 2> 15 /solr/collections
[junit4] 2>
[junit4] 2> 2113849 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[B7C0DF610159713C]) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:52093
[junit4] 2> 2113850 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[B7C0DF610159713C]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:52093
[junit4] 2> 2113850 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplicationLink-seed#[B7C0DF610159713C]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 52093
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.ShardSplitTest_B7C0DF610159713C-001
[junit4] 2> May 27, 2020 3:33:20 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=SimpleText, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@121b6f5e), locale=tzm, timezone=America/Boise
[junit4] 2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 14 (64-bit)/cpus=6,threads=1,free=253731840,total=503316480
[junit4] 2> NOTE: All tests run in this JVM: [MetricUtilsTest, TestExactStatsCacheCloud, MergeStrategyTest, TestLegacyFieldReuse, TestSolrTestCaseJ4, ComputePlanActionTest, PeerSyncWithLeaderAndIndexFingerprintCachingTest, ConcurrentDeleteAndCreateCollectionTest, HdfsRecoverLeaseTest, LeaderTragicEventTest, TestHdfsUpdateLog, TestSimNodeLostTrigger, DistributedSuggestComponentTest, SystemInfoHandlerTest, RequestLoggingTest, OverriddenZkACLAndCredentialsProvidersTest, TestFunctionQuery, MigrateRouteKeyTest, TestSnapshotCloudManager, FullHLLTest, TestCloudJSONFacetJoinDomain, TestRawTransformer, TestCorePropertiesReload, TestWaitForStateWithJettyShutdowns, DistributedMLTComponentTest, ZookeeperReadAPITest, CoreAdminHandlerTest, CdcrReplicationHandlerTest, TestFuzzyAnalyzedSuggestions, TestSolrDeletionPolicy2, MultiSolrCloudTestCaseTest, BJQParserTest, TestSolrConfigHandlerConcurrent, DocumentBuilderTest, SimpleMLTQParserTest, TestTlogReplayVsRecovery, UninvertDocValuesMergePolicyTest, ZkNodePropsTest, ParsingFieldUpdateProcessorsTest, AnalysisAfterCoreReloadTest, UpdateParamsTest, TestDistribDocBasedVersion, RoutingToNodesWithPropertiesTest, XmlUpdateRequestHandlerTest, TestManagedResourceStorage, SignatureUpdateProcessorFactoryTest, EmbeddedSolrNoSerializeTest, RulesTest, SegmentsInfoRequestHandlerTest, TestFieldCache, AssignBackwardCompatibilityTest, TestSegmentSorting, NodeAddedTriggerTest, TestPointFields, TestMaxTokenLenTokenizer, HealthCheckHandlerTest, ForceLeaderWithTlogReplicasTest, TestSha256AuthenticationProvider, TestCharFilters, SmileWriterTest, TestSimpleQParserPlugin, CloneFieldUpdateProcessorFactoryTest, TestIndexSearcher, TestPerFieldSimilarity, BufferStoreTest, HighlighterWithoutStoredIdTest, PreAnalyzedFieldTest, TestLeaderElectionZkExpiry, TestUnInvertedFieldException, TestXmlQParser, CollectionReloadTest, TestIBSimilarityFactory, ByteBuffersDirectoryFactoryTest, HdfsBasicDistributedZk2Test, TestLazyCores, CreateCollectionCleanupTest, SolrIndexConfigTest, TestCoreBackup, TestJsonFacets, DistributedIntervalFacetingTest, DateFieldTest, TestConfigSetImmutable, UtilsToolTest, UnloadDistributedZkTest, TestFacetMethods, TestPrepRecovery, TestRecoveryHdfs, TestReloadAndDeleteDocs, ScheduledMaintenanceTriggerTest, TestTextField, HttpPartitionWithTlogReplicasTest, MoveReplicaHDFSTest, MoveReplicaTest, ReindexCollectionTest, TestCloudRecovery, TestConfigSetsAPI, TestMiniSolrCloudClusterSSL, TestSolrCloudWithSecureImpersonation, AssignTest, AsyncCallRequestStatusResponseTest, ShardSplitTest]
[junit4] Completed [651/913 (2!)] on J0 in 274.93s, 11 tests, 1 failure, 3 skipped <<< FAILURES!
[...truncated 45701 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/6075/consoleText
[repro] Revision: ac80fb9979c26e357a561a609ecd754a1c33c561
[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseG1GC"
[repro] Repro line: ant test -Dtestcase=MetricTriggerIntegrationTest -Dtests.method=testMetricTrigger -Dtests.seed=B7C0DF610159713C -Dtests.slow=true -Dtests.locale=it-CH -Dtests.timezone=America/North_Dakota/Center -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] Repro line: ant test -Dtestcase=ShardSplitTest -Dtests.method=testSplitAfterFailedSplit -Dtests.seed=B7C0DF610159713C -Dtests.slow=true -Dtests.locale=tzm -Dtests.timezone=America/Boise -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] ShardSplitTest
[repro] MetricTriggerIntegrationTest
[repro] ant compile-test
[...truncated 3158 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=10 -Dtests.class="*.ShardSplitTest|*.MetricTriggerIntegrationTest" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseG1GC" -Dtests.seed=B7C0DF610159713C -Dtests.slow=true -Dtests.locale=tzm -Dtests.timezone=America/Boise -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[...truncated 166 lines...]
[repro] Failures w/original seeds:
[repro] 0/5 failed: org.apache.solr.cloud.api.collections.ShardSplitTest
[repro] 0/5 failed: org.apache.solr.cloud.autoscaling.MetricTriggerIntegrationTest
[repro] Exiting with code 0
[...truncated 73 lines...]
[JENKINS] Lucene-Solr-master-MacOSX (64bit/jdk-13.0.2) - Build #
6074 - Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/6074/
Java: 64bit/jdk-13.0.2 -XX:+UseCompressedOops -XX:+UseSerialGC
1 tests failed.
FAILED: org.apache.solr.cloud.cdcr.CdcrVersionReplicationTest.testCdcrDocVersions
Error Message:
Error from server at http://127.0.0.1:61195: ADDREPLICA failed to create replica
Stack Trace:
org.apache.solr.client.solrj.impl.BaseHttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:61195: ADDREPLICA failed to create replica
at __randomizedtesting.SeedInfo.seed([76B14FFD05D9C1CA:8E27445FF7BF2ED6]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:663)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:265)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1147)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:910)
at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:842)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:224)
at org.apache.solr.cloud.cdcr.BaseCdcrDistributedZkTest.startServers(BaseCdcrDistributedZkTest.java:594)
at org.apache.solr.cloud.cdcr.BaseCdcrDistributedZkTest.createSourceCollection(BaseCdcrDistributedZkTest.java:352)
at org.apache.solr.cloud.cdcr.BaseCdcrDistributedZkTest.baseBefore(BaseCdcrDistributedZkTest.java:178)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:567)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:976)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1081)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1053)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
at java.base/java.lang.Thread.run(Thread.java:830)
Build Log:
[...truncated 13175 lines...]
[junit4] Suite: org.apache.solr.cloud.cdcr.CdcrVersionReplicationTest
[junit4] 2> 327554 INFO (SUITE-CdcrVersionReplicationTest-seed#[76B14FFD05D9C1CA]-worker) [ ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/server/solr/configsets/_default/conf'
[junit4] 2> 327555 INFO (SUITE-CdcrVersionReplicationTest-seed#[76B14FFD05D9C1CA]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_76B14FFD05D9C1CA-001/data-dir-16-001
[junit4] 2> 327555 INFO (SUITE-CdcrVersionReplicationTest-seed#[76B14FFD05D9C1CA]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 327556 INFO (SUITE-CdcrVersionReplicationTest-seed#[76B14FFD05D9C1CA]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 327556 INFO (SUITE-CdcrVersionReplicationTest-seed#[76B14FFD05D9C1CA]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 327556 INFO (SUITE-CdcrVersionReplicationTest-seed#[76B14FFD05D9C1CA]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 327564 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 327565 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0
[junit4] 2> 327565 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 327668 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.ZkTestServer start zk server on port: 61173
[junit4] 2> 327668 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:61173
[junit4] 2> 327668 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:61173
[junit4] 2> 327668 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 61173
[junit4] 2> 327670 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 327675 INFO (zkConnectionManagerCallback-1628-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 327676 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 327679 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 327683 INFO (zkConnectionManagerCallback-1630-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 327683 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 327686 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-cdcr.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 327689 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 327694 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 327698 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 327702 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 327706 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 327710 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 327714 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 327718 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 327724 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 327727 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.ZkTestServer put /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 327729 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCdcrDocVersions
[junit4] 2> 328532 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 328532 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 328532 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 13.0.2+8
[junit4] 2> 328545 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 328545 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 328546 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 328561 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@60eccfec{/,null,AVAILABLE}
[junit4] 2> 328579 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@16d76775{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:61183}
[junit4] 2> 328579 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.Server Started @328642ms
[junit4] 2> 328579 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard1, hostContext=/, hostPort=61183, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_76B14FFD05D9C1CA-001/jetty-001/cores}
[junit4] 2> 328579 ERROR (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 328580 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 328580 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 328580 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 328580 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 328580 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-05-26T21:06:01.350193Z
[junit4] 2> 328583 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 328589 INFO (zkConnectionManagerCallback-1632-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 328590 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 328711 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 328712 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_76B14FFD05D9C1CA-001/jetty-001/solr.xml
[junit4] 2> 328715 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@5191d802, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 328776 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 328783 WARN (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@c178e9b[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 328783 WARN (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@c178e9b[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 328792 WARN (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3a3f73a2[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 328792 WARN (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3a3f73a2[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 328793 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:61173/solr
[junit4] 2> 328796 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 328799 INFO (zkConnectionManagerCallback-1643-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 328799 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 328905 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61183_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 328909 INFO (zkConnectionManagerCallback-1645-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 328909 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61183_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 329395 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61183_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:61183_
[junit4] 2> 329405 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61183_ ] o.a.s.c.Overseer Overseer (id=72110154834378756-127.0.0.1:61183_-n_0000000000) starting
[junit4] 2> 329465 INFO (OverseerStateUpdate-72110154834378756-127.0.0.1:61183_-n_0000000000) [n:127.0.0.1:61183_ ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:61183_
[junit4] 2> 329466 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61183_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:61183_
[junit4] 2> 329494 INFO (OverseerStateUpdate-72110154834378756-127.0.0.1:61183_-n_0000000000) [n:127.0.0.1:61183_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 329527 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61183_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 329529 WARN (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61183_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 329567 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61183_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 329654 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61183_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5191d802
[junit4] 2> 329668 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61183_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5191d802
[junit4] 2> 329670 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61183_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5191d802
[junit4] 2> 329672 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61183_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_76B14FFD05D9C1CA-001/jetty-001/cores
[junit4] 2> 330398 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 330398 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 330398 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 13.0.2+8
[junit4] 2> 330404 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 330404 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 330404 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 330407 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@66d9a135{/,null,AVAILABLE}
[junit4] 2> 330410 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@61efaf4{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:61195}
[junit4] 2> 330410 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.Server Started @330473ms
[junit4] 2> 330410 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard2, hostContext=/, hostPort=61195, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_76B14FFD05D9C1CA-001/jetty-002/cores}
[junit4] 2> 330411 ERROR (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 330411 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 330411 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 330411 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 330411 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 330411 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-05-26T21:06:03.181790Z
[junit4] 2> 330414 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 330417 INFO (zkConnectionManagerCallback-1659-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 330417 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 330525 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 330525 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_76B14FFD05D9C1CA-001/jetty-002/solr.xml
[junit4] 2> 330540 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@5191d802, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 330700 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 330703 WARN (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@753ed941[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 330703 WARN (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@753ed941[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 330715 WARN (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@395a2390[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 330715 WARN (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@395a2390[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 330716 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:61173/solr
[junit4] 2> 330720 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 330726 INFO (zkConnectionManagerCallback-1670-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 330744 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 330902 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61195_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 330906 INFO (zkConnectionManagerCallback-1672-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 330906 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61195_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 330942 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61195_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 330963 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61195_ ] o.a.s.c.ZkController Publish node=127.0.0.1:61195_ as DOWN
[junit4] 2> 330971 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61195_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 330979 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61195_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:61195_
[junit4] 2> 330987 INFO (zkCallback-1644-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 330988 INFO (zkCallback-1671-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 331011 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61195_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 331017 WARN (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61195_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 331087 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61195_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 331139 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61195_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5191d802
[junit4] 2> 331174 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61195_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5191d802
[junit4] 2> 331174 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61195_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5191d802
[junit4] 2> 331178 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61195_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_76B14FFD05D9C1CA-001/jetty-002/cores
[junit4] 2> 331908 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 331909 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 331909 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 13.0.2+8
[junit4] 2> 331923 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 331924 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 331924 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.session node0 Scavenging every 660000ms
[junit4] 2> 331927 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5b6d7759{/,null,AVAILABLE}
[junit4] 2> 331933 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@779c1966{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:61214}
[junit4] 2> 331934 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.Server Started @331997ms
[junit4] 2> 331934 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard3, hostContext=/, hostPort=61214, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_76B14FFD05D9C1CA-001/jetty-003/cores}
[junit4] 2> 331938 ERROR (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 331938 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 331938 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 331938 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 331938 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 331938 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-05-26T21:06:04.708867Z
[junit4] 2> 331941 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 331944 INFO (zkConnectionManagerCallback-1682-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 331944 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 332053 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 332053 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_76B14FFD05D9C1CA-001/jetty-003/solr.xml
[junit4] 2> 332066 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@5191d802, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 333142 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 333144 WARN (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3ceb4883[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 333144 WARN (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3ceb4883[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 333150 WARN (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@2ec84d8b[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 333150 WARN (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@2ec84d8b[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 333151 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:61173/solr
[junit4] 2> 333152 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 333158 INFO (zkConnectionManagerCallback-1693-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 333158 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 333272 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61214_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 333278 INFO (zkConnectionManagerCallback-1695-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 333278 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61214_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 333301 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61214_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 333314 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61214_ ] o.a.s.c.ZkController Publish node=127.0.0.1:61214_ as DOWN
[junit4] 2> 333354 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61214_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 333354 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61214_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:61214_
[junit4] 2> 333360 INFO (zkCallback-1671-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 333361 INFO (zkCallback-1644-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 333362 INFO (zkCallback-1694-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 333372 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61214_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 333373 WARN (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61214_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 333419 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61214_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 333452 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61214_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5191d802
[junit4] 2> 333470 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61214_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5191d802
[junit4] 2> 333470 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61214_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5191d802
[junit4] 2> 333474 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61214_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_76B14FFD05D9C1CA-001/jetty-003/cores
[junit4] 2> 333956 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
[junit4] 2> 333956 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ...
[junit4] 2> 333956 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.Server jetty-9.4.27.v20200227; built: 2020-02-27T18:37:21.340Z; git: a304fd9f351f337e7c0e2a7c28878dd536149c6c; jvm 13.0.2+8
[junit4] 2> 333959 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 333959 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 333959 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.session node0 Scavenging every 600000ms
[junit4] 2> 333959 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@76e7ba6e{/,null,AVAILABLE}
[junit4] 2> 333960 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6e8026d1{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:61238}
[junit4] 2> 333960 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.Server Started @334023ms
[junit4] 2> 333960 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard4, hostContext=/, hostPort=61238, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_76B14FFD05D9C1CA-001/jetty-004/cores}
[junit4] 2> 333961 ERROR (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 333961 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 333961 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0
[junit4] 2> 333961 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 333961 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr
[junit4] 2> 333961 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2020-05-26T21:06:06.731564Z
[junit4] 2> 333962 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 333965 INFO (zkConnectionManagerCallback-1705-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 333966 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 334076 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 334078 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_76B14FFD05D9C1CA-001/jetty-004/solr.xml
[junit4] 2> 334084 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@5191d802, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 334237 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
[junit4] 2> 334242 WARN (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@2ecf08c3[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 334242 WARN (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@2ecf08c3[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 334272 WARN (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@391d997d[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 334275 WARN (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@391d997d[provider=null,keyStore=null,trustStore=null]
[junit4] 2> 334277 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:61173/solr
[junit4] 2> 334298 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 334300 INFO (zkConnectionManagerCallback-1716-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 334302 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 334421 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61238_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 334431 INFO (zkConnectionManagerCallback-1718-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 334431 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61238_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 334479 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61238_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 334509 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61238_ ] o.a.s.c.ZkController Publish node=127.0.0.1:61238_ as DOWN
[junit4] 2> 334516 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61238_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 334516 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61238_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:61238_
[junit4] 2> 334525 INFO (zkCallback-1671-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 334528 INFO (zkCallback-1644-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 334529 INFO (zkCallback-1694-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 334529 INFO (zkCallback-1717-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 334543 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61238_ ] o.a.s.p.PackageLoader /packages.json updated to version -1
[junit4] 2> 334543 WARN (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61238_ ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info
[junit4] 2> 334570 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61238_ ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
[junit4] 2> 334599 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61238_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5191d802
[junit4] 2> 334636 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61238_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5191d802
[junit4] 2> 334637 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61238_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5191d802
[junit4] 2> 334639 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [n:127.0.0.1:61238_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_76B14FFD05D9C1CA-001/jetty-004/cores
[junit4] 2> 334659 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 334661 INFO (zkConnectionManagerCallback-1731-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 334663 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 334667 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 334677 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:61173/solr ready
[junit4] 2> 334681 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&name=tmp_collection&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 334711 INFO (OverseerThreadFactory-1652-thread-1-processing-n:127.0.0.1:61183_) [n:127.0.0.1:61183_ ] o.a.s.c.a.c.CreateCollectionCmd Create collection tmp_collection
[junit4] 2> 334838 WARN (OverseerThreadFactory-1652-thread-1-processing-n:127.0.0.1:61183_) [n:127.0.0.1:61183_ ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (tmp_collection) without cores.
[junit4] 2> 334846 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
[junit4] 2> 334851 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=tmp_collection&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&wt=javabin&version=2} status=0 QTime=169
[junit4] 2> 334854 INFO (qtp1221650672-2795) [n:127.0.0.1:61195_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:61183_&action=ADDREPLICA&collection=tmp_collection&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 334870 INFO (OverseerCollectionConfigSetProcessor-72110154834378756-127.0.0.1:61183_-n_0000000000) [n:127.0.0.1:61183_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 334885 INFO (qtp1221650672-2793) [n:127.0.0.1:61195_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 334889 INFO (qtp1379031432-2821) [n:127.0.0.1:61214_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 334892 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 334892 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 334895 INFO (qtp2030562194-2848) [n:127.0.0.1:61238_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 334911 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 334913 INFO (qtp1379031432-2822) [n:127.0.0.1:61214_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 334915 INFO (qtp1999442702-2761) [n:127.0.0.1:61183_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 334917 INFO (qtp2030562194-2849) [n:127.0.0.1:61238_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 334922 INFO (OverseerThreadFactory-1652-thread-2-processing-n:127.0.0.1:61183_) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:61183_ for creating new replica of shard shard1 for collection tmp_collection
[junit4] 2> 334941 INFO (OverseerThreadFactory-1652-thread-2-processing-n:127.0.0.1:61183_) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 334952 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ x:tmp_collection_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=tmp_collection_shard1_replica_n1&action=CREATE&collection=tmp_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 335982 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 336004 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=test
[junit4] 2> 336075 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 336126 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'tmp_collection_shard1_replica_n1' using configuration from configset conf1, trusted=true
[junit4] 2> 336127 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.tmp_collection.shard1.replica_n1' (registry 'solr.core.tmp_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5191d802
[junit4] 2> 336127 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [[tmp_collection_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_76B14FFD05D9C1CA-001/jetty-001/cores/tmp_collection_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_76B14FFD05D9C1CA-001/jetty-001/cores/tmp_collection_shard1_replica_n1/data/]
[junit4] 2> 336129 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=12, maxMergeAtOnceExplicit=23, maxMergedSegmentMB=70.3779296875, floorSegmentMB=1.86328125, forceMergeDeletesPctAllowed=3.8694029490538737, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7419915598070421, deletesPctAllowed=20.990701921253013
[junit4] 2> 336209 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
[junit4] 2> 336209 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 336211 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 336211 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 336211 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=31, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2678969229868313]
[junit4] 2> 336213 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 336214 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 336215 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
[junit4] 2> 336222 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.h.CdcrBufferStateManager Created znode /collections/tmp_collection/cdcr/state/buffer
[junit4] 2> 336226 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.h.CdcrProcessStateManager Created znode /collections/tmp_collection/cdcr/state/process
[junit4] 2> 336235 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1667788616766586880
[junit4] 2> 336239 INFO (searcherExecutor-1733-thread-1-processing-n:127.0.0.1:61183_ x:tmp_collection_shard1_replica_n1 c:tmp_collection s:shard1) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [tmp_collection_shard1_replica_n1] Registered new searcher autowarm time: 0 ms: Collection: 'tmp_collection'
[junit4] 2> 336245 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/tmp_collection/terms/shard1 to Terms{values={core_node2=0}, version=0}
[junit4] 2> 336245 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/tmp_collection/leaders/shard1
[junit4] 2> 336253 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 336253 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 336253 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:61183/tmp_collection_shard1_replica_n1/
[junit4] 2> 336253 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 336254 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.c.SyncStrategy http://127.0.0.1:61183/tmp_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 336254 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/tmp_collection/leaders/shard1/leader after winning as /collections/tmp_collection/leader_elect/shard1/election/72110154834378756-core_node2-n_0000000000
[junit4] 2> 336255 INFO (zkCallback-1644-thread-1) [ ] o.a.s.h.CdcrLeaderStateManager Received new leader state @ tmp_collection:shard1
[junit4] 2> 336259 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:61183/tmp_collection_shard1_replica_n1/ shard1
[junit4] 2> 336364 INFO (zkCallback-1644-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 336365 INFO (zkCallback-1644-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 336367 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 x:tmp_collection_shard1_replica_n1 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 336372 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=tmp_collection_shard1_replica_n1&action=CREATE&collection=tmp_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1420
[junit4] 2> 336376 INFO (qtp1221650672-2795) [n:127.0.0.1:61195_ c:tmp_collection ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:61183_&action=ADDREPLICA&collection=tmp_collection&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=1522
[junit4] 2> 336378 INFO (qtp1221650672-2796) [n:127.0.0.1:61195_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:61195_&action=ADDREPLICA&collection=tmp_collection&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 336384 INFO (OverseerCollectionConfigSetProcessor-72110154834378756-127.0.0.1:61183_-n_0000000000) [n:127.0.0.1:61183_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 336387 INFO (qtp1221650672-2793) [n:127.0.0.1:61195_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 336390 INFO (qtp1379031432-2823) [n:127.0.0.1:61214_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 336392 INFO (qtp1999442702-2761) [n:127.0.0.1:61183_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.tmp_collection.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
[junit4] 2> 336393 INFO (qtp1999442702-2762) [n:127.0.0.1:61183_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 336394 INFO (qtp2030562194-2850) [n:127.0.0.1:61238_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 336398 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=1
[junit4] 2> 336400 INFO (qtp1379031432-2820) [n:127.0.0.1:61214_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 336401 INFO (qtp1999442702-2759) [n:127.0.0.1:61183_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.tmp_collection.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
[junit4] 2> 336402 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 336403 INFO (qtp2030562194-2847) [n:127.0.0.1:61238_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 336404 INFO (OverseerThreadFactory-1652-thread-3-processing-n:127.0.0.1:61183_) [n:127.0.0.1:61183_ c:tmp_collection s:shard2 ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:61195_ for creating new replica of shard shard2 for collection tmp_collection
[junit4] 2> 336406 INFO (OverseerThreadFactory-1652-thread-3-processing-n:127.0.0.1:61183_) [n:127.0.0.1:61183_ c:tmp_collection s:shard2 ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 336412 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ x:tmp_collection_shard2_replica_n3 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=tmp_collection_shard2_replica_n3&action=CREATE&collection=tmp_collection&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 336539 INFO (zkCallback-1644-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 336539 INFO (zkCallback-1644-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 336540 INFO (zkCallback-1644-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 337434 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n3 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
[junit4] 2> 337444 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n3 ] o.a.s.s.IndexSchema Schema name=test
[junit4] 2> 337518 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n3 ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 337551 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n3 ] o.a.s.c.CoreContainer Creating SolrCore 'tmp_collection_shard2_replica_n3' using configuration from configset conf1, trusted=true
[junit4] 2> 337551 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n3 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.tmp_collection.shard2.replica_n3' (registry 'solr.core.tmp_collection.shard2.replica_n3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5191d802
[junit4] 2> 337551 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n3 ] o.a.s.c.SolrCore [[tmp_collection_shard2_replica_n3] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_76B14FFD05D9C1CA-001/jetty-002/cores/tmp_collection_shard2_replica_n3], dataDir=[/Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_76B14FFD05D9C1CA-001/jetty-002/cores/tmp_collection_shard2_replica_n3/data/]
[junit4] 2> 337554 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n3 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=12, maxMergeAtOnceExplicit=23, maxMergedSegmentMB=70.3779296875, floorSegmentMB=1.86328125, forceMergeDeletesPctAllowed=3.8694029490538737, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7419915598070421, deletesPctAllowed=20.990701921253013
[junit4] 2> 337602 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n3 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
[junit4] 2> 337602 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n3 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 337603 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n3 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 337603 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n3 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 337604 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n3 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=31, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2678969229868313]
[junit4] 2> 337605 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n3 ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 337606 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n3 ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 337606 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n3 ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 ms
[junit4] 2> 337612 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n3 ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1667788618210476032
[junit4] 2> 337617 INFO (searcherExecutor-1740-thread-1-processing-n:127.0.0.1:61195_ x:tmp_collection_shard2_replica_n3 c:tmp_collection s:shard2) [n:127.0.0.1:61195_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n3 ] o.a.s.c.SolrCore [tmp_collection_shard2_replica_n3] Registered new searcher autowarm time: 0 ms: Collection: 'tmp_collection'
[junit4] 2> 337627 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n3 ] o.a.s.c.ZkShardTerms Successful update of terms at /collections/tmp_collection/terms/shard2 to Terms{values={core_node4=0}, version=0}
[junit4] 2> 337627 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n3 ] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/tmp_collection/leaders/shard2
[junit4] 2> 337646 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n3 ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 337646 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n3 ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 337646 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n3 ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:61195/tmp_collection_shard2_replica_n3/
[junit4] 2> 337647 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n3 ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 337648 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n3 ] o.a.s.c.SyncStrategy http://127.0.0.1:61195/tmp_collection_shard2_replica_n3/ has no replicas
[junit4] 2> 337648 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n3 ] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/tmp_collection/leaders/shard2/leader after winning as /collections/tmp_collection/leader_elect/shard2/election/72110154834378759-core_node4-n_0000000000
[junit4] 2> 337650 INFO (zkCallback-1671-thread-1) [ ] o.a.s.h.CdcrLeaderStateManager Received new leader state @ tmp_collection:shard2
[junit4] 2> 337655 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n3 ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:61195/tmp_collection_shard2_replica_n3/ shard2
[junit4] 2> 337766 INFO (zkCallback-1644-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 337766 INFO (zkCallback-1644-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 337767 INFO (zkCallback-1671-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 337767 INFO (zkCallback-1671-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 337767 INFO (zkCallback-1644-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 337770 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ c:tmp_collection s:shard2 x:tmp_collection_shard2_replica_n3 ] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 337777 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=tmp_collection_shard2_replica_n3&action=CREATE&collection=tmp_collection&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1364
[junit4] 2> 337780 INFO (qtp1221650672-2796) [n:127.0.0.1:61195_ c:tmp_collection ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:61195_&action=ADDREPLICA&collection=tmp_collection&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1402
[junit4] 2> 337782 INFO (qtp1221650672-2795) [n:127.0.0.1:61195_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:61214_&action=ADDREPLICA&collection=tmp_collection&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 337787 INFO (OverseerCollectionConfigSetProcessor-72110154834378756-127.0.0.1:61183_-n_0000000000) [n:127.0.0.1:61183_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 337792 INFO (qtp1221650672-2793) [n:127.0.0.1:61195_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.tmp_collection.shard2.replica_n3:INDEX.sizeInBytes} status=0 QTime=0
[junit4] 2> 337793 INFO (qtp1221650672-2794) [n:127.0.0.1:61195_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 337794 INFO (qtp1379031432-2821) [n:127.0.0.1:61214_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 337795 INFO (qtp1999442702-2761) [n:127.0.0.1:61183_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.tmp_collection.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
[junit4] 2> 337796 INFO (qtp1999442702-2762) [n:127.0.0.1:61183_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 337797 INFO (qtp2030562194-2848) [n:127.0.0.1:61238_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 337801 INFO (qtp1221650672-2796) [n:127.0.0.1:61195_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.tmp_collection.shard2.replica_n3:INDEX.sizeInBytes} status=0 QTime=0
[junit4] 2> 337803 INFO (qtp1221650672-2793) [n:127.0.0.1:61195_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 337805 INFO (qtp1379031432-2822) [n:127.0.0.1:61214_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 337807 INFO (qtp1999442702-2759) [n:127.0.0.1:61183_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.tmp_collection.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
[junit4] 2> 337808 INFO (qtp1999442702-2760) [n:127.0.0.1:61183_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 337809 INFO (qtp2030562194-2849) [n:127.0.0.1:61238_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CONTAINER.cores&wt=javabin&version=2&group=solr.node} status=0 QTime=0
[junit4] 2> 337812 INFO (qtp1999442702-2761) [n:127.0.0.1:61183_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.tmp_collection.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=0
[junit4] 2> 337813 INFO (OverseerThreadFactory-1652-thread-4-processing-n:127.0.0.1:61183_) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:61214_ for creating new replica of shard shard1 for collection tmp_collection
[junit4] 2> 337817 INFO (OverseerThreadFactory-1652-thread-4-processing-n:127.0.0.1:61183_) [n:127.0.0.1:61183_ c:tmp_collection s:shard1 ] o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
[junit4] 2> 337825 INFO (qtp1379031432-2821) [n:127.0.0.1:61214_ x:tmp_collection_shard1_replica_n5 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=tmp_collection_shard1_replica_n5&action=CREATE&collection=tmp_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 337942 INFO (zkCallback-1671-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 337942 INFO (zkCallback-1644-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 337942 INFO (zkCallback-1644-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tmp_collection/state.json] for collection [tmp_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 337942 INFO (zkCallback-1644-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent
[...truncated too long message...]
nExpiredException: KeeperErrorCode = Session expired for /collections/tmp_collection/state.json
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2131)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:339)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:339)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1564)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1550)
[junit4] 2> ... 52 more
[junit4] 2>
[junit4] 2> 362120 INFO (qtp2030562194-2850) [n:127.0.0.1:61238_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=tmp_collection_shard2_replica_n7&action=CREATE&collection=tmp_collection&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=21170
[junit4] 2> 362131 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.Overseer Overseer (id=72110154834378765-127.0.0.1:61238_-n_0000000003) closing
[junit4] 2> 362140 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@6e8026d1{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0}
[junit4] 2> 362140 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@76e7ba6e{/,null,UNAVAILABLE}
[junit4] 2> 362141 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.e.j.s.session node0 Stopped scavenging
[junit4] 2> 362149 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testCdcrDocVersions
[junit4] 2> 362150 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
[junit4] 2> 362381 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/collections/tmp_collection/terms/shard1
[junit4] 2> 5 /solr/aliases.json
[junit4] 2> 4 /solr/packages.json
[junit4] 2> 4 /solr/security.json
[junit4] 2> 4 /solr/configs/conf1
[junit4] 2> 4 /solr/collections/tmp_collection/terms/shard2
[junit4] 2> 4 /solr/collections/tmp_collection/leaders/shard1/leader
[junit4] 2> 3 /solr/collections/tmp_collection/leaders/shard2/leader
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 69 /solr/collections/tmp_collection/state.json
[junit4] 2> 5 /solr/clusterstate.json
[junit4] 2> 5 /solr/clusterprops.json
[junit4] 2> 4 /solr/autoscaling.json
[junit4] 2> 4 /solr/collections/tmp_collection/cdcr/state/buffer
[junit4] 2> 4 /solr/collections/tmp_collection/cdcr/state/process
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 33 /solr/overseer/queue
[junit4] 2> 21 /solr/live_nodes
[junit4] 2> 20 /solr/overseer/collection-queue-work
[junit4] 2> 10 /solr/collections
[junit4] 2> 4 /solr/autoscaling/events/.scheduled_maintenance
[junit4] 2> 3 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 3 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> 362386 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:61173
[junit4] 2> 362387 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:61173
[junit4] 2> 362387 INFO (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[76B14FFD05D9C1CA]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 61173
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CdcrVersionReplicationTest -Dtests.method=testCdcrDocVersions -Dtests.seed=76B14FFD05D9C1CA -Dtests.slow=true -Dtests.locale=af-NA -Dtests.timezone=Pacific/Tongatapu -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 34.8s J2 | CdcrVersionReplicationTest.testCdcrDocVersions <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.impl.BaseHttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:61195: ADDREPLICA failed to create replica
[junit4] > at __randomizedtesting.SeedInfo.seed([76B14FFD05D9C1CA:8E27445FF7BF2ED6]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:663)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:265)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
[junit4] > at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
[junit4] > at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
[junit4] > at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1147)
[junit4] > at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:910)
[junit4] > at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:842)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:224)
[junit4] > at org.apache.solr.cloud.cdcr.BaseCdcrDistributedZkTest.startServers(BaseCdcrDistributedZkTest.java:594)
[junit4] > at org.apache.solr.cloud.cdcr.BaseCdcrDistributedZkTest.createSourceCollection(BaseCdcrDistributedZkTest.java:352)
[junit4] > at org.apache.solr.cloud.cdcr.BaseCdcrDistributedZkTest.baseBefore(BaseCdcrDistributedZkTest.java:178)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:567)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1081)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1053)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:830)
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-master-MacOSX/solr/build/solr-core/test/J2/temp/solr.cloud.cdcr.CdcrVersionReplicationTest_76B14FFD05D9C1CA-001
[junit4] 2> May 26, 2020 9:06:35 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene86): {}, docValues:{}, maxPointsInLeafNode=712, maxMBSortInHeap=6.627080483256359, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@60e7cda3), locale=af-NA, timezone=Pacific/Tongatapu
[junit4] 2> NOTE: Mac OS X 10.14.6 x86_64/AdoptOpenJDK 13.0.2 (64-bit)/cpus=6,threads=1,free=31184392,total=195166208
[junit4] 2> NOTE: All tests run in this JVM: [TestStressRecovery, TestElisionMultitermQuery, TestSystemCollAutoCreate, TestDirectoryFactory, SpellPossibilityIteratorTest, OverseerTaskQueueTest, TestBulkSchemaAPI, BasicAuthOnSingleNodeTest, ReplicationFactorTest, StatsComponentTest, TestSQLHandler, RequiredFieldsTest, TestDistribPackageStore, TestDownShardTolerantSearch, TestManagedSynonymFilterFactory, TestConfigSetsAPIZkFailure, CdcrVersionReplicationTest]
[junit4] Completed [117/913 (1!)] on J2 in 34.99s, 1 test, 1 error <<< FAILURES!
[...truncated 55092 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-MacOSX/6074/consoleText
[repro] Revision: 46ca7686875243a09aecfbfb49b05f457ad68751
[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseSerialGC"
[repro] Repro line: ant test -Dtestcase=CdcrVersionReplicationTest -Dtests.method=testCdcrDocVersions -Dtests.seed=76B14FFD05D9C1CA -Dtests.slow=true -Dtests.locale=af-NA -Dtests.timezone=Pacific/Tongatapu -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] CdcrVersionReplicationTest
[repro] ant compile-test
[...truncated 3158 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.CdcrVersionReplicationTest" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseSerialGC" -Dtests.seed=76B14FFD05D9C1CA -Dtests.slow=true -Dtests.locale=af-NA -Dtests.timezone=Pacific/Tongatapu -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[...truncated 81 lines...]
[repro] Failures w/original seeds:
[repro] 0/5 failed: org.apache.solr.cloud.cdcr.CdcrVersionReplicationTest
[repro] Exiting with code 0
[...truncated 73 lines...]