You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2019/03/30 04:15:36 UTC

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk-11) - Build # 23843 - Still Unstable!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/23843/
Java: 64bit/jdk-11 -XX:+UseCompressedOops -XX:+UseG1GC

2 tests failed.
FAILED:  org.apache.solr.cloud.ReindexCollectionTest.testSameTargetReindexing

Error Message:
copied num docs expected:<200> but was:<196>

Stack Trace:
java.lang.AssertionError: copied num docs expected:<200> but was:<196>
	at __randomizedtesting.SeedInfo.seed([91B8AD75704CCD37:24C146A2772A5573]:0)
	at org.junit.Assert.fail(Assert.java:88)
	at org.junit.Assert.failNotEquals(Assert.java:834)
	at org.junit.Assert.assertEquals(Assert.java:645)
	at org.apache.solr.cloud.ReindexCollectionTest.testSameTargetReindexing(ReindexCollectionTest.java:180)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)


FAILED:  org.apache.solr.cloud.ReindexCollectionTest.testSameTargetReindexing

Error Message:
copied num docs expected:<200> but was:<199>

Stack Trace:
java.lang.AssertionError: copied num docs expected:<200> but was:<199>
	at __randomizedtesting.SeedInfo.seed([91B8AD75704CCD37:24C146A2772A5573]:0)
	at org.junit.Assert.fail(Assert.java:88)
	at org.junit.Assert.failNotEquals(Assert.java:834)
	at org.junit.Assert.assertEquals(Assert.java:645)
	at org.apache.solr.cloud.ReindexCollectionTest.testSameTargetReindexing(ReindexCollectionTest.java:180)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)




Build Log:
[...truncated 13834 lines...]
   [junit4] Suite: org.apache.solr.cloud.ReindexCollectionTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_91B8AD75704CCD37-001/init-core-data-001
   [junit4]   2> 1297725 WARN  (SUITE-ReindexCollectionTest-seed#[91B8AD75704CCD37]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=70 numCloses=70
   [junit4]   2> 1297725 INFO  (SUITE-ReindexCollectionTest-seed#[91B8AD75704CCD37]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 1297726 INFO  (SUITE-ReindexCollectionTest-seed#[91B8AD75704CCD37]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 1297726 INFO  (SUITE-ReindexCollectionTest-seed#[91B8AD75704CCD37]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1297726 INFO  (SUITE-ReindexCollectionTest-seed#[91B8AD75704CCD37]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_91B8AD75704CCD37-001/tempDir-001
   [junit4]   2> 1297726 INFO  (SUITE-ReindexCollectionTest-seed#[91B8AD75704CCD37]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1297731 INFO  (ZkTestServer Run Thread) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1297731 INFO  (ZkTestServer Run Thread) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1297831 INFO  (SUITE-ReindexCollectionTest-seed#[91B8AD75704CCD37]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:46029
   [junit4]   2> 1297831 INFO  (SUITE-ReindexCollectionTest-seed#[91B8AD75704CCD37]-worker) [    ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:46029
   [junit4]   2> 1297831 INFO  (SUITE-ReindexCollectionTest-seed#[91B8AD75704CCD37]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 46029
   [junit4]   2> 1297874 INFO  (zkConnectionManagerCallback-8888-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1297879 INFO  (zkConnectionManagerCallback-8890-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1297890 INFO  (zkConnectionManagerCallback-8892-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1297892 WARN  (jetty-launcher-8893-thread-1) [    ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 1297892 INFO  (jetty-launcher-8893-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 1297892 INFO  (jetty-launcher-8893-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 1297892 INFO  (jetty-launcher-8893-thread-1) [    ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 11+28
   [junit4]   2> 1297898 WARN  (jetty-launcher-8893-thread-2) [    ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 1297898 INFO  (jetty-launcher-8893-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 1297898 INFO  (jetty-launcher-8893-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 1297898 INFO  (jetty-launcher-8893-thread-2) [    ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 11+28
   [junit4]   2> 1297936 INFO  (jetty-launcher-8893-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1297936 INFO  (jetty-launcher-8893-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1297936 INFO  (jetty-launcher-8893-thread-1) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 1297939 INFO  (jetty-launcher-8893-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1297939 INFO  (jetty-launcher-8893-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1297939 INFO  (jetty-launcher-8893-thread-2) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 1297941 INFO  (jetty-launcher-8893-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@14583e64{/solr,null,AVAILABLE}
   [junit4]   2> 1297941 INFO  (jetty-launcher-8893-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@50a01e9c{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:37507}
   [junit4]   2> 1297941 INFO  (jetty-launcher-8893-thread-1) [    ] o.e.j.s.Server Started @1298020ms
   [junit4]   2> 1297941 INFO  (jetty-launcher-8893-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37507}
   [junit4]   2> 1297943 INFO  (jetty-launcher-8893-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@31076619{/solr,null,AVAILABLE}
   [junit4]   2> 1297943 ERROR (jetty-launcher-8893-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1297943 INFO  (jetty-launcher-8893-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1297943 INFO  (jetty-launcher-8893-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 9.0.0
   [junit4]   2> 1297943 INFO  (jetty-launcher-8893-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1297943 INFO  (jetty-launcher-8893-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1297943 INFO  (jetty-launcher-8893-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-03-30T03:29:52.987722Z
   [junit4]   2> 1297952 INFO  (jetty-launcher-8893-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@87a8ed3{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:41997}
   [junit4]   2> 1297952 INFO  (jetty-launcher-8893-thread-2) [    ] o.e.j.s.Server Started @1298032ms
   [junit4]   2> 1297953 INFO  (jetty-launcher-8893-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41997}
   [junit4]   2> 1297953 ERROR (jetty-launcher-8893-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1297953 INFO  (jetty-launcher-8893-thread-2) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 1297953 INFO  (jetty-launcher-8893-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 9.0.0
   [junit4]   2> 1297953 INFO  (jetty-launcher-8893-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1297953 INFO  (jetty-launcher-8893-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1297953 INFO  (jetty-launcher-8893-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-03-30T03:29:52.997375Z
   [junit4]   2> 1297970 INFO  (zkConnectionManagerCallback-8897-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1297970 INFO  (jetty-launcher-8893-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1297970 INFO  (zkConnectionManagerCallback-8895-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1297971 INFO  (jetty-launcher-8893-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1297973 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100d01707b30003, likely client has closed socket
   [junit4]   2> 1298043 INFO  (jetty-launcher-8893-thread-1) [    ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1298047 WARN  (jetty-launcher-8893-thread-1) [    ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@28ec9087[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1298063 WARN  (jetty-launcher-8893-thread-1) [    ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@2f2eed19[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1298063 INFO  (jetty-launcher-8893-thread-2) [    ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 1298064 INFO  (jetty-launcher-8893-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46029/solr
   [junit4]   2> 1298067 WARN  (jetty-launcher-8893-thread-2) [    ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@45ccc468[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1298094 INFO  (zkConnectionManagerCallback-8906-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1298095 WARN  (jetty-launcher-8893-thread-2) [    ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@3532bacd[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 1298096 INFO  (jetty-launcher-8893-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46029/solr
   [junit4]   2> 1298131 INFO  (zkConnectionManagerCallback-8910-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1298131 INFO  (zkConnectionManagerCallback-8913-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1298169 INFO  (jetty-launcher-8893-thread-1) [n:127.0.0.1:37507_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37507_solr
   [junit4]   2> 1298170 INFO  (jetty-launcher-8893-thread-1) [n:127.0.0.1:37507_solr    ] o.a.s.c.Overseer Overseer (id=72286391369924614-127.0.0.1:37507_solr-n_0000000000) starting
   [junit4]   2> 1298178 INFO  (zkConnectionManagerCallback-8915-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1298194 INFO  (zkConnectionManagerCallback-8922-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1298195 INFO  (jetty-launcher-8893-thread-2) [n:127.0.0.1:41997_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41997_solr
   [junit4]   2> 1298203 INFO  (zkCallback-8914-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1298203 INFO  (zkCallback-8909-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1298204 INFO  (jetty-launcher-8893-thread-1) [n:127.0.0.1:37507_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1298204 INFO  (jetty-launcher-8893-thread-1) [n:127.0.0.1:37507_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46029/solr ready
   [junit4]   2> 1298207 INFO  (OverseerStateUpdate-72286391369924614-127.0.0.1:37507_solr-n_0000000000) [n:127.0.0.1:37507_solr    ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:37507_solr
   [junit4]   2> 1298222 INFO  (jetty-launcher-8893-thread-1) [n:127.0.0.1:37507_solr    ] o.a.s.c.ZkController Publish node=127.0.0.1:37507_solr as DOWN
   [junit4]   2> 1298222 INFO  (jetty-launcher-8893-thread-1) [n:127.0.0.1:37507_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1298222 INFO  (jetty-launcher-8893-thread-1) [n:127.0.0.1:37507_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37507_solr
   [junit4]   2> 1298223 INFO  (zkCallback-8909-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1298223 INFO  (zkCallback-8914-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1298234 INFO  (zkConnectionManagerCallback-8929-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1298235 INFO  (jetty-launcher-8893-thread-2) [n:127.0.0.1:41997_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1298236 INFO  (jetty-launcher-8893-thread-2) [n:127.0.0.1:41997_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46029/solr ready
   [junit4]   2> 1298242 INFO  (jetty-launcher-8893-thread-1) [n:127.0.0.1:37507_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1298254 INFO  (zkCallback-8921-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1298258 INFO  (jetty-launcher-8893-thread-1) [n:127.0.0.1:37507_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37507.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@150b31ac
   [junit4]   2> 1298266 INFO  (jetty-launcher-8893-thread-1) [n:127.0.0.1:37507_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37507.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@150b31ac
   [junit4]   2> 1298266 INFO  (jetty-launcher-8893-thread-1) [n:127.0.0.1:37507_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37507.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@150b31ac
   [junit4]   2> 1298267 INFO  (jetty-launcher-8893-thread-1) [n:127.0.0.1:37507_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_91B8AD75704CCD37-001/tempDir-001/node1/.
   [junit4]   2> 1298293 INFO  (jetty-launcher-8893-thread-2) [n:127.0.0.1:41997_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 1298308 INFO  (jetty-launcher-8893-thread-2) [n:127.0.0.1:41997_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41997.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@150b31ac
   [junit4]   2> 1298316 INFO  (jetty-launcher-8893-thread-2) [n:127.0.0.1:41997_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41997.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@150b31ac
   [junit4]   2> 1298317 INFO  (jetty-launcher-8893-thread-2) [n:127.0.0.1:41997_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41997.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@150b31ac
   [junit4]   2> 1298317 INFO  (jetty-launcher-8893-thread-2) [n:127.0.0.1:41997_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_91B8AD75704CCD37-001/tempDir-001/node2/.
   [junit4]   2> 1298358 INFO  (zkConnectionManagerCallback-8936-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1298358 INFO  (SUITE-ReindexCollectionTest-seed#[91B8AD75704CCD37]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1298359 INFO  (SUITE-ReindexCollectionTest-seed#[91B8AD75704CCD37]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46029/solr ready
   [junit4]   2> 1298375 INFO  (TEST-ReindexCollectionTest.testFailure-seed#[91B8AD75704CCD37]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFailure
   [junit4]   2> 1298390 INFO  (zkConnectionManagerCallback-8941-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1298391 INFO  (TEST-ReindexCollectionTest.testFailure-seed#[91B8AD75704CCD37]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1298392 INFO  (TEST-ReindexCollectionTest.testFailure-seed#[91B8AD75704CCD37]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46029/solr ready
   [junit4]   2> 1298404 INFO  (qtp183703520-20405) [n:127.0.0.1:41997_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&maxShardsPerNode=-1&name=failReindexing&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1298427 INFO  (OverseerThreadFactory-6009-thread-1-processing-n:127.0.0.1:37507_solr) [n:127.0.0.1:37507_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection failReindexing
   [junit4]   2> 1298538 INFO  (OverseerStateUpdate-72286391369924614-127.0.0.1:37507_solr-n_0000000000) [n:127.0.0.1:37507_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"failReindexing",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"failReindexing_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:37507/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1298539 INFO  (OverseerStateUpdate-72286391369924614-127.0.0.1:37507_solr-n_0000000000) [n:127.0.0.1:37507_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"failReindexing",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"failReindexing_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:41997/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1298541 INFO  (OverseerStateUpdate-72286391369924614-127.0.0.1:37507_solr-n_0000000000) [n:127.0.0.1:37507_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"failReindexing",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"failReindexing_shard2_replica_n5",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:37507/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1298543 INFO  (OverseerStateUpdate-72286391369924614-127.0.0.1:37507_solr-n_0000000000) [n:127.0.0.1:37507_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"failReindexing",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"failReindexing_shard2_replica_n7",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:41997/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1298756 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr    x:failReindexing_shard1_replica_n2] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf1&newCollection=true&name=failReindexing_shard1_replica_n2&action=CREATE&numShards=2&collection=failReindexing&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1298756 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr    x:failReindexing_shard1_replica_n2] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1298758 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr    x:failReindexing_shard2_replica_n5] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf1&newCollection=true&name=failReindexing_shard2_replica_n5&action=CREATE&numShards=2&collection=failReindexing&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1298793 INFO  (qtp573680078-20404) [n:127.0.0.1:37507_solr    x:failReindexing_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&newCollection=true&name=failReindexing_shard1_replica_n1&action=CREATE&numShards=2&collection=failReindexing&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1298798 INFO  (qtp183703520-20407) [n:127.0.0.1:41997_solr    x:failReindexing_shard2_replica_n7] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf1&newCollection=true&name=failReindexing_shard2_replica_n7&action=CREATE&numShards=2&collection=failReindexing&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1299860 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
   [junit4]   2> 1299860 INFO  (qtp183703520-20407) [n:127.0.0.1:41997_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n7] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
   [junit4]   2> 1299915 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
   [junit4]   2> 1299920 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.s.IndexSchema [failReindexing_shard2_replica_n5] Schema name=minimal
   [junit4]   2> 1299921 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1299921 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.c.CoreContainer Creating SolrCore 'failReindexing_shard2_replica_n5' using configuration from collection failReindexing, trusted=true
   [junit4]   2> 1299922 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37507.solr.core.failReindexing.shard2.replica_n5' (registry 'solr.core.failReindexing.shard2.replica_n5') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@150b31ac
   [junit4]   2> 1299922 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.c.SolrCore [[failReindexing_shard2_replica_n5] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_91B8AD75704CCD37-001/tempDir-001/node1/failReindexing_shard2_replica_n5], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_91B8AD75704CCD37-001/tempDir-001/node1/./failReindexing_shard2_replica_n5/data/]
   [junit4]   2> 1299936 INFO  (qtp183703520-20407) [n:127.0.0.1:41997_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n7] o.a.s.s.IndexSchema [failReindexing_shard2_replica_n7] Schema name=minimal
   [junit4]   2> 1299937 INFO  (qtp183703520-20407) [n:127.0.0.1:41997_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n7] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1299937 INFO  (qtp183703520-20407) [n:127.0.0.1:41997_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n7] o.a.s.c.CoreContainer Creating SolrCore 'failReindexing_shard2_replica_n7' using configuration from collection failReindexing, trusted=true
   [junit4]   2> 1299937 INFO  (qtp183703520-20407) [n:127.0.0.1:41997_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n7] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41997.solr.core.failReindexing.shard2.replica_n7' (registry 'solr.core.failReindexing.shard2.replica_n7') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@150b31ac
   [junit4]   2> 1299938 INFO  (qtp183703520-20407) [n:127.0.0.1:41997_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n7] o.a.s.c.SolrCore [[failReindexing_shard2_replica_n7] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_91B8AD75704CCD37-001/tempDir-001/node2/failReindexing_shard2_replica_n7], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_91B8AD75704CCD37-001/tempDir-001/node2/./failReindexing_shard2_replica_n7/data/]
   [junit4]   2> 1299940 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.s.IndexSchema [failReindexing_shard1_replica_n2] Schema name=minimal
   [junit4]   2> 1299943 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1299943 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'failReindexing_shard1_replica_n2' using configuration from collection failReindexing, trusted=true
   [junit4]   2> 1299943 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41997.solr.core.failReindexing.shard1.replica_n2' (registry 'solr.core.failReindexing.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@150b31ac
   [junit4]   2> 1299944 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.c.SolrCore [[failReindexing_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_91B8AD75704CCD37-001/tempDir-001/node2/failReindexing_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_91B8AD75704CCD37-001/tempDir-001/node2/./failReindexing_shard1_replica_n2/data/]
   [junit4]   2> 1299954 INFO  (qtp573680078-20404) [n:127.0.0.1:37507_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
   [junit4]   2> 1299963 INFO  (qtp573680078-20404) [n:127.0.0.1:37507_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.s.IndexSchema [failReindexing_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 1299964 INFO  (qtp573680078-20404) [n:127.0.0.1:37507_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1299964 INFO  (qtp573680078-20404) [n:127.0.0.1:37507_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'failReindexing_shard1_replica_n1' using configuration from collection failReindexing, trusted=true
   [junit4]   2> 1299964 INFO  (qtp573680078-20404) [n:127.0.0.1:37507_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37507.solr.core.failReindexing.shard1.replica_n1' (registry 'solr.core.failReindexing.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@150b31ac
   [junit4]   2> 1299964 INFO  (qtp573680078-20404) [n:127.0.0.1:37507_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.c.SolrCore [[failReindexing_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_91B8AD75704CCD37-001/tempDir-001/node1/failReindexing_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_91B8AD75704CCD37-001/tempDir-001/node1/./failReindexing_shard1_replica_n1/data/]
   [junit4]   2> 1300015 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1300015 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1300017 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1300017 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1300019 INFO  (qtp183703520-20407) [n:127.0.0.1:41997_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n7] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1300019 INFO  (qtp183703520-20407) [n:127.0.0.1:41997_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n7] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1300021 INFO  (qtp183703520-20407) [n:127.0.0.1:41997_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n7] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1300021 INFO  (qtp183703520-20407) [n:127.0.0.1:41997_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n7] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1300027 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@577e49b4[failReindexing_shard1_replica_n2] main]
   [junit4]   2> 1300035 INFO  (qtp183703520-20407) [n:127.0.0.1:41997_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n7] o.a.s.s.SolrIndexSearcher Opening [Searcher@4aa1cd8[failReindexing_shard2_replica_n7] main]
   [junit4]   2> 1300053 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1300053 INFO  (qtp183703520-20407) [n:127.0.0.1:41997_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n7] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1300067 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1300067 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1300069 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1300069 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1300070 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.s.SolrIndexSearcher Opening [Searcher@4c3978a4[failReindexing_shard2_replica_n5] main]
   [junit4]   2> 1300070 INFO  (qtp183703520-20407) [n:127.0.0.1:41997_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n7] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1300070 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1300071 INFO  (qtp573680078-20404) [n:127.0.0.1:37507_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1300071 INFO  (qtp573680078-20404) [n:127.0.0.1:37507_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1300071 INFO  (qtp183703520-20407) [n:127.0.0.1:41997_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n7] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1300071 INFO  (qtp183703520-20407) [n:127.0.0.1:41997_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n7] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1629399647639306240
   [junit4]   2> 1300073 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1300073 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1629399647641403392
   [junit4]   2> 1300073 INFO  (qtp573680078-20404) [n:127.0.0.1:37507_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1300073 INFO  (qtp573680078-20404) [n:127.0.0.1:37507_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1300075 INFO  (qtp573680078-20404) [n:127.0.0.1:37507_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@524148c5[failReindexing_shard1_replica_n1] main]
   [junit4]   2> 1300086 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1300086 INFO  (qtp573680078-20404) [n:127.0.0.1:37507_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1300086 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1300089 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1300089 INFO  (qtp573680078-20404) [n:127.0.0.1:37507_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1300089 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1629399647658180608
   [junit4]   2> 1300089 INFO  (searcherExecutor-6019-thread-1-processing-n:127.0.0.1:41997_solr x:failReindexing_shard1_replica_n2 c:failReindexing s:shard1 r:core_node4) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.c.SolrCore [failReindexing_shard1_replica_n2] Registered new searcher Searcher@577e49b4[failReindexing_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1300090 INFO  (searcherExecutor-6018-thread-1-processing-n:127.0.0.1:41997_solr x:failReindexing_shard2_replica_n7 c:failReindexing s:shard2 r:core_node8) [n:127.0.0.1:41997_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n7] o.a.s.c.SolrCore [failReindexing_shard2_replica_n7] Registered new searcher Searcher@4aa1cd8[failReindexing_shard2_replica_n7] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1300090 INFO  (qtp573680078-20404) [n:127.0.0.1:37507_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1300090 INFO  (qtp573680078-20404) [n:127.0.0.1:37507_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1629399647659229184
   [junit4]   2> 1300102 INFO  (searcherExecutor-6020-thread-1-processing-n:127.0.0.1:37507_solr x:failReindexing_shard1_replica_n1 c:failReindexing s:shard1 r:core_node3) [n:127.0.0.1:37507_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.c.SolrCore [failReindexing_shard1_replica_n1] Registered new searcher Searcher@524148c5[failReindexing_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1300102 INFO  (searcherExecutor-6017-thread-1-processing-n:127.0.0.1:37507_solr x:failReindexing_shard2_replica_n5 c:failReindexing s:shard2 r:core_node6) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.c.SolrCore [failReindexing_shard2_replica_n5] Registered new searcher Searcher@4c3978a4[failReindexing_shard2_replica_n5] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1300103 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/failReindexing/terms/shard1 to Terms{values={core_node4=0}, version=0}
   [junit4]   2> 1300103 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/failReindexing/leaders/shard1
   [junit4]   2> 1300104 INFO  (qtp183703520-20407) [n:127.0.0.1:41997_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n7] o.a.s.c.ZkShardTerms Successful update of terms at /collections/failReindexing/terms/shard2 to Terms{values={core_node8=0}, version=0}
   [junit4]   2> 1300104 INFO  (qtp183703520-20407) [n:127.0.0.1:41997_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n7] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/failReindexing/leaders/shard2
   [junit4]   2> 1300105 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.c.ZkShardTerms Successful update of terms at /collections/failReindexing/terms/shard2 to Terms{values={core_node6=0, core_node8=0}, version=1}
   [junit4]   2> 1300105 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/failReindexing/leaders/shard2
   [junit4]   2> 1300107 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 1300108 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1300108 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1300108 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:37507/solr/failReindexing_shard2_replica_n5/
   [junit4]   2> 1300108 INFO  (qtp573680078-20404) [n:127.0.0.1:37507_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/failReindexing/terms/shard1 to Terms{values={core_node3=0, core_node4=0}, version=1}
   [junit4]   2> 1300108 INFO  (qtp573680078-20404) [n:127.0.0.1:37507_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/failReindexing/leaders/shard1
   [junit4]   2> 1300108 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.u.PeerSync PeerSync: core=failReindexing_shard2_replica_n5 url=http://127.0.0.1:37507/solr START replicas=[http://127.0.0.1:41997/solr/failReindexing_shard2_replica_n7/] nUpdates=100
   [junit4]   2> 1300110 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.u.PeerSync PeerSync: core=failReindexing_shard2_replica_n5 url=http://127.0.0.1:37507/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 1300112 INFO  (qtp183703520-20481) [n:127.0.0.1:41997_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n7] o.a.s.c.S.Request [failReindexing_shard2_replica_n7]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1300112 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 1300112 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1300112 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/failReindexing/leaders/shard2/leader after winning as /collections/failReindexing/leader_elect/shard2/election/72286391369924614-core_node6-n_0000000000
   [junit4]   2> 1300113 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:37507/solr/failReindexing_shard2_replica_n5/ shard2
   [junit4]   2> 1300222 INFO  (zkCallback-8909-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1300223 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1300227 INFO  (zkCallback-8909-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1300227 INFO  (zkCallback-8909-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1300249 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node6&collection.configName=conf1&newCollection=true&name=failReindexing_shard2_replica_n5&action=CREATE&numShards=2&collection=failReindexing&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1490
   [junit4]   2> 1300351 INFO  (zkCallback-8909-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1300351 INFO  (zkCallback-8909-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1300351 INFO  (zkCallback-8909-thread-3) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1300363 INFO  (zkCallback-8909-thread-4) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1300608 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1300608 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1300608 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:41997/solr/failReindexing_shard1_replica_n2/
   [junit4]   2> 1300608 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=failReindexing_shard1_replica_n2 url=http://127.0.0.1:41997/solr START replicas=[http://127.0.0.1:37507/solr/failReindexing_shard1_replica_n1/] nUpdates=100
   [junit4]   2> 1300614 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=failReindexing_shard1_replica_n2 url=http://127.0.0.1:41997/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 1300615 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.c.S.Request [failReindexing_shard1_replica_n1]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1300622 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 1300622 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1300622 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/failReindexing/leaders/shard1/leader after winning as /collections/failReindexing/leader_elect/shard1/election/72286391369924616-core_node4-n_0000000000
   [junit4]   2> 1300623 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:41997/solr/failReindexing_shard1_replica_n2/ shard1
   [junit4]   2> 1300727 INFO  (zkCallback-8914-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1300727 INFO  (zkCallback-8909-thread-4) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1300727 INFO  (zkCallback-8909-thread-3) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1300727 INFO  (zkCallback-8909-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1300727 INFO  (zkCallback-8909-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1300728 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1300756 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf1&newCollection=true&name=failReindexing_shard1_replica_n2&action=CREATE&numShards=2&collection=failReindexing&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2001
   [junit4]   2> 1300834 INFO  (zkCallback-8909-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1300834 INFO  (zkCallback-8909-thread-3) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1300834 INFO  (zkCallback-8909-thread-4) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1300834 INFO  (zkCallback-8914-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1300835 INFO  (zkCallback-8909-thread-5) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1300842 INFO  (zkCallback-8914-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1301148 INFO  (qtp183703520-20407) [n:127.0.0.1:41997_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n7] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf1&newCollection=true&name=failReindexing_shard2_replica_n7&action=CREATE&numShards=2&collection=failReindexing&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2350
   [junit4]   2> 1301148 INFO  (qtp573680078-20404) [n:127.0.0.1:37507_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&newCollection=true&name=failReindexing_shard1_replica_n1&action=CREATE&numShards=2&collection=failReindexing&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2356
   [junit4]   2> 1301171 INFO  (qtp183703520-20405) [n:127.0.0.1:41997_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
   [junit4]   2> 1301227 INFO  (zkCallback-8914-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1301227 INFO  (zkCallback-8909-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1301227 INFO  (zkCallback-8909-thread-4) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1301227 INFO  (zkCallback-8909-thread-3) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1301227 INFO  (zkCallback-8914-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1301227 INFO  (qtp183703520-20405) [n:127.0.0.1:41997_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&maxShardsPerNode=-1&name=failReindexing&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2} status=0 QTime=2823
   [junit4]   2> 1301227 INFO  (zkCallback-8909-thread-5) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexing/state.json] for collection [failReindexing] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1301243 INFO  (qtp183703520-20479) [n:127.0.0.1:41997_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=conf1&maxShardsPerNode=-1&name=failReindexingTarget&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1301284 INFO  (OverseerThreadFactory-6009-thread-2-processing-n:127.0.0.1:37507_solr) [n:127.0.0.1:37507_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection failReindexingTarget
   [junit4]   2> 1301299 INFO  (OverseerCollectionConfigSetProcessor-72286391369924614-127.0.0.1:37507_solr-n_0000000000) [n:127.0.0.1:37507_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1301564 INFO  (OverseerStateUpdate-72286391369924614-127.0.0.1:37507_solr-n_0000000000) [n:127.0.0.1:37507_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"failReindexingTarget",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"failReindexingTarget_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:37507/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1301765 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr    x:failReindexingTarget_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=failReindexingTarget_shard1_replica_n1&action=CREATE&numShards=1&collection=failReindexingTarget&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1302777 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
   [junit4]   2> 1302868 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.s.IndexSchema [failReindexingTarget_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 1302869 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1302869 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'failReindexingTarget_shard1_replica_n1' using configuration from collection failReindexingTarget, trusted=true
   [junit4]   2> 1302869 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37507.solr.core.failReindexingTarget.shard1.replica_n1' (registry 'solr.core.failReindexingTarget.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@150b31ac
   [junit4]   2> 1302869 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.SolrCore [[failReindexingTarget_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_91B8AD75704CCD37-001/tempDir-001/node1/failReindexingTarget_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_91B8AD75704CCD37-001/tempDir-001/node1/./failReindexingTarget_shard1_replica_n1/data/]
   [junit4]   2> 1302978 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1302978 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1302980 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1302980 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1302988 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6e1a02bd[failReindexingTarget_shard1_replica_n1] main]
   [junit4]   2> 1302989 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1302989 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1302989 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1302989 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1629399650699051008
   [junit4]   2> 1302991 INFO  (searcherExecutor-6037-thread-1-processing-n:127.0.0.1:37507_solr x:failReindexingTarget_shard1_replica_n1 c:failReindexingTarget s:shard1 r:core_node2) [n:127.0.0.1:37507_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.SolrCore [failReindexingTarget_shard1_replica_n1] Registered new searcher Searcher@6e1a02bd[failReindexingTarget_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1302994 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/failReindexingTarget/terms/shard1 to Terms{values={core_node2=0}, version=0}
   [junit4]   2> 1302994 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/failReindexingTarget/leaders/shard1
   [junit4]   2> 1302996 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1302996 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1302996 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:37507/solr/failReindexingTarget_shard1_replica_n1/
   [junit4]   2> 1302996 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1302996 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:37507/solr/failReindexingTarget_shard1_replica_n1/ has no replicas
   [junit4]   2> 1302996 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/failReindexingTarget/leaders/shard1/leader after winning as /collections/failReindexingTarget/leader_elect/shard1/election/72286391369924614-core_node2-n_0000000000
   [junit4]   2> 1302997 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:37507/solr/failReindexingTarget_shard1_replica_n1/ shard1
   [junit4]   2> 1303103 INFO  (zkCallback-8909-thread-5) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexingTarget/state.json] for collection [failReindexingTarget] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1303103 INFO  (zkCallback-8909-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexingTarget/state.json] for collection [failReindexingTarget] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1303103 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1303104 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr c:failReindexingTarget s:shard1 r:core_node2 x:failReindexingTarget_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=failReindexingTarget_shard1_replica_n1&action=CREATE&numShards=1&collection=failReindexingTarget&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1339
   [junit4]   2> 1303111 INFO  (qtp183703520-20479) [n:127.0.0.1:41997_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
   [junit4]   2> 1303112 INFO  (OverseerCollectionConfigSetProcessor-72286391369924614-127.0.0.1:37507_solr-n_0000000000) [n:127.0.0.1:37507_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1303227 INFO  (zkCallback-8914-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexingTarget/state.json] for collection [failReindexingTarget] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1303227 INFO  (qtp183703520-20479) [n:127.0.0.1:41997_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&maxShardsPerNode=-1&name=failReindexingTarget&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=1984
   [junit4]   2> 1303230 INFO  (zkCallback-8909-thread-5) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexingTarget/state.json] for collection [failReindexingTarget] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1303231 INFO  (qtp183703520-20481) [n:127.0.0.1:41997_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :createalias with params collections=failReindexingTarget&name=failAlias&action=CREATEALIAS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1303231 INFO  (zkCallback-8909-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexingTarget/state.json] for collection [failReindexingTarget] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1303231 INFO  (zkCallback-8909-thread-3) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/failReindexingTarget/state.json] for collection [failReindexingTarget] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1303360 INFO  (qtp183703520-20481) [n:127.0.0.1:41997_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collections=failReindexingTarget&name=failAlias&action=CREATEALIAS&wt=javabin&version=2} status=0 QTime=129
   [junit4]   2> 1303440 INFO  (qtp573680078-20404) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.c.ZkShardTerms Successful update of terms at /collections/failReindexing/terms/shard2 to Terms{values={core_node6=1, core_node8=1}, version=2}
   [junit4]   2> 1303495 INFO  (qtp183703520-20479) [n:127.0.0.1:41997_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n7] o.a.s.u.p.LogUpdateProcessorFactory [failReindexing_shard2_replica_n7]  webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:37507/solr/failReindexing_shard2_replica_n5/&wt=javabin&version=2}{add=[2 (1629399651122675712), 3 (1629399651166715904), 5 (1629399651166715905), 6 (1629399651166715906), 7 (1629399651166715907), 9 (1629399651166715908), 17 (1629399651166715909), 18 (1629399651166715910), 19 (1629399651166715911), 21 (1629399651166715912), ... (97 adds)]} 0 18
   [junit4]   2> 1303495 INFO  (qtp573680078-20404) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.u.p.LogUpdateProcessorFactory [failReindexing_shard2_replica_n5]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[2 (1629399651122675712), 3 (1629399651166715904), 5 (1629399651166715905), 6 (1629399651166715906), 7 (1629399651166715907), 9 (1629399651166715908), 17 (1629399651166715909), 18 (1629399651166715910), 19 (1629399651166715911), 21 (1629399651166715912), ... (97 adds)]} 0 102
   [junit4]   2> 1303502 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.c.ZkShardTerms Successful update of terms at /collections/failReindexing/terms/shard1 to Terms{values={core_node3=1, core_node4=1}, version=2}
   [junit4]   2> 1303516 INFO  (qtp573680078-20402) [n:127.0.0.1:37507_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [failReindexing_shard1_replica_n1]  webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:41997/solr/failReindexing_shard1_replica_n2/&wt=javabin&version=2}{add=[0 (1629399651107995648), 1 (1629399651133161472), 4 (1629399651133161473), 8 (1629399651133161474), 10 (1629399651133161475), 11 (1629399651133161476), 12 (1629399651133161477), 13 (1629399651133161478), 14 (1629399651133161479), 15 (1629399651133161480), ... (103 adds)]} 0 19
   [junit4]   2> 1303519 INFO  (qtp183703520-20403) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [failReindexing_shard1_replica_n2]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[0 (1629399651107995648), 1 (1629399651133161472), 4 (1629399651133161473), 8 (1629399651133161474), 10 (1629399651133161475), 11 (1629399651133161476), 12 (1629399651133161477), 13 (1629399651133161478), 14 (1629399651133161479), 15 (1629399651133161480), ... (103 adds)]} 0 139
   [junit4]   2> 1303521 INFO  (qtp183703520-20481) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1629399651256893440,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1303522 INFO  (qtp183703520-20481) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@2d8f4da1 commitCommandVersion:1629399651256893440
   [junit4]   2> 1303522 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1629399651257942016,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1303522 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1400a173 commitCommandVersion:1629399651257942016
   [junit4]   2> 1303560 INFO  (qtp183703520-20481) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@38cf664c[failReindexing_shard1_replica_n2] main]
   [junit4]   2> 1303561 INFO  (qtp183703520-20481) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1303562 INFO  (searcherExecutor-6019-thread-1-processing-n:127.0.0.1:41997_solr x:failReindexing_shard1_replica_n2 c:failReindexing s:shard1 r:core_node4) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.c.SolrCore [failReindexing_shard1_replica_n2] Registered new searcher Searcher@38cf664c[failReindexing_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(9.0.0):C103:[diagnostics={os=Linux, java.vendor=Oracle Corporation, java.version=11, java.vm.version=11+28, lucene.version=9.0.0, os.arch=amd64, java.runtime.version=11+28, source=flush, os.version=4.18.0-15-generic, timestamp=1553916598569}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}])))}
   [junit4]   2> 1303571 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3c560ccd[failReindexing_shard1_replica_n1] main]
   [junit4]   2> 1303572 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1303573 INFO  (searcherExecutor-6020-thread-1-processing-n:127.0.0.1:37507_solr x:failReindexing_shard1_replica_n1 c:failReindexing s:shard1 r:core_node3) [n:127.0.0.1:37507_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.c.SolrCore [failReindexing_shard1_replica_n1] Registered new searcher Searcher@3c560ccd[failReindexing_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(9.0.0):C103:[diagnostics={os=Linux, java.vendor=Oracle Corporation, java.version=11, java.vm.version=11+28, lucene.version=9.0.0, os.arch=amd64, java.runtime.version=11+28, source=flush, os.version=4.18.0-15-generic, timestamp=1553916598569}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}])))}
   [junit4]   2> 1303573 INFO  (qtp573680078-20406) [n:127.0.0.1:37507_solr c:failReindexing s:shard1 r:core_node3 x:failReindexing_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [failReindexing_shard1_replica_n1]  webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:41997/solr/failReindexing_shard1_replica_n2/&commit_end_point=replicas&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 51
   [junit4]   2> 1303573 INFO  (qtp183703520-20481) [n:127.0.0.1:41997_solr c:failReindexing s:shard1 r:core_node4 x:failReindexing_shard1_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [failReindexing_shard1_replica_n2]  webapp=/solr path=/update params={update.distrib=TOLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:37507/solr/failReindexing_shard2_replica_n5/&commit_end_point=leaders&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 53
   [junit4]   2> 1303579 INFO  (qtp573680078-20404) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1629399651317710848,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1303579 INFO  (qtp573680078-20404) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@7aa169a8 commitCommandVersion:1629399651317710848
   [junit4]   2> 1303580 INFO  (qtp183703520-20407) [n:127.0.0.1:41997_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n7] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1629399651318759424,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1303580 INFO  (qtp183703520-20407) [n:127.0.0.1:41997_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n7] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@77681bc1 commitCommandVersion:1629399651318759424
   [junit4]   2> 1303585 INFO  (qtp573680078-20404) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.s.SolrIndexSearcher Opening [Searcher@42de843e[failReindexing_shard2_replica_n5] main]
   [junit4]   2> 1303586 INFO  (qtp573680078-20404) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1303587 INFO  (searcherExecutor-6017-thread-1-processing-n:127.0.0.1:37507_solr x:failReindexing_shard2_replica_n5 c:failReindexing s:shard2 r:core_node6) [n:127.0.0.1:37507_solr c:failReindexing s:shard2 r:core_node6 x:failReindexing_shard2_replica_n5] o.a.s.c.SolrCore [failReindexing_shard2_replica_n5] Registered new searcher Searcher@42de843e[failReindexing_shard2_replica_n5] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(9.0.0):C97:[diagnostics={os=Linux, java.vendor=Oracle Corporation, java.version=11, java.vm.version=11+28, lucene.version=9.0.0, os.arch=amd64, java.runtime.version=11+28, source=flush, os.version=4.18.0-15-generic, timestamp=1553916598626}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}])))}
   [junit4]   2> 1303588 INFO  (qtp183703520-20407) [n:127.0.0.1:41997_solr c:failReindexing s:shard2 r:core_node8 x:failReindexing_shard2_replica_n7] o.a.s.s.SolrIndexSearcher Opening [Searcher@56af80c8[failRein

[...truncated too long message...]

) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@231ff7d5{/solr,null,UNAVAILABLE}
   [junit4]   2> 92578 INFO  (jetty-closer-258-thread-1) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 92583 INFO  (jetty-closer-258-thread-2) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@dc91ec7{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:0}
   [junit4]   2> 92584 INFO  (jetty-closer-258-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@567808cb{/solr,null,UNAVAILABLE}
   [junit4]   2> 92584 INFO  (jetty-closer-258-thread-2) [    ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 92585 INFO  (SUITE-ReindexCollectionTest-seed#[91B8AD75704CCD37]-worker) [    ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 92588 WARN  (ZkTestServer Run Thread) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	37	/solr/aliases.json
   [junit4]   2> 	37	/solr/clusterprops.json
   [junit4]   2> 	11	/solr/collections/failReindexingTarget/terms/shard1
   [junit4]   2> 	10	/solr/collections/.rx_sameTargetReindexing_5/terms/shard1
   [junit4]   2> 	10	/solr/collections/.rx_sameTargetReindexing_5/terms/shard2
   [junit4]   2> 	10	/solr/collections/basicReindexingTarget/terms/shard2
   [junit4]   2> 	10	/solr/collections/sourceLossyReindexing/terms/shard1
   [junit4]   2> 	10	/solr/collections/sourceLossyReindexing/terms/shard2
   [junit4]   2> 	10	/solr/collections/sameTargetReindexing/terms/shard2
   [junit4]   2> 	10	/solr/configs/conf1
   [junit4]   2> 	10	/solr/collections/reshapeReindexing/terms/shard2
   [junit4]   2> 	9	/solr/collections/failReindexingTarget/terms/shard2
   [junit4]   2> 	9	/solr/collections/basicReindexing/terms/shard1
   [junit4]   2> 	9	/solr/collections/basicReindexing/terms/shard2
   [junit4]   2> 	9	/solr/collections/basicReindexingTarget/terms/shard1
   [junit4]   2> 	9	/solr/collections/reshapeReindexingTarget/terms/bar
   [junit4]   2> 	9	/solr/collections/sameTargetReindexing/terms/shard1
   [junit4]   2> 	9	/solr/collections/reshapeReindexing/terms/shard1
   [junit4]   2> 	9	/solr/collections/targetLossyReindexing/terms/shard2
   [junit4]   2> 	9	/solr/collections/failReindexing/terms/shard2
   [junit4]   2> 	8	/solr/collections/targetLossyReindexing/terms/shard1
   [junit4]   2> 	8	/solr/collections/failReindexing/terms/shard1
   [junit4]   2> 	7	/solr/collections/reshapeReindexingTarget/terms/foo
   [junit4]   2> 	7	/solr/collections/reshapeReindexingTarget/terms/baz
   [junit4]   2> 	6	/solr/configs/_default
   [junit4]   2> 	6	/solr/configs/_default/managed-schema
   [junit4]   2> 	4	/solr/collections/.rx_ck_sourceLossyReindexing/terms/shard1
   [junit4]   2> 	4	/solr/collections/abortReindexingTarget/state.json
   [junit4]   2> 	4	/solr/collections/.rx_ck_reshapeReindexing/terms/shard1
   [junit4]   2> 	4	/solr/collections/.rx_ck_failReindexing/terms/shard1
   [junit4]   2> 	4	/solr/collections/.rx_ck_basicReindexing/terms/shard1
   [junit4]   2> 	4	/solr/collections/abortReindexing/state.json
   [junit4]   2> 	4	/solr/collections/.rx_ck_sameTargetReindexing/terms/shard1
   [junit4]   2> 	3	/solr/collections/.rx_ck_abortReindexing/terms/shard1
   [junit4]   2> 	3	/solr/collections/abortReindexing/terms/shard2
   [junit4]   2> 	3	/solr/collections/abortReindexing/terms/shard1
   [junit4]   2> 	3	/solr/collections/.rx_ck_sameTargetReindexing/state.json
   [junit4]   2> 	2	/solr/collections/basicReindexingTarget/state.json
   [junit4]   2> 	2	/solr/collections/.rx_ck_reshapeReindexing/state.json
   [junit4]   2> 	2	/solr/collections/targetLossyReindexing/state.json
   [junit4]   2> 	2	/solr/collections/.rx_ck_abortReindexing/state.json
   [junit4]   2> 	2	/solr/collections/basicReindexing/state.json
   [junit4]   2> 	2	/solr/collections/reshapeReindexingTarget/state.json
   [junit4]   2> 	2	/solr/collections/sourceLossyReindexing/state.json
   [junit4]   2> 	2	/solr/collections/.rx_sameTargetReindexing_5/state.json
   [junit4]   2> 	2	/solr/collections/reshapeReindexing/state.json
   [junit4]   2> 	2	/solr/collections/failReindexing/state.json
   [junit4]   2> 	2	/solr/security.json
   [junit4]   2> 	2	/solr/collections/abortReindexingTarget/terms/shard1
   [junit4]   2> 	2	/solr/configs/conf2
   [junit4]   2> 	2	/solr/configs/conf3
   [junit4]   2> 	2	/solr/collections/abortReindexingTarget/terms/shard2
   [junit4]   2> 	2	/solr/collections/.rx_ck_failReindexing/state.json
   [junit4]   2> 	2	/solr/collections/sameTargetReindexing/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	37	/solr/clusterstate.json
   [junit4]   2> 	24	/solr/aliases.json
   [junit4]   2> 	20	/solr/collections/failReindexingTarget/state.json
   [junit4]   2> 	20	/solr/collections/abortReindexing/state.json
   [junit4]   2> 	16	/solr/collections/failReindexing/state.json
   [junit4]   2> 	15	/solr/collections/reshapeReindexing/state.json
   [junit4]   2> 	15	/solr/collections/sameTargetReindexing/state.json
   [junit4]   2> 	14	/solr/collections/basicReindexing/state.json
   [junit4]   2> 	14	/solr/collections/reshapeReindexingTarget/state.json
   [junit4]   2> 	14	/solr/collections/sourceLossyReindexing/state.json
   [junit4]   2> 	13	/solr/collections/basicReindexingTarget/state.json
   [junit4]   2> 	13	/solr/collections/.rx_sameTargetReindexing_5/state.json
   [junit4]   2> 	12	/solr/collections/abortReindexingTarget/state.json
   [junit4]   2> 	12	/solr/collections/targetLossyReindexing/state.json
   [junit4]   2> 	9	/solr/collections/.rx_ck_basicReindexing/state.json
   [junit4]   2> 	9	/solr/collections/.rx_ck_sourceLossyReindexing/state.json
   [junit4]   2> 	9	/solr/collections/.rx_ck_sameTargetReindexing/state.json
   [junit4]   2> 	8	/solr/collections/.rx_ck_reshapeReindexing/state.json
   [junit4]   2> 	7	/solr/collections/.rx_ck_failReindexing/state.json
   [junit4]   2> 	6	/solr/collections/.rx_ck_abortReindexing/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	46	/solr/collections
   [junit4]   2> 	37	/solr/live_nodes
   [junit4]   2> 
   [junit4]   2> 92613 INFO  (SUITE-ReindexCollectionTest-seed#[91B8AD75704CCD37]-worker) [    ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:35121
   [junit4]   2> 92613 INFO  (SUITE-ReindexCollectionTest-seed#[91B8AD75704CCD37]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 35121
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ReindexCollectionTest_91B8AD75704CCD37-001
   [junit4]   2> Mar 30, 2019 4:13:07 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene80): {_version_=PostingsFormat(name=Asserting), remove_s=PostingsFormat(name=MockRandom), _root_=PostingsFormat(name=Asserting), string_s=PostingsFormat(name=LuceneVarGapFixedInterval), sind=PostingsFormat(name=Asserting), id=Lucene50(blocksize=128)}, docValues:{_version_=DocValuesFormat(name=Direct), id=DocValuesFormat(name=Lucene80)}, maxPointsInLeafNode=1066, maxMBSortInHeap=6.790084594021398, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@3d90b578), locale=es-PE, timezone=America/Creston
   [junit4]   2> NOTE: Linux 4.18.0-15-generic amd64/Oracle Corporation 11 (64-bit)/cpus=8,threads=2,free=364623872,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [ReindexCollectionTest]
   [junit4] Completed [2/5 (1!)] on J2 in 91.73s, 6 tests, 1 failure <<< FAILURES!

[...truncated 38 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1573: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1100: There were test failures: 5 suites, 30 tests, 1 failure [seed: 91B8AD75704CCD37]

Total time: 2 minutes 51 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   1/5 failed: org.apache.solr.cloud.ReindexCollectionTest
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
No credentials specified
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=b2941ff0da4987dec4774aa6b4bb7c597b362243, workspace=/home/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #23842
Recording test results
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_172) - Build # 23844 - Failure!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/23844/
Java: 64bit/jdk1.8.0_172 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  org.apache.solr.update.processor.CategoryRoutedAliasUpdateProcessorTest.testSliceRouting

Error Message:
Timeout occurred while waiting response from server at: http://127.0.0.1:42593/solr/myAlias__CRA__Heart_of_Gold_shard3_replica_n16

Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Timeout occurred while waiting response from server at: http://127.0.0.1:42593/solr/myAlias__CRA__Heart_of_Gold_shard3_replica_n16
	at org.apache.solr.client.solrj.impl.CloudSolrClient.getRouteException(CloudSolrClient.java:125)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.getRouteException(CloudSolrClient.java:46)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.directUpdate(BaseCloudSolrClient.java:485)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:964)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:830)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:763)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:177)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:138)
	at org.apache.solr.update.processor.CategoryRoutedAliasUpdateProcessorTest.testSliceRouting(CategoryRoutedAliasUpdateProcessorTest.java:366)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occurred while waiting response from server at: http://127.0.0.1:42593/solr/myAlias__CRA__Heart_of_Gold_shard3_replica_n16
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:660)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368)
	at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296)
	at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.lambda$directUpdate$0(BaseCloudSolrClient.java:459)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	... 1 more
Caused by: java.net.SocketTimeoutException: Read timed out




Build Log:
[...truncated 15591 lines...]
   [junit4] Suite: org.apache.solr.update.processor.CategoryRoutedAliasUpdateProcessorTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/init-core-data-001
   [junit4]   2> 2621908 WARN  (SUITE-CategoryRoutedAliasUpdateProcessorTest-seed#[BE3A4FBDFF01A721]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=116 numCloses=116
   [junit4]   2> 2621908 INFO  (SUITE-CategoryRoutedAliasUpdateProcessorTest-seed#[BE3A4FBDFF01A721]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 2621909 INFO  (SUITE-CategoryRoutedAliasUpdateProcessorTest-seed#[BE3A4FBDFF01A721]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 2621909 INFO  (SUITE-CategoryRoutedAliasUpdateProcessorTest-seed#[BE3A4FBDFF01A721]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 2621912 INFO  (TEST-CategoryRoutedAliasUpdateProcessorTest.testMustMatch-seed#[BE3A4FBDFF01A721]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testMustMatch
   [junit4]   2> 2621912 INFO  (TEST-CategoryRoutedAliasUpdateProcessorTest.testMustMatch-seed#[BE3A4FBDFF01A721]) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001
   [junit4]   2> 2621912 INFO  (TEST-CategoryRoutedAliasUpdateProcessorTest.testMustMatch-seed#[BE3A4FBDFF01A721]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2621912 INFO  (ZkTestServer Run Thread) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2621912 INFO  (ZkTestServer Run Thread) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2622012 INFO  (TEST-CategoryRoutedAliasUpdateProcessorTest.testMustMatch-seed#[BE3A4FBDFF01A721]) [    ] o.a.s.c.ZkTestServer start zk server on port:34431
   [junit4]   2> 2622012 INFO  (TEST-CategoryRoutedAliasUpdateProcessorTest.testMustMatch-seed#[BE3A4FBDFF01A721]) [    ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:34431
   [junit4]   2> 2622012 INFO  (TEST-CategoryRoutedAliasUpdateProcessorTest.testMustMatch-seed#[BE3A4FBDFF01A721]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 34431
   [junit4]   2> 2622024 INFO  (zkConnectionManagerCallback-16553-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2622044 INFO  (zkConnectionManagerCallback-16555-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2622060 INFO  (zkConnectionManagerCallback-16557-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2622068 WARN  (jetty-launcher-16558-thread-1) [    ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 2622068 WARN  (jetty-launcher-16558-thread-2) [    ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 2622068 INFO  (jetty-launcher-16558-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 2622068 INFO  (jetty-launcher-16558-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 2622068 INFO  (jetty-launcher-16558-thread-2) [    ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_172-b11
   [junit4]   2> 2622076 WARN  (jetty-launcher-16558-thread-3) [    ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 2622076 INFO  (jetty-launcher-16558-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 2622077 INFO  (jetty-launcher-16558-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 2622077 INFO  (jetty-launcher-16558-thread-3) [    ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_172-b11
   [junit4]   2> 2622080 WARN  (jetty-launcher-16558-thread-4) [    ] o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 2622080 INFO  (jetty-launcher-16558-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 2622080 INFO  (jetty-launcher-16558-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 2622080 INFO  (jetty-launcher-16558-thread-4) [    ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_172-b11
   [junit4]   2> 2622100 INFO  (jetty-launcher-16558-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 2622100 INFO  (jetty-launcher-16558-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 2622100 INFO  (jetty-launcher-16558-thread-1) [    ] o.e.j.s.Server jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_172-b11
   [junit4]   2> 2622174 INFO  (jetty-launcher-16558-thread-3) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2622174 INFO  (jetty-launcher-16558-thread-3) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2622174 INFO  (jetty-launcher-16558-thread-3) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 2622175 INFO  (jetty-launcher-16558-thread-4) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2622175 INFO  (jetty-launcher-16558-thread-4) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2622176 INFO  (jetty-launcher-16558-thread-4) [    ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 2622180 INFO  (jetty-launcher-16558-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@33031186{/solr,null,AVAILABLE}
   [junit4]   2> 2622181 INFO  (jetty-launcher-16558-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7f810c20{/solr,null,AVAILABLE}
   [junit4]   2> 2622184 INFO  (jetty-launcher-16558-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2622184 INFO  (jetty-launcher-16558-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2622184 INFO  (jetty-launcher-16558-thread-2) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 2622186 INFO  (jetty-launcher-16558-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2622186 INFO  (jetty-launcher-16558-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2622186 INFO  (jetty-launcher-16558-thread-1) [    ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 2622186 INFO  (jetty-launcher-16558-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3091ee34{/solr,null,AVAILABLE}
   [junit4]   2> 2622188 INFO  (jetty-launcher-16558-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@18321de7{/solr,null,AVAILABLE}
   [junit4]   2> 2622188 INFO  (jetty-launcher-16558-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@289ba46b{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:41079}
   [junit4]   2> 2622188 INFO  (jetty-launcher-16558-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@63473dca{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:42671}
   [junit4]   2> 2622188 INFO  (jetty-launcher-16558-thread-3) [    ] o.e.j.s.Server Started @2622340ms
   [junit4]   2> 2622188 INFO  (jetty-launcher-16558-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42671}
   [junit4]   2> 2622188 INFO  (jetty-launcher-16558-thread-4) [    ] o.e.j.s.Server Started @2622340ms
   [junit4]   2> 2622188 INFO  (jetty-launcher-16558-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41079}
   [junit4]   2> 2622189 INFO  (jetty-launcher-16558-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@69853c7d{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:45363}
   [junit4]   2> 2622189 INFO  (jetty-launcher-16558-thread-1) [    ] o.e.j.s.Server Started @2622340ms
   [junit4]   2> 2622189 ERROR (jetty-launcher-16558-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2622189 ERROR (jetty-launcher-16558-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2622189 INFO  (jetty-launcher-16558-thread-4) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2622189 INFO  (jetty-launcher-16558-thread-3) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2622189 INFO  (jetty-launcher-16558-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45363}
   [junit4]   2> 2622189 INFO  (jetty-launcher-16558-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 9.0.0
   [junit4]   2> 2622189 INFO  (jetty-launcher-16558-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 9.0.0
   [junit4]   2> 2622189 INFO  (jetty-launcher-16558-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2622189 INFO  (jetty-launcher-16558-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2622189 ERROR (jetty-launcher-16558-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2622189 INFO  (jetty-launcher-16558-thread-1) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2622189 INFO  (jetty-launcher-16558-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2622189 INFO  (jetty-launcher-16558-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2622189 INFO  (jetty-launcher-16558-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-03-30T08:02:19.728Z
   [junit4]   2> 2622189 INFO  (jetty-launcher-16558-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-03-30T08:02:19.728Z
   [junit4]   2> 2622189 INFO  (jetty-launcher-16558-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 9.0.0
   [junit4]   2> 2622189 INFO  (jetty-launcher-16558-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2622189 INFO  (jetty-launcher-16558-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2622189 INFO  (jetty-launcher-16558-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-03-30T08:02:19.728Z
   [junit4]   2> 2622196 INFO  (jetty-launcher-16558-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@19e82c28{HTTP/1.1,[http/1.1, h2c]}{127.0.0.1:40509}
   [junit4]   2> 2622196 INFO  (jetty-launcher-16558-thread-2) [    ] o.e.j.s.Server Started @2622348ms
   [junit4]   2> 2622196 INFO  (jetty-launcher-16558-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40509}
   [junit4]   2> 2622196 ERROR (jetty-launcher-16558-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2622196 INFO  (jetty-launcher-16558-thread-2) [    ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2622196 INFO  (jetty-launcher-16558-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 9.0.0
   [junit4]   2> 2622196 INFO  (jetty-launcher-16558-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2622196 INFO  (jetty-launcher-16558-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2622196 INFO  (jetty-launcher-16558-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-03-30T08:02:19.735Z
   [junit4]   2> 2622204 INFO  (zkConnectionManagerCallback-16560-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2622204 INFO  (zkConnectionManagerCallback-16564-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2622204 INFO  (jetty-launcher-16558-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2622204 INFO  (jetty-launcher-16558-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2622208 INFO  (zkConnectionManagerCallback-16562-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2622208 INFO  (zkConnectionManagerCallback-16566-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2622208 INFO  (jetty-launcher-16558-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2622208 INFO  (jetty-launcher-16558-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2622274 INFO  (jetty-launcher-16558-thread-1) [    ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 2622300 WARN  (jetty-launcher-16558-thread-1) [    ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@65fe91ca[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2622340 WARN  (jetty-launcher-16558-thread-1) [    ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@2e5466ef[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2622341 INFO  (jetty-launcher-16558-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34431/solr
   [junit4]   2> 2622383 INFO  (zkConnectionManagerCallback-16576-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2622418 INFO  (zkConnectionManagerCallback-16578-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2622432 INFO  (jetty-launcher-16558-thread-2) [    ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 2622448 WARN  (jetty-launcher-16558-thread-2) [    ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@1c559042[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2622453 INFO  (jetty-launcher-16558-thread-3) [    ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 2622462 INFO  (jetty-launcher-16558-thread-1) [n:127.0.0.1:45363_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45363_solr
   [junit4]   2> 2622462 INFO  (jetty-launcher-16558-thread-1) [n:127.0.0.1:45363_solr    ] o.a.s.c.Overseer Overseer (id=72287462666010632-127.0.0.1:45363_solr-n_0000000000) starting
   [junit4]   2> 2622470 WARN  (jetty-launcher-16558-thread-3) [    ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@3a3d248f[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2622520 WARN  (jetty-launcher-16558-thread-2) [    ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@675d68aa[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2622521 INFO  (jetty-launcher-16558-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34431/solr
   [junit4]   2> 2622536 INFO  (zkConnectionManagerCallback-16588-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2622538 INFO  (jetty-launcher-16558-thread-1) [n:127.0.0.1:45363_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34431/solr ready
   [junit4]   2> 2622545 WARN  (jetty-launcher-16558-thread-3) [    ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@150d586[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2622546 INFO  (jetty-launcher-16558-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34431/solr
   [junit4]   2> 2622546 INFO  (jetty-launcher-16558-thread-4) [    ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 2622547 INFO  (OverseerStateUpdate-72287462666010632-127.0.0.1:45363_solr-n_0000000000) [n:127.0.0.1:45363_solr    ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:45363_solr
   [junit4]   2> 2622547 INFO  (zkConnectionManagerCallback-16593-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2622556 INFO  (jetty-launcher-16558-thread-1) [n:127.0.0.1:45363_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45363_solr
   [junit4]   2> 2622560 WARN  (jetty-launcher-16558-thread-4) [    ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@3946db9[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2622561 INFO  (zkCallback-16577-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2622566 INFO  (zkCallback-16587-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2622575 INFO  (zkConnectionManagerCallback-16601-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2622575 INFO  (jetty-launcher-16558-thread-1) [n:127.0.0.1:45363_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 2622575 INFO  (zkConnectionManagerCallback-16597-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2622577 INFO  (jetty-launcher-16558-thread-2) [n:127.0.0.1:40509_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2622579 INFO  (jetty-launcher-16558-thread-2) [n:127.0.0.1:40509_solr    ] o.a.s.c.ZkController Publish node=127.0.0.1:40509_solr as DOWN
   [junit4]   2> 2622579 INFO  (jetty-launcher-16558-thread-2) [n:127.0.0.1:40509_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2622579 INFO  (jetty-launcher-16558-thread-2) [n:127.0.0.1:40509_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40509_solr
   [junit4]   2> 2622580 INFO  (zkCallback-16587-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2622580 WARN  (jetty-launcher-16558-thread-4) [    ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for SslContextFactory@48ec723c[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2622581 INFO  (jetty-launcher-16558-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34431/solr
   [junit4]   2> 2622588 INFO  (zkCallback-16600-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2622595 INFO  (jetty-launcher-16558-thread-1) [n:127.0.0.1:45363_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45363.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7cd4a68b
   [junit4]   2> 2622600 INFO  (zkConnectionManagerCallback-16608-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2622600 INFO  (zkCallback-16577-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2622601 INFO  (jetty-launcher-16558-thread-1) [n:127.0.0.1:45363_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45363.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7cd4a68b
   [junit4]   2> 2622601 INFO  (jetty-launcher-16558-thread-1) [n:127.0.0.1:45363_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45363.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7cd4a68b
   [junit4]   2> 2622601 INFO  (jetty-launcher-16558-thread-1) [n:127.0.0.1:45363_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node1/.
   [junit4]   2> 2622660 INFO  (zkConnectionManagerCallback-16615-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2622662 INFO  (jetty-launcher-16558-thread-3) [n:127.0.0.1:42671_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2622663 INFO  (jetty-launcher-16558-thread-3) [n:127.0.0.1:42671_solr    ] o.a.s.c.ZkController Publish node=127.0.0.1:42671_solr as DOWN
   [junit4]   2> 2622663 INFO  (jetty-launcher-16558-thread-3) [n:127.0.0.1:42671_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2622663 INFO  (jetty-launcher-16558-thread-3) [n:127.0.0.1:42671_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42671_solr
   [junit4]   2> 2622664 INFO  (zkCallback-16587-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2622669 INFO  (zkCallback-16577-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2622669 INFO  (zkCallback-16600-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2622670 INFO  (zkConnectionManagerCallback-16613-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2622671 INFO  (jetty-launcher-16558-thread-2) [n:127.0.0.1:40509_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 2622672 INFO  (jetty-launcher-16558-thread-2) [n:127.0.0.1:40509_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34431/solr ready
   [junit4]   2> 2622683 INFO  (zkConnectionManagerCallback-16617-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2622686 INFO  (jetty-launcher-16558-thread-4) [n:127.0.0.1:41079_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 2622688 INFO  (jetty-launcher-16558-thread-4) [n:127.0.0.1:41079_solr    ] o.a.s.c.ZkController Publish node=127.0.0.1:41079_solr as DOWN
   [junit4]   2> 2622688 INFO  (jetty-launcher-16558-thread-4) [n:127.0.0.1:41079_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2622688 INFO  (jetty-launcher-16558-thread-4) [n:127.0.0.1:41079_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41079_solr
   [junit4]   2> 2622689 INFO  (zkCallback-16587-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2622689 INFO  (zkCallback-16577-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2622689 INFO  (zkCallback-16600-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2622704 INFO  (zkCallback-16614-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (4)
   [junit4]   2> 2622724 INFO  (zkCallback-16612-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2622735 INFO  (zkCallback-16616-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2622743 INFO  (jetty-launcher-16558-thread-2) [n:127.0.0.1:40509_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 2622759 INFO  (jetty-launcher-16558-thread-2) [n:127.0.0.1:40509_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40509.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7cd4a68b
   [junit4]   2> 2622766 INFO  (jetty-launcher-16558-thread-2) [n:127.0.0.1:40509_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40509.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7cd4a68b
   [junit4]   2> 2622766 INFO  (jetty-launcher-16558-thread-2) [n:127.0.0.1:40509_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40509.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7cd4a68b
   [junit4]   2> 2622767 INFO  (jetty-launcher-16558-thread-2) [n:127.0.0.1:40509_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node2/.
   [junit4]   2> 2622780 INFO  (zkConnectionManagerCallback-16632-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2622780 INFO  (jetty-launcher-16558-thread-4) [n:127.0.0.1:41079_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 2622781 INFO  (jetty-launcher-16558-thread-4) [n:127.0.0.1:41079_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34431/solr ready
   [junit4]   2> 2622795 INFO  (jetty-launcher-16558-thread-4) [n:127.0.0.1:41079_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 2622816 INFO  (jetty-launcher-16558-thread-4) [n:127.0.0.1:41079_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41079.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7cd4a68b
   [junit4]   2> 2622823 INFO  (jetty-launcher-16558-thread-4) [n:127.0.0.1:41079_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41079.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7cd4a68b
   [junit4]   2> 2622823 INFO  (jetty-launcher-16558-thread-4) [n:127.0.0.1:41079_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41079.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7cd4a68b
   [junit4]   2> 2622823 INFO  (zkConnectionManagerCallback-16627-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2622823 INFO  (jetty-launcher-16558-thread-4) [n:127.0.0.1:41079_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/.
   [junit4]   2> 2622824 INFO  (jetty-launcher-16558-thread-3) [n:127.0.0.1:42671_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 2622825 INFO  (jetty-launcher-16558-thread-3) [n:127.0.0.1:42671_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34431/solr ready
   [junit4]   2> 2622872 INFO  (jetty-launcher-16558-thread-3) [n:127.0.0.1:42671_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 2622884 INFO  (jetty-launcher-16558-thread-3) [n:127.0.0.1:42671_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42671.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7cd4a68b
   [junit4]   2> 2622894 INFO  (jetty-launcher-16558-thread-3) [n:127.0.0.1:42671_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42671.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7cd4a68b
   [junit4]   2> 2622894 INFO  (jetty-launcher-16558-thread-3) [n:127.0.0.1:42671_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42671.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7cd4a68b
   [junit4]   2> 2622894 INFO  (jetty-launcher-16558-thread-3) [n:127.0.0.1:42671_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node3/.
   [junit4]   2> 2622960 INFO  (zkConnectionManagerCallback-16639-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2622960 INFO  (TEST-CategoryRoutedAliasUpdateProcessorTest.testMustMatch-seed#[BE3A4FBDFF01A721]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 2622961 INFO  (TEST-CategoryRoutedAliasUpdateProcessorTest.testMustMatch-seed#[BE3A4FBDFF01A721]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34431/solr ready
   [junit4]   2> 2622972 INFO  (qtp973678361-45996) [n:127.0.0.1:42671_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2622972 INFO  (qtp973678361-45996) [n:127.0.0.1:42671_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2622973 INFO  (TEST-CategoryRoutedAliasUpdateProcessorTest.testMustMatch-seed#[BE3A4FBDFF01A721]) [    ] o.a.s.u.p.CategoryRoutedAliasUpdateProcessorTest SolrClient: org.apache.solr.client.solrj.impl.CloudSolrClient@34fbd2bc
   [junit4]   2> 2622973 INFO  (TEST-CategoryRoutedAliasUpdateProcessorTest.testMustMatch-seed#[BE3A4FBDFF01A721]) [    ] o.a.s.u.p.CategoryRoutedAliasUpdateProcessorTest ClusterStateProvider org.apache.solr.client.solrj.impl.HttpClusterStateProvider@674c6a91
   [junit4]   2> 2622974 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2622975 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2622975 INFO  (qtp718257367-45998) [n:127.0.0.1:41079_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2622976 INFO  (qtp718257367-45998) [n:127.0.0.1:41079_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2622976 INFO  (qtp718257367-45992) [n:127.0.0.1:41079_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2622976 INFO  (qtp718257367-45992) [n:127.0.0.1:41079_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2622976 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2622977 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2622978 INFO  (qtp718257367-45992) [n:127.0.0.1:41079_solr    ] o.a.s.h.a.ConfigSetsHandler Invoked ConfigSet Action :create with params baseConfigSet=_default&name=testMustMatch&action=CREATE&wt=javabin&version=2 
   [junit4]   2> 2622980 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.OverseerConfigSetMessageHandler OverseerConfigSetMessageHandler.processMessage : create , {
   [junit4]   2>   "name":"testMustMatch",
   [junit4]   2>   "baseConfigSet":"_default",
   [junit4]   2>   "immutable":"false",
   [junit4]   2>   "operation":"configsets:create"}
   [junit4]   2> 2622981 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/protwords.txt to /configs/testMustMatch/protwords.txt
   [junit4]   2> 2622982 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/managed-schema to /configs/testMustMatch/managed-schema
   [junit4]   2> 2622983 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/solrconfig.xml to /configs/testMustMatch/solrconfig.xml
   [junit4]   2> 2622984 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/synonyms.txt to /configs/testMustMatch/synonyms.txt
   [junit4]   2> 2622985 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/stopwords.txt to /configs/testMustMatch/stopwords.txt
   [junit4]   2> 2622986 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_it.txt to /configs/testMustMatch/lang/contractions_it.txt
   [junit4]   2> 2622986 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stemdict_nl.txt to /configs/testMustMatch/lang/stemdict_nl.txt
   [junit4]   2> 2622987 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hy.txt to /configs/testMustMatch/lang/stopwords_hy.txt
   [junit4]   2> 2622996 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_no.txt to /configs/testMustMatch/lang/stopwords_no.txt
   [junit4]   2> 2622997 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ca.txt to /configs/testMustMatch/lang/contractions_ca.txt
   [junit4]   2> 2622997 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_id.txt to /configs/testMustMatch/lang/stopwords_id.txt
   [junit4]   2> 2622998 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ga.txt to /configs/testMustMatch/lang/stopwords_ga.txt
   [junit4]   2> 2622999 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hi.txt to /configs/testMustMatch/lang/stopwords_hi.txt
   [junit4]   2> 2623000 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_da.txt to /configs/testMustMatch/lang/stopwords_da.txt
   [junit4]   2> 2623001 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ja.txt to /configs/testMustMatch/lang/stopwords_ja.txt
   [junit4]   2> 2623002 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_pt.txt to /configs/testMustMatch/lang/stopwords_pt.txt
   [junit4]   2> 2623003 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hu.txt to /configs/testMustMatch/lang/stopwords_hu.txt
   [junit4]   2> 2623003 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_el.txt to /configs/testMustMatch/lang/stopwords_el.txt
   [junit4]   2> 2623004 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ru.txt to /configs/testMustMatch/lang/stopwords_ru.txt
   [junit4]   2> 2623005 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_tr.txt to /configs/testMustMatch/lang/stopwords_tr.txt
   [junit4]   2> 2623006 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ar.txt to /configs/testMustMatch/lang/stopwords_ar.txt
   [junit4]   2> 2623007 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/userdict_ja.txt to /configs/testMustMatch/lang/userdict_ja.txt
   [junit4]   2> 2623008 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_eu.txt to /configs/testMustMatch/lang/stopwords_eu.txt
   [junit4]   2> 2623008 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_it.txt to /configs/testMustMatch/lang/stopwords_it.txt
   [junit4]   2> 2623009 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_cz.txt to /configs/testMustMatch/lang/stopwords_cz.txt
   [junit4]   2> 2623010 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stoptags_ja.txt to /configs/testMustMatch/lang/stoptags_ja.txt
   [junit4]   2> 2623011 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_fr.txt to /configs/testMustMatch/lang/contractions_fr.txt
   [junit4]   2> 2623012 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_de.txt to /configs/testMustMatch/lang/stopwords_de.txt
   [junit4]   2> 2623012 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fa.txt to /configs/testMustMatch/lang/stopwords_fa.txt
   [junit4]   2> 2623013 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ga.txt to /configs/testMustMatch/lang/contractions_ga.txt
   [junit4]   2> 2623014 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ca.txt to /configs/testMustMatch/lang/stopwords_ca.txt
   [junit4]   2> 2623014 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_nl.txt to /configs/testMustMatch/lang/stopwords_nl.txt
   [junit4]   2> 2623015 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_bg.txt to /configs/testMustMatch/lang/stopwords_bg.txt
   [junit4]   2> 2623016 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_lv.txt to /configs/testMustMatch/lang/stopwords_lv.txt
   [junit4]   2> 2623017 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_en.txt to /configs/testMustMatch/lang/stopwords_en.txt
   [junit4]   2> 2623017 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_es.txt to /configs/testMustMatch/lang/stopwords_es.txt
   [junit4]   2> 2623018 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_th.txt to /configs/testMustMatch/lang/stopwords_th.txt
   [junit4]   2> 2623019 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ro.txt to /configs/testMustMatch/lang/stopwords_ro.txt
   [junit4]   2> 2623020 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fr.txt to /configs/testMustMatch/lang/stopwords_fr.txt
   [junit4]   2> 2623020 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_sv.txt to /configs/testMustMatch/lang/stopwords_sv.txt
   [junit4]   2> 2623021 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fi.txt to /configs/testMustMatch/lang/stopwords_fi.txt
   [junit4]   2> 2623022 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/hyphenations_ga.txt to /configs/testMustMatch/lang/hyphenations_ga.txt
   [junit4]   2> 2623023 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_gl.txt to /configs/testMustMatch/lang/stopwords_gl.txt
   [junit4]   2> 2623023 INFO  (OverseerThreadFactory-15666-thread-1-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/params.json to /configs/testMustMatch/params.json
   [junit4]   2> 2623025 INFO  (qtp718257367-45992) [n:127.0.0.1:41079_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/configs params={baseConfigSet=_default&name=testMustMatch&action=CREATE&wt=javabin&version=2} status=0 QTime=47
   [junit4]   2> 2623025 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2623026 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2623026 INFO  (qtp718257367-45998) [n:127.0.0.1:41079_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2623027 INFO  (qtp718257367-45998) [n:127.0.0.1:41079_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2623027 INFO  (qtp718257367-45992) [n:127.0.0.1:41079_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2623027 INFO  (qtp718257367-45992) [n:127.0.0.1:41079_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2623027 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2623028 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2623028 INFO  (qtp718257367-45998) [n:127.0.0.1:41079_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params collection.configName=testMustMatch&name=testMustMatch&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2623032 INFO  (OverseerThreadFactory-15666-thread-2-processing-n:127.0.0.1:45363_solr) [n:127.0.0.1:45363_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection testMustMatch
   [junit4]   2> 2623032 INFO  (OverseerCollectionConfigSetProcessor-72287462666010632-127.0.0.1:45363_solr-n_0000000000) [n:127.0.0.1:45363_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 2623135 INFO  (OverseerStateUpdate-72287462666010632-127.0.0.1:45363_solr-n_0000000000) [n:127.0.0.1:45363_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testMustMatch",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testMustMatch_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:41079/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2623338 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr    x:testMustMatch_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=testMustMatch&newCollection=true&name=testMustMatch_shard1_replica_n1&action=CREATE&numShards=1&collection=testMustMatch&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2624347 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.RequestParams conf resource params.json loaded . version : 0 
   [junit4]   2> 2624347 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.RequestParams request params refreshed to version 0
   [junit4]   2> 2624347 WARN  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../contrib/extraction/lib
   [junit4]   2> 2624347 WARN  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../dist
   [junit4]   2> 2624348 WARN  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../contrib/clustering/lib
   [junit4]   2> 2624348 WARN  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../dist
   [junit4]   2> 2624348 WARN  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../contrib/langid/lib
   [junit4]   2> 2624348 WARN  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../dist
   [junit4]   2> 2624348 WARN  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../contrib/velocity/lib
   [junit4]   2> 2624348 WARN  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../dist
   [junit4]   2> 2624348 WARN  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../dist filtered by solr-ltr-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../dist
   [junit4]   2> 2624356 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
   [junit4]   2> 2624398 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.s.IndexSchema [testMustMatch_shard1_replica_n1] Schema name=default-config
   [junit4]   2> 2624595 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema default-config/1.6 with uniqueid field id
   [junit4]   2> 2624611 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testMustMatch_shard1_replica_n1' using configuration from collection testMustMatch, trusted=true
   [junit4]   2> 2624611 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41079.solr.core.testMustMatch.shard1.replica_n1' (registry 'solr.core.testMustMatch.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7cd4a68b
   [junit4]   2> 2624611 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.SolrCore [[testMustMatch_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/./testMustMatch_shard1_replica_n1/data/]
   [junit4]   2> 2624613 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.r.XSLTResponseWriter xsltCacheLifetimeSeconds=5
   [junit4]   2> 2624654 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2624654 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2624670 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommitted for 15000ms; 
   [junit4]   2> 2624670 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2624671 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1976ee71[testMustMatch_shard1_replica_n1] main]
   [junit4]   2> 2624671 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/testMustMatch
   [junit4]   2> 2624671 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/testMustMatch
   [junit4]   2> 2624671 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/testMustMatch/managed-schema
   [junit4]   2> 2624672 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 2624672 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 2624672 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.s.DirectSolrSpellChecker init: {name=default,field=_text_,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
   [junit4]   2> 2624673 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2624673 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1629416788812890112
   [junit4]   2> 2624675 INFO  (searcherExecutor-15683-thread-1-processing-n:127.0.0.1:41079_solr x:testMustMatch_shard1_replica_n1 c:testMustMatch s:shard1 r:core_node2) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.QuerySenderListener QuerySenderListener sending requests to Searcher@1976ee71[testMustMatch_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2624675 INFO  (searcherExecutor-15683-thread-1-processing-n:127.0.0.1:41079_solr x:testMustMatch_shard1_replica_n1 c:testMustMatch s:shard1 r:core_node2) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.QuerySenderListener QuerySenderListener done.
   [junit4]   2> 2624675 INFO  (searcherExecutor-15683-thread-1-processing-n:127.0.0.1:41079_solr x:testMustMatch_shard1_replica_n1 c:testMustMatch s:shard1 r:core_node2) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 2624676 INFO  (searcherExecutor-15683-thread-1-processing-n:127.0.0.1:41079_solr x:testMustMatch_shard1_replica_n1 c:testMustMatch s:shard1 r:core_node2) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.SolrCore [testMustMatch_shard1_replica_n1] Registered new searcher Searcher@1976ee71[testMustMatch_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2624677 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.ZkShardTerms Successful update of terms at /collections/testMustMatch/terms/shard1 to Terms{values={core_node2=0}, version=0}
   [junit4]   2> 2624677 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContextBase make sure parent is created /collections/testMustMatch/leaders/shard1
   [junit4]   2> 2624679 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2624679 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 2624679 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:41079/solr/testMustMatch_shard1_replica_n1/
   [junit4]   2> 2624679 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 2624679 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:41079/solr/testMustMatch_shard1_replica_n1/ has no replicas
   [junit4]   2> 2624679 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/testMustMatch/leaders/shard1/leader after winning as /collections/testMustMatch/leader_elect/shard1/election/72287462666010640-core_node2-n_0000000000
   [junit4]   2> 2624680 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:41079/solr/testMustMatch_shard1_replica_n1/ shard1
   [junit4]   2> 2624781 INFO  (zkCallback-16616-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testMustMatch/state.json] for collection [testMustMatch] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2624781 INFO  (zkCallback-16616-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testMustMatch/state.json] for collection [testMustMatch] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2624782 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 2624849 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=testMustMatch&newCollection=true&name=testMustMatch_shard1_replica_n1&action=CREATE&numShards=1&collection=testMustMatch&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1511
   [junit4]   2> 2624851 INFO  (qtp718257367-45998) [n:127.0.0.1:41079_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 45 seconds. Check all shard replicas
   [junit4]   2> 2624883 INFO  (zkCallback-16616-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testMustMatch/state.json] for collection [testMustMatch] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2624883 INFO  (zkCallback-16616-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testMustMatch/state.json] for collection [testMustMatch] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2624883 INFO  (qtp718257367-45998) [n:127.0.0.1:41079_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=testMustMatch&name=testMustMatch&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=1855
   [junit4]   2> 2624893 INFO  (zkCallback-16616-thread-3) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testMustMatch/state.json] for collection [testMustMatch] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2624900 INFO  (qtp718257367-45992) [n:127.0.0.1:41079_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=CLUSTERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2624902 INFO  (qtp718257367-45992) [n:127.0.0.1:41079_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=CLUSTERSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 2624937 INFO  (qtp718257367-45998) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.h.SolrConfigHandler Executed config commands successfully and persisted to ZK [{"set-user-property":{"update.autoCreateFields":false}}, {"add-updateprocessor":{
   [junit4]   2>     "name":"tolerant",
   [junit4]   2>     "class":"solr.TolerantUpdateProcessorFactory"}}, {"add-updateprocessor":{
   [junit4]   2>     "name":"tracking-testSliceRouting",
   [junit4]   2>     "class":"solr.TrackingUpdateProcessorFactory",
   [junit4]   2>     "group":"testMustMatch"}}, {"add-updateprocessor":{
   [junit4]   2>     "name":"inc",
   [junit4]   2>     "class":"org.apache.solr.update.processor.RoutedAliasUpdateProcessorTest$IncrementURPFactory",
   [junit4]   2>     "fieldName":"integer_i"}}]
   [junit4]   2> 2624937 INFO  (qtp718257367-45998) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.h.SolrConfigHandler Waiting up to 30 secs for 1 replicas to set the property overlay to be of version 0 for collection testMustMatch
   [junit4]   2> 2624940 INFO  (Thread-7613) [    ] o.a.s.c.SolrCore config update listener called for core testMustMatch_shard1_replica_n1
   [junit4]   2> 2624940 INFO  (Thread-7613) [    ] o.a.s.c.SolrCore core reload testMustMatch_shard1_replica_n1
   [junit4]   2> 2624948 INFO  (Thread-7613) [    ] o.a.s.c.RequestParams conf resource params.json loaded . version : 0 
   [junit4]   2> 2624948 INFO  (Thread-7613) [    ] o.a.s.c.RequestParams request params refreshed to version 0
   [junit4]   2> 2624948 WARN  (Thread-7613) [    ] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../contrib/extraction/lib
   [junit4]   2> 2624949 WARN  (Thread-7613) [    ] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../dist
   [junit4]   2> 2624949 WARN  (Thread-7613) [    ] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../contrib/clustering/lib
   [junit4]   2> 2624949 WARN  (Thread-7613) [    ] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../dist
   [junit4]   2> 2624949 WARN  (Thread-7613) [    ] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../contrib/langid/lib
   [junit4]   2> 2624949 WARN  (Thread-7613) [    ] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../dist
   [junit4]   2> 2624949 WARN  (Thread-7613) [    ] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../contrib/velocity/lib
   [junit4]   2> 2624949 WARN  (Thread-7613) [    ] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../dist
   [junit4]   2> 2624949 WARN  (Thread-7613) [    ] o.a.s.c.SolrConfig Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../dist filtered by solr-ltr-\d.*\.jar to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1/../../../../dist
   [junit4]   2> 2624958 INFO  (Thread-7613) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0
   [junit4]   2> 2624968 INFO  (solrHandlerExecutor-15688-thread-1-processing-n:127.0.0.1:41079_solr x:testMustMatch_shard1_replica_n1 c:testMustMatch s:shard1 r:core_node2) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.h.SolrConfigHandler Time elapsed : 0 secs, maxWait 30
   [junit4]   2> 2624989 INFO  (Thread-7613) [    ] o.a.s.s.IndexSchema [testMustMatch_shard1_replica_n1] Schema name=default-config
   [junit4]   2> 2625055 INFO  (OverseerCollectionConfigSetProcessor-72287462666010632-127.0.0.1:45363_solr-n_0000000000) [n:127.0.0.1:45363_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 2625069 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.h.SolrConfigHandler expecting overlay version 0 but my version is -1
   [junit4]   2> 2625069 INFO  (qtp718257367-45994) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.S.Request [testMustMatch_shard1_replica_n1]  webapp=/solr path=/config/znodeVersion params={overlay=0&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2625069 INFO  (SolrConfigHandler-refreshconf) [    ] o.a.s.h.SolrConfigHandler Another reload is in progress . Not doing anything
   [junit4]   2> 2625069 INFO  (solrHandlerExecutor-15688-thread-1-processing-n:127.0.0.1:41079_solr x:testMustMatch_shard1_replica_n1 c:testMustMatch s:shard1 r:core_node2) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.h.SolrConfigHandler Could not get expectedVersion 0 from http://127.0.0.1:41079/solr/testMustMatch_shard1_replica_n1/ for prop overlay   after 1 attempts
   [junit4]   2> 2625069 INFO  (solrHandlerExecutor-15688-thread-1-processing-n:127.0.0.1:41079_solr x:testMustMatch_shard1_replica_n1 c:testMustMatch s:shard1 r:core_node2) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.h.SolrConfigHandler Time elapsed : 0 secs, maxWait 30
   [junit4]   2> 2625172 INFO  (qtp718257367-45992) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.h.SolrConfigHandler expecting overlay version 0 but my version is -1
   [junit4]   2> 2625175 INFO  (qtp718257367-45992) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.S.Request [testMustMatch_shard1_replica_n1]  webapp=/solr path=/config/znodeVersion params={overlay=0&wt=javabin&version=2} status=0 QTime=3
   [junit4]   2> 2625176 INFO  (SolrConfigHandler-refreshconf) [    ] o.a.s.h.SolrConfigHandler Another reload is in progress . Not doing anything
   [junit4]   2> 2625184 INFO  (solrHandlerExecutor-15688-thread-1-processing-n:127.0.0.1:41079_solr x:testMustMatch_shard1_replica_n1 c:testMustMatch s:shard1 r:core_node2) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.h.SolrConfigHandler Could not get expectedVersion 0 from http://127.0.0.1:41079/solr/testMustMatch_shard1_replica_n1/ for prop overlay   after 2 attempts
   [junit4]   2> 2625184 INFO  (solrHandlerExecutor-15688-thread-1-processing-n:127.0.0.1:41079_solr x:testMustMatch_shard1_replica_n1 c:testMustMatch s:shard1 r:core_node2) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.h.SolrConfigHandler Time elapsed : 0 secs, maxWait 30
   [junit4]   2> 2625203 INFO  (Thread-7613) [    ] o.a.s.s.IndexSchema Loaded schema default-config/1.6 with uniqueid field id
   [junit4]   2> 2625223 INFO  (Thread-7613) [    ] o.a.s.c.CoreContainer Reloading SolrCore 'testMustMatch_shard1_replica_n1' using configuration from collection testMustMatch
   [junit4]   2> 2625243 INFO  (Thread-7613) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41079.solr.core.testMustMatch.shard1.replica_n1' (registry 'solr.core.testMustMatch.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7cd4a68b
   [junit4]   2> 2625243 INFO  (Thread-7613) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.c.SolrCore [[testMustMatch_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/testMustMatch_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001/tempDir-001/node4/./testMustMatch_shard1_replica_n1/data/]
   [junit4]   2> 2625244 INFO  (Thread-7613) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.r.XSLTResponseWriter xsltCacheLifetimeSeconds=5
   [junit4]   2> 2625280 INFO  (Thread-7613) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommitted for 15000ms; 
   [junit4]   2> 2625280 INFO  (Thread-7613) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2625282 INFO  (Thread-7613) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@ab2bb0[testMustMatch_shard1_replica_n1] main]
   [junit4]   2> 2625282 INFO  (Thread-7613) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/testMustMatch
   [junit4]   2> 2625282 INFO  (Thread-7613) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/testMustMatch
   [junit4]   2> 2625282 INFO  (Thread-7613) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/testMustMatch/managed-schema
   [junit4]   2> 2625283 INFO  (Thread-7613) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 2625283 INFO  (Thread-7613) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 2625283 INFO  (Thread-7613) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.s.DirectSolrSpellChecker init: {name=default,field=_text_,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
   [junit4]   2> 2625283 INFO  (Thread-7613) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2625283 INFO  (Thread-7613) [n:127.0.0.1:41079_solr c:testMustMatch s:shard1 r:core_node2 x:testMustMatch_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1629416789452521472
   [junit4]   2> 2625284 

[...truncated too long message...]

4FBDFF01A721]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testInvalidMustMatch
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.update.processor.CategoryRoutedAliasUpdateProcessorTest_BE3A4FBDFF01A721-001
   [junit4]   2> Mar 30, 2019 8:11:14 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=21317, maxDocsPerChunk=224, blockSize=959), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=21317, blockSize=959)), sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@1280791c), locale=ca-ES, timezone=Europe/Andorra
   [junit4]   2> NOTE: Linux 4.18.0-15-generic amd64/Oracle Corporation 1.8.0_172 (64-bit)/cpus=8,threads=1,free=253274056,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [TestReqParamsAPI, TestPhraseSuggestions, MBeansHandlerTest, HDFSCollectionsAPITest, MergeStrategyTest, RankQueryTest, TestCloudPseudoReturnFields, ZkNodePropsTest, XmlUpdateRequestHandlerTest, ZkCLITest, CleanupOldIndexTest, TestBulkSchemaAPI, TestJmxIntegration, TestManagedSynonymFilterFactory, DateMathParserTest, MoveReplicaHDFSFailoverTest, HealthCheckHandlerTest, TestRuleBasedAuthorizationPlugin, DataDrivenBlockJoinTest, TestMaxTokenLenTokenizer, SolrCLIZkUtilsTest, TestDistributedMissingSort, BasicAuthStandaloneTest, HdfsUnloadDistributedZkTest, RAMDirectoryFactoryTest, TestGroupingSearch, TestBackupRepositoryFactory, CurrencyRangeFacetCloudTest, TestEmbeddedSolrServerAdminHandler, TestCloudInspectUtil, TestNRTOpen, TestStandardQParsers, NumberUtilsTest, DeleteReplicaTest, SplitShardTest, CoreSorterTest, TestTestInjection, TestSimDistribStateManager, TestStressReorder, TestNumericRangeQuery64, FieldMutatingUpdateProcessorTest, TestSolrConfigHandler, TestJsonFacetsStatsParsing, DistributedDebugComponentTest, ByteBuffersDirectoryFactoryTest, SearchRateTriggerTest, TestStressInPlaceUpdates, UUIDUpdateProcessorFallbackTest, SolrMetricManagerTest, BigEndianAscendingWordDeserializerTest, SolrJmxReporterTest, HLLUtilTest, PolyFieldTest, TestNoOpRegenerator, TermsComponentTest, CollectionsAPIAsyncDistributedZkTest, HdfsChaosMonkeyNothingIsSafeTest, TestSolrIndexConfig, QueryElevationComponentTest, BadIndexSchemaTest, TestAnalyzedSuggestions, SynonymTokenizerTest, CustomCollectionTest, RemoteQueryErrorTest, CdcrRequestHandlerTest, TestHttpShardHandlerFactory, TestIndexingPerformance, TestExactStatsCache, SimpleCollectionCreateDeleteTest, TestFoldingMultitermQuery, TestPerFieldSimilarityWithDefaultOverride, TestApiFramework, DefaultValueUpdateProcessorTest, MetricTriggerIntegrationTest, TestDynamicFieldResource, TriLevelCompositeIdRoutingTest, FacetPivotSmallTest, TestFaceting, TestRawResponseWriter, TestDocBasedVersionConstraints, SuggestComponentTest, TestLegacyField, BufferStoreTest, AlternateDirectoryTest, TestManagedResource, MetricsHistoryIntegrationTest, TestReplicationHandler, TestComponentsName, TestSSLRandomization, TestCrossCoreJoin, CursorPagingTest, TestIndexSearcher, OverseerModifyCollectionTest, TestSimExtremeIndexing, EchoParamsTest, TestCollapseQParserPlugin, TestRequestStatusCollectionAPI, TestTolerantUpdateProcessorCloud, TestConfigSetsAPIExclusivity, TestHdfsCloudBackupRestore, TestAtomicUpdateErrorCases, DistributedQueryComponentCustomSortTest, BinaryUpdateRequestHandlerTest, DistribCursorPagingTest, SSLMigrationTest, TestFieldCacheVsDocValues, ConnectionManagerTest, PathHierarchyTokenizerFactoryTest, CopyFieldTest, ScheduledTriggerIntegrationTest, TestRandomDVFaceting, TestDeprecatedFilters, AssignTest, TestFieldTypeCollectionResource, TestQueryUtils, TestFunctionQuery, TestStreamBody, AsyncCallRequestStatusResponseTest, TestSimTriggerIntegration, TestLRUCache, HighlighterConfigTest, TestCustomDocTransformer, TestSolrCoreProperties, SpellCheckComponentTest, PKIAuthenticationIntegrationTest, TestSystemCollAutoCreate, TestSchemaResource, RecoveryAfterSoftCommitTest, ChaosMonkeySafeLeaderTest, TestPostingsSolrHighlighter, TestManagedSchemaAPI, TestClusterStateMutator, TestSurroundQueryParser, TestFieldSortValues, NodeAddedTriggerTest, TestSolrQueryResponse, DateRangeFieldTest, BasicZkTest, AutoscalingHistoryHandlerTest, JvmMetricsTest, AnalysisAfterCoreReloadTest, BasicFunctionalityTest, ConvertedLegacyTest, SampleTest, SolrInfoBeanTest, SolrTestCaseJ4Test, TestWordDelimiterFilterFactory, TokenizerChainTest, TestLuceneIndexBackCompat, TestJettySolrRunner, ConnectionReuseTest, ActionThrottleTest, AddReplicaTest, AliasIntegrationTest, AssignBackwardCompatibilityTest, ClusterStateUpdateTest, CollectionPropsTest, CollectionStateFormat2Test, CollectionsAPISolrJTest, ConcurrentCreateRoutedAliasTest, ConfigSetsAPITest, DeleteInactiveReplicaTest, DeleteLastCustomShardedReplicaTest, DeleteNodeTest, DistributedQueueTest, DistributedVersionInfoTest, ForceLeaderTest, ForceLeaderWithTlogReplicasTest, FullSolrCloudDistribCmdsTest, HttpPartitionWithTlogReplicasTest, LeaderFailoverAfterPartitionTest, LeaderTragicEventTest, LeaderVoteWaitTimeoutTest, PeerSyncReplicationTest, RestartWhileUpdatingTest, RollingRestartTest, TestCloudSearcherWarming, TestLeaderElectionZkExpiry, TestOnReconnectListenerSupport, TestPullReplica, TestPullReplicaErrorHandling, TestRebalanceLeaders, TestSolrCloudWithDelegationTokens, TestSolrCloudWithKerberosAlt, TestWithCollection, NodeMarkersRegistrationTest, ScheduledMaintenanceTriggerTest, TriggerSetPropertiesIntegrationTest, TestSimComputePlanAction, TestSimNodeAddedTrigger, TestSimNodeLostTrigger, TestSimPolicyCloud, CdcrBootstrapTest, HdfsDirectoryFactoryTest, SOLR749Test, SolrCoreTest, TestCoreDiscovery, TestDynamicLoading, RequestLoggingTest, ResponseBuilderTest, SearchHandlerTest, TestBlobHandler, TestSQLHandlerNonCloud, TestSolrConfigHandlerCloud, DebugComponentTest, DistributedFacetPivotLargeTest, DistributedFacetPivotWhiteBoxTest, DistributedSpellCheckComponentTest, ShardsWhitelistTest, UninvertDocValuesMergePolicyTest, TestLegacyTerms, TestMultiValuedNumericRangeQuery, TestNumericRangeQuery32, SolrGraphiteReporterTest, SolrShardReporterTest, SubstringBytesRefFilterTest, TestFacetMethods, TestMacroExpander, JSONWriterTest, TestBinaryResponseWriter, TestPHPSerializedResponseWriter, TestSubQueryTransformerDistrib, ManagedSchemaRoundRobinCloudTest, SpatialRPTFieldTypeTest, TestCollationField, TestCollationFieldDocValues, TestHalfAndHalfDocValues, TestPointFields, TestUseDocValuesAsStored2, UUIDFieldTest, AnalyticsMergeStrategyTest, SortSpecParsingTest, TestAddFieldRealTimeGet, TestExtendedDismaxParser, TestMissingGroups, TestPayloadScoreQParserPlugin, TestQueryTypes, TestReRankQParserPlugin, TestRealTimeGet, TestRecovery, TestReload, TestReloadDeadlock, TestSearchPerf, TestSearcherReuse, TestSimpleQParserPlugin, TestSmileRequest, TestSolr4Spatial, TestSolr4Spatial2, TestSolrCoreParser, TestSolrFieldCacheBean, TestSolrJ, TestSolrQueryParser, TestSort, RangeFacetCloudTest, TestCloudJSONFacetSKG, CloudMLTQParserTest, TestExactSharedStatsCache, TestZkAclsWithHadoopAuth, CacheHeaderTest, NoCacheHeaderTest, ResponseHeaderTest, SolrRequestParserTest, DirectSolrSpellCheckerTest, IndexBasedSpellCheckerTest, SpellCheckCollatorWithCollapseTest, SpellPossibilityIteratorTest, TestSuggestSpellingConverter, SuggesterFSTTest, SuggesterTSTTest, SuggesterWFSTTest, TestFreeTextSuggestions, TestHighFrequencyDictionaryFactory, TestDocTermOrdsUninvertLimit, TestFieldCache, TestNumericTerms64, PeerSyncWithLeaderAndIndexFingerprintCachingTest, PeerSyncWithLeaderTest, SolrIndexMetricsTest, TestInPlaceUpdatesDistrib, TransactionLogTest, UpdateLogTest, UpdateParamsTest, VersionInfoTest, AddSchemaFieldsUpdateProcessorFactoryTest, AtomicUpdateProcessorFactoryTest, AtomicUpdatesTest, CategoryRoutedAliasUpdateProcessorTest]
   [junit4] Completed [846/846 (1!)] on J0 in 535.28s, 6 tests, 1 error <<< FAILURES!

[...truncated 1 lines...]
   [junit4] JVM J0: stdout was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J0-20190330_071837_2711411839299382853770.sysout
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: Java heap space
   [junit4] Dumping heap to /home/jenkins/workspace/Lucene-Solr-master-Linux/heapdumps/java_pid28685.hprof ...
   [junit4] Heap dump file created [594324583 bytes in 22.168 secs]
   [junit4] <<< JVM J0: EOF ----

[...truncated 8965 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:633: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:585: Some of the tests produced a heap dump, but did not fail. Maybe a suppressed OutOfMemoryError? Dumps created:
* java_pid28685.hprof

Total time: 113 minutes 8 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2