You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2017/10/25 01:26:10 UTC

[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk1.8.0_144) - Build # 662 - Unstable!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/662/
Java: 64bit/jdk1.8.0_144 -XX:+UseCompressedOops -XX:+UseParallelGC

2 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.response.transform.TestSubQueryTransformerDistrib

Error Message:
Error from server at https://127.0.0.1:46357/solr: create the collection time out:180s

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:46357/solr: create the collection time out:180s
	at __randomizedtesting.SeedInfo.seed([D7CA8611EAB239F5]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:626)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:867)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
	at org.apache.solr.response.transform.TestSubQueryTransformerDistrib.setupCluster(TestSubQueryTransformerDistrib.java:74)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:874)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.ShardSplitTest.test

Error Message:
SPLITSHARD was not successful even after three tries

Stack Trace:
java.lang.AssertionError: SPLITSHARD was not successful even after three tries
	at __randomizedtesting.SeedInfo.seed([D7CA8611EAB239F5:5F9EB9CB444E540D]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.ShardSplitTest.splitByRouteFieldTest(ShardSplitTest.java:731)
	at org.apache.solr.cloud.ShardSplitTest.test(ShardSplitTest.java:101)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12380 lines...]
   [junit4] Suite: org.apache.solr.cloud.ShardSplitTest
   [junit4]   2> 284615 INFO  (SUITE-ShardSplitTest-seed#[D7CA8611EAB239F5]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/init-core-data-001
   [junit4]   2> 284615 WARN  (SUITE-ShardSplitTest-seed#[D7CA8611EAB239F5]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=18 numCloses=18
   [junit4]   2> 284615 INFO  (SUITE-ShardSplitTest-seed#[D7CA8611EAB239F5]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 284616 INFO  (SUITE-ShardSplitTest-seed#[D7CA8611EAB239F5]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 284616 INFO  (SUITE-ShardSplitTest-seed#[D7CA8611EAB239F5]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 284618 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 284618 INFO  (Thread-1748) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 284618 INFO  (Thread-1748) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 284619 ERROR (Thread-1748) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 284718 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.ZkTestServer start zk server on port:41713
   [junit4]   2> 284735 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 284736 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 284737 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 284738 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 284739 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 284740 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 284741 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 284742 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 284743 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 284743 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 284744 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 284745 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
   [junit4]   2> 284879 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 284879 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2a0d30f3{/,null,AVAILABLE}
   [junit4]   2> 284880 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@a8c539e{HTTP/1.1,[http/1.1]}{127.0.0.1:43991}
   [junit4]   2> 284880 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.e.j.s.Server Started @286347ms
   [junit4]   2> 284880 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/tempDir-001/control/data, hostContext=/, hostPort=43991, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/control-001/cores}
   [junit4]   2> 284881 ERROR (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 284881 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 284881 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 284881 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 284881 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T00:20:21.262Z
   [junit4]   2> 284889 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 284889 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/control-001/solr.xml
   [junit4]   2> 284891 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 284892 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 284898 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@3f3adcfc, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 284903 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41713/solr
   [junit4]   2> 284938 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:43991_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 284939 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:43991_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:43991_
   [junit4]   2> 284939 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:43991_    ] o.a.s.c.Overseer Overseer (id=98886668845056004-127.0.0.1:43991_-n_0000000000) starting
   [junit4]   2> 284941 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:43991_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43991_
   [junit4]   2> 284942 INFO  (OverseerStateUpdate-98886668845056004-127.0.0.1:43991_-n_0000000000) [n:127.0.0.1:43991_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 284993 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:43991_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f3adcfc
   [junit4]   2> 284998 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:43991_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f3adcfc
   [junit4]   2> 284998 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:43991_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f3adcfc
   [junit4]   2> 284999 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:43991_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/control-001/cores
   [junit4]   2> 285010 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 285011 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41713/solr ready
   [junit4]   2> 285012 INFO  (qtp222433645-3040) [n:127.0.0.1:43991_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:43991_&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 285013 INFO  (OverseerThreadFactory-896-thread-1-processing-n:127.0.0.1:43991_) [n:127.0.0.1:43991_    ] o.a.s.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 285118 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 285118 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 285221 INFO  (zkCallback-287-thread-1-processing-n:127.0.0.1:43991_) [n:127.0.0.1:43991_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 286138 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 286157 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 286216 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 286224 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 286225 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f3adcfc
   [junit4]   2> 286229 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 286229 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 286232 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=34, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7709082486956434]
   [junit4]   2> 286252 WARN  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 286274 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 286275 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 286275 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 286275 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 286276 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=20, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6711264657383196]
   [junit4]   2> 286276 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@416a95cb[control_collection_shard1_replica_n1] main]
   [junit4]   2> 286278 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 286278 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 286278 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 286279 INFO  (searcherExecutor-899-thread-1-processing-n:127.0.0.1:43991_ x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@416a95cb[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 286279 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582186703261532160
   [junit4]   2> 286282 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 286282 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 286282 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:43991/control_collection_shard1_replica_n1/
   [junit4]   2> 286282 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 286282 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:43991/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 286282 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 286283 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:43991/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 286384 INFO  (zkCallback-287-thread-2-processing-n:127.0.0.1:43991_) [n:127.0.0.1:43991_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 286434 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 286435 INFO  (qtp222433645-3042) [n:127.0.0.1:43991_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1317
   [junit4]   2> 286437 INFO  (qtp222433645-3040) [n:127.0.0.1:43991_    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 286536 INFO  (zkCallback-287-thread-2-processing-n:127.0.0.1:43991_) [n:127.0.0.1:43991_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 287015 INFO  (OverseerCollectionConfigSetProcessor-98886668845056004-127.0.0.1:43991_-n_0000000000) [n:127.0.0.1:43991_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 287437 INFO  (qtp222433645-3040) [n:127.0.0.1:43991_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:43991_&wt=javabin&version=2} status=0 QTime=2425
   [junit4]   2> 287443 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 287443 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41713/solr ready
   [junit4]   2> 287443 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 287444 INFO  (qtp222433645-3040) [n:127.0.0.1:43991_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 287445 INFO  (OverseerThreadFactory-896-thread-2-processing-n:127.0.0.1:43991_) [n:127.0.0.1:43991_    ] o.a.s.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 287445 WARN  (OverseerThreadFactory-896-thread-2-processing-n:127.0.0.1:43991_) [n:127.0.0.1:43991_    ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 287648 INFO  (qtp222433645-3040) [n:127.0.0.1:43991_    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 287649 INFO  (qtp222433645-3040) [n:127.0.0.1:43991_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=204
   [junit4]   2> 287727 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/shard-1-001 of type TLOG
   [junit4]   2> 287727 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 287743 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4ff62f90{/,null,AVAILABLE}
   [junit4]   2> 287745 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@69bd3a0{HTTP/1.1,[http/1.1]}{127.0.0.1:38989}
   [junit4]   2> 287745 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.e.j.s.Server Started @289212ms
   [junit4]   2> 287745 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/tempDir-001/jetty1, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=38989, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/shard-1-001/cores}
   [junit4]   2> 287746 ERROR (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 287746 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 287746 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 287746 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 287746 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T00:20:24.127Z
   [junit4]   2> 287749 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 287749 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/shard-1-001/solr.xml
   [junit4]   2> 287752 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 287752 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 287753 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@3f3adcfc, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 287755 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41713/solr
   [junit4]   2> 287768 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:38989_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 287768 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:38989_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 287769 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:38989_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38989_
   [junit4]   2> 287770 INFO  (zkCallback-287-thread-2-processing-n:127.0.0.1:43991_) [n:127.0.0.1:43991_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 287773 INFO  (zkCallback-300-thread-1-processing-n:127.0.0.1:38989_) [n:127.0.0.1:38989_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 287774 INFO  (zkCallback-295-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 287820 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:38989_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f3adcfc
   [junit4]   2> 287828 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:38989_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f3adcfc
   [junit4]   2> 287828 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:38989_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f3adcfc
   [junit4]   2> 287829 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:38989_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/shard-1-001/cores
   [junit4]   2> 287843 INFO  (qtp1687059490-3087) [n:127.0.0.1:38989_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:38989_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 287844 INFO  (OverseerCollectionConfigSetProcessor-98886668845056004-127.0.0.1:43991_-n_0000000000) [n:127.0.0.1:43991_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 287845 INFO  (OverseerThreadFactory-896-thread-3-processing-n:127.0.0.1:43991_) [n:127.0.0.1:43991_    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:38989_ for creating new replica
   [junit4]   2> 287846 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 287846 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 287949 INFO  (zkCallback-300-thread-1-processing-n:127.0.0.1:38989_) [n:127.0.0.1:38989_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 288878 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 288886 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema [collection1_shard2_replica_t41] Schema name=test
   [junit4]   2> 288936 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 288966 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t41' using configuration from collection collection1, trusted=true
   [junit4]   2> 288966 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t41' (registry 'solr.core.collection1.shard2.replica_t41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f3adcfc
   [junit4]   2> 288966 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 288966 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [[collection1_shard2_replica_t41] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/shard-1-001/cores/collection1_shard2_replica_t41], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/shard-1-001/cores/collection1_shard2_replica_t41/data/]
   [junit4]   2> 288968 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=34, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7709082486956434]
   [junit4]   2> 288988 WARN  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 289028 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 289028 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 289029 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 289029 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 289031 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=20, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6711264657383196]
   [junit4]   2> 289031 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.SolrIndexSearcher Opening [Searcher@488989b5[collection1_shard2_replica_t41] main]
   [junit4]   2> 289032 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 289032 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 289032 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 289033 INFO  (searcherExecutor-910-thread-1-processing-n:127.0.0.1:38989_ x:collection1_shard2_replica_t41 s:shard2 c:collection1) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [collection1_shard2_replica_t41] Registered new searcher Searcher@488989b5[collection1_shard2_replica_t41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 289033 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582186706149310464
   [junit4]   2> 289037 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 289037 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 289037 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:38989/collection1_shard2_replica_t41/
   [junit4]   2> 289037 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 289037 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy http://127.0.0.1:38989/collection1_shard2_replica_t41/ has no replicas
   [junit4]   2> 289037 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 289037 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ZkController collection1_shard2_replica_t41 stopping background replication from leader
   [junit4]   2> 289040 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:38989/collection1_shard2_replica_t41/ shard2
   [junit4]   2> 289141 INFO  (zkCallback-300-thread-1-processing-n:127.0.0.1:38989_) [n:127.0.0.1:38989_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 289190 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 289191 INFO  (qtp1687059490-3089) [n:127.0.0.1:38989_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1345
   [junit4]   2> 289192 INFO  (qtp1687059490-3087) [n:127.0.0.1:38989_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:38989_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=1349
   [junit4]   2> 289243 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/shard-2-001 of type TLOG
   [junit4]   2> 289243 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 289244 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@a963dcf{/,null,AVAILABLE}
   [junit4]   2> 289244 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@3d3e695c{HTTP/1.1,[http/1.1]}{127.0.0.1:34071}
   [junit4]   2> 289244 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.e.j.s.Server Started @290711ms
   [junit4]   2> 289245 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/tempDir-001/jetty2, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=34071, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/shard-2-001/cores}
   [junit4]   2> 289245 ERROR (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 289245 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 289245 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 289245 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 289245 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T00:20:25.626Z
   [junit4]   2> 289249 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 289249 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/shard-2-001/solr.xml
   [junit4]   2> 289251 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 289251 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 289252 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@3f3adcfc, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 289255 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41713/solr
   [junit4]   2> 289262 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:34071_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 289263 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:34071_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 289263 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:34071_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34071_
   [junit4]   2> 289264 INFO  (zkCallback-300-thread-1-processing-n:127.0.0.1:38989_) [n:127.0.0.1:38989_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 289264 INFO  (zkCallback-287-thread-2-processing-n:127.0.0.1:43991_) [n:127.0.0.1:43991_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 289264 INFO  (zkCallback-295-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 289265 INFO  (zkCallback-306-thread-1-processing-n:127.0.0.1:34071_) [n:127.0.0.1:34071_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 289304 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:34071_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f3adcfc
   [junit4]   2> 289309 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:34071_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f3adcfc
   [junit4]   2> 289309 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:34071_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f3adcfc
   [junit4]   2> 289310 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:34071_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/shard-2-001/cores
   [junit4]   2> 289328 INFO  (qtp1333676052-3116) [n:127.0.0.1:34071_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:34071_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 289329 INFO  (OverseerCollectionConfigSetProcessor-98886668845056004-127.0.0.1:43991_-n_0000000000) [n:127.0.0.1:43991_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 289330 INFO  (OverseerThreadFactory-896-thread-4-processing-n:127.0.0.1:43991_) [n:127.0.0.1:43991_    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:34071_ for creating new replica
   [junit4]   2> 289331 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 289331 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 289433 INFO  (zkCallback-306-thread-1-processing-n:127.0.0.1:34071_) [n:127.0.0.1:34071_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 289433 INFO  (zkCallback-300-thread-1-processing-n:127.0.0.1:38989_) [n:127.0.0.1:38989_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 290339 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 290347 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema [collection1_shard1_replica_t43] Schema name=test
   [junit4]   2> 290408 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 290415 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t43' using configuration from collection collection1, trusted=true
   [junit4]   2> 290416 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t43' (registry 'solr.core.collection1.shard1.replica_t43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f3adcfc
   [junit4]   2> 290416 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 290416 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [[collection1_shard1_replica_t43] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/shard-2-001/cores/collection1_shard1_replica_t43], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/shard-2-001/cores/collection1_shard1_replica_t43/data/]
   [junit4]   2> 290418 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=34, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7709082486956434]
   [junit4]   2> 290448 WARN  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 290481 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 290481 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 290482 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 290482 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 290483 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=20, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6711264657383196]
   [junit4]   2> 290483 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.SolrIndexSearcher Opening [Searcher@64b5fa30[collection1_shard1_replica_t43] main]
   [junit4]   2> 290484 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 290484 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 290484 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 290485 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582186707671842816
   [junit4]   2> 290486 INFO  (searcherExecutor-921-thread-1-processing-n:127.0.0.1:34071_ x:collection1_shard1_replica_t43 s:shard1 c:collection1) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [collection1_shard1_replica_t43] Registered new searcher Searcher@64b5fa30[collection1_shard1_replica_t43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 290490 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 290490 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 290490 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:34071/collection1_shard1_replica_t43/
   [junit4]   2> 290490 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 290490 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy http://127.0.0.1:34071/collection1_shard1_replica_t43/ has no replicas
   [junit4]   2> 290490 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 290490 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ZkController collection1_shard1_replica_t43 stopping background replication from leader
   [junit4]   2> 290491 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:34071/collection1_shard1_replica_t43/ shard1
   [junit4]   2> 290592 INFO  (zkCallback-300-thread-1-processing-n:127.0.0.1:38989_) [n:127.0.0.1:38989_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 290592 INFO  (zkCallback-306-thread-1-processing-n:127.0.0.1:34071_) [n:127.0.0.1:34071_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 290642 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 290643 INFO  (qtp1333676052-3112) [n:127.0.0.1:34071_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1312
   [junit4]   2> 290644 INFO  (qtp1333676052-3116) [n:127.0.0.1:34071_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:34071_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=1316
   [junit4]   2> 290714 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/shard-3-001 of type TLOG
   [junit4]   2> 290714 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 290726 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@389ab0d5{/,null,AVAILABLE}
   [junit4]   2> 290727 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@5c5f993a{HTTP/1.1,[http/1.1]}{127.0.0.1:41181}
   [junit4]   2> 290727 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.e.j.s.Server Started @292194ms
   [junit4]   2> 290727 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/tempDir-001/jetty3, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=41181, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/shard-3-001/cores}
   [junit4]   2> 290727 ERROR (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 290727 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 290727 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 290727 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 290727 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T00:20:27.108Z
   [junit4]   2> 290731 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 290731 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/shard-3-001/solr.xml
   [junit4]   2> 290735 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 290735 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 290735 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@3f3adcfc, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 290738 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41713/solr
   [junit4]   2> 290744 INFO  (zkCallback-300-thread-1-processing-n:127.0.0.1:38989_) [n:127.0.0.1:38989_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 290744 INFO  (zkCallback-306-thread-1-processing-n:127.0.0.1:34071_) [n:127.0.0.1:34071_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 290755 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:41181_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 290758 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:41181_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 290760 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:41181_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41181_
   [junit4]   2> 290761 INFO  (zkCallback-295-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 290761 INFO  (zkCallback-306-thread-1-processing-n:127.0.0.1:34071_) [n:127.0.0.1:34071_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 290761 INFO  (zkCallback-300-thread-1-processing-n:127.0.0.1:38989_) [n:127.0.0.1:38989_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 290761 INFO  (zkCallback-287-thread-2-processing-n:127.0.0.1:43991_) [n:127.0.0.1:43991_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 290761 INFO  (zkCallback-312-thread-1-processing-n:127.0.0.1:41181_) [n:127.0.0.1:41181_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 290842 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:41181_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f3adcfc
   [junit4]   2> 290851 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:41181_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f3adcfc
   [junit4]   2> 290851 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:41181_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f3adcfc
   [junit4]   2> 290852 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [n:127.0.0.1:41181_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/shard-3-001/cores
   [junit4]   2> 290902 INFO  (qtp1333676052-3117) [n:127.0.0.1:34071_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:41181_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 290910 INFO  (OverseerCollectionConfigSetProcessor-98886668845056004-127.0.0.1:43991_-n_0000000000) [n:127.0.0.1:43991_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 290910 INFO  (OverseerThreadFactory-896-thread-5-processing-n:127.0.0.1:43991_) [n:127.0.0.1:43991_    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:41181_ for creating new replica
   [junit4]   2> 290918 INFO  (qtp2035387633-3145) [n:127.0.0.1:41181_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 290918 INFO  (qtp2035387633-3145) [n:127.0.0.1:41181_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 291021 INFO  (zkCallback-306-thread-1-processing-n:127.0.0.1:34071_) [n:127.0.0.1:34071_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 291021 INFO  (zkCallback-300-thread-1-processing-n:127.0.0.1:38989_) [n:127.0.0.1:38989_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 291021 INFO  (zkCallback-312-thread-1-processing-n:127.0.0.1:41181_) [n:127.0.0.1:41181_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 291935 INFO  (qtp2035387633-3145) [n:127.0.0.1:41181_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 291961 INFO  (qtp2035387633-3145) [n:127.0.0.1:41181_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema [collection1_shard2_replica_t45] Schema name=test
   [junit4]   2> 292013 INFO  (qtp2035387633-3145) [n:127.0.0.1:41181_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 292020 INFO  (qtp2035387633-3145) [n:127.0.0.1:41181_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t45' using configuration from collection collection1, trusted=true
   [junit4]   2> 292020 INFO  (qtp2035387633-3145) [n:127.0.0.1:41181_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t45' (registry 'solr.core.collection1.shard2.replica_t45') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3f3adcfc
   [junit4]   2> 292021 INFO  (qtp2035387633-3145) [n:127.0.0.1:41181_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 292021 INFO  (qtp2035387633-3145) [n:127.0.0.1:41181_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [[collection1_shard2_replica_t45] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/shard-3-001/cores/collection1_shard2_replica_t45], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/shard-3-001/cores/collection1_shard2_replica_t45/data/]
   [junit4]   2> 292022 INFO  (qtp2035387633-3145) [n:127.0.0.1:41181_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=34, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7709082486956434]
   [junit4]   2> 292527 WARN  (qtp2035387633-3145) [n:127.0.0.1:41181_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 292551 INFO  (qtp2035387633-3145) [n:127.0.0.1:41181_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 292551 INFO  (qtp2035387633-3145) [n:127.0.0.1:41181_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 292552 INFO  (qtp2035387633-3145) [n:127.0.0.1:41181_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 292552 INFO  (qtp2035387633-3145) [n:127.0.0.1:41181_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 292552 INFO  (qtp2035387633-3145) [n:127.0.0.1:41181_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=20, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6711264657383196]
   [junit4]   2> 292553 INFO  (qtp2035387633-3145) [n:127.0.0.1:41181_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.SolrIndexSearcher Opening [Searcher@295209cc[collection1_shard2_replica_t45] main]
   [junit4]   2> 292553 INFO  (qtp2035387633-3145) [n:127.0.0.1:41181_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 292553 INFO  (qtp2035387633-3145) [n:127.0.0.1:41181_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 292554 INFO  (qtp2035387633-3145) [n:127.0.0.1:41181_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 292554 INFO  (searcherExecutor-932-thread-1-processing-n:127.0.0.1:41181_ x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:41181_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [collection1_shard2_replica_t45] Registered new searcher Searcher@295209cc[collection1_shard2_replica_t45] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 292554 INFO  (qtp2035387633-3145) [n:127.0.0.1:41181_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582186709841346560
   [junit4]   2> 292557 INFO  (qtp2035387633-3145) [n:127.0.0.1:41181_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.ZkController Core needs to recover:collection1_shard2_replica_t45
   [junit4]   2> 292558 INFO  (updateExecutor-309-thread-1-processing-n:127.0.0.1:41181_ x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:41181_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 292997 INFO  (qtp2035387633-3145) [n:127.0.0.1:41181_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1641
   [junit4]   2> 292999 INFO  (qtp1333676052-3117) [n:127.0.0.1:34071_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:41181_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=2097
   [junit4]   2> 293001 INFO  (recoveryExecutor-310-thread-1-processing-n:127.0.0.1:41181_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41181_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
   [junit4]   2> 293001 INFO  (recoveryExecutor-310-thread-1-processing-n:127.0.0.1:41181_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41181_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
   [junit4]   2> 293001 INFO  (recoveryExecutor-310-thread-1-processing-n:127.0.0.1:41181_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41181_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.ZkController collection1_shard2_replica_t45 stopping background replication from leader
   [junit4]   2> 293001 INFO  (recoveryExecutor-310-thread-1-processing-n:127.0.0.1:41181_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41181_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard2_replica_t45]
   [junit4]   2> 293001 INFO  (recoveryExecutor-310-thread-1-processing-n:127.0.0.1:41181_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41181_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
   [junit4]   2> 293001 INFO  (recoveryExecutor-310-thread-1-processing-n:127.0.0.1:41181_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41181_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard2_replica_t45] as recovering, leader is [http://127.0.0.1:38989/collection1_shard2_replica_t41/] and I am [http://127.0.0.1:41181/collection1_shard2_replica_t45/]
   [junit4]   2> 293004 INFO  (recoveryExecutor-310-thread-1-processing-n:127.0.0.1:41181_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:41181_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:38989]; [WaitForState: action=PREPRECOVERY&core=collection1_shard2_replica_t41&nodeName=127.0.0.1:41181_&coreNodeName=core_node46&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
   [junit4]   2> 293006 INFO  (qtp1687059490-3083) [n:127.0.0.1:38989_    ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
   [junit4]   2> 293006 INFO  (qtp1687059490-3083) [n:127.0.0.1:38989_    ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_t41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:41181_, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_t45","base_url":"http://127.0.0.1:41181","node_name":"127.0.0.1:41181_","state":"down","type":"TLOG"}
   [junit4]   2> 293050 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 4 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/shard-4-001 of type TLOG
   [junit4]   2> 293051 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 293052 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5081ec15{/,null,AVAILABLE}
   [junit4]   2> 293052 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@246e54eb{HTTP/1.1,[http/1.1]}{127.0.0.1:44825}
   [junit4]   2> 293053 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.e.j.s.Server Started @294519ms
   [junit4]   2> 293053 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/tempDir-001/jetty4, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=44825, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/shard-4-001/cores}
   [junit4]   2> 293053 ERROR (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 293053 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 293053 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 293053 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 293053 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T00:20:29.434Z
   [junit4]   2> 293055 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 293056 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[D7CA8611EAB239F5]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_D7CA8611EAB239F5-001/shard-4-001/solr.xml
   [junit4]   2> 293058 INFO  (TEST-

[...truncated too long message...]

CoreAdminOperation.java:384)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.solr.common.SolrException: No registered leader was found after waiting for 1220000ms , collection: people slice: shard1 saw state=null with live_nodes=[]
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:816)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:781)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1178)
   [junit4]   2> 	... 44 more
   [junit4]   2> 
   [junit4]   2> 2053098 INFO  (qtp170883113-10032) [n:127.0.0.1:42987_solr c:people s:shard1 r:core_node5 x:people_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=people&version=2&replicaType=NRT&property.config=solrconfig-doctransformers.xml&property.schema=schema-docValuesJoin.xml&coreNodeName=core_node5&name=people_shard1_replica_n2&action=CREATE&numShards=2&shard=shard1&wt=javabin} status=0 QTime=209812
   [junit4]   2> 2053099 ERROR (SUITE-TestSubQueryTransformerDistrib-seed#[D7CA8611EAB239F5]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2053100 INFO  (SUITE-TestSubQueryTransformerDistrib-seed#[D7CA8611EAB239F5]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45479 45479
   [junit4]   2> 2058122 INFO  (Thread-3034) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45479 45479
   [junit4]   2> 2058123 WARN  (Thread-3034) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/aliases.json
   [junit4]   2> 	5	/solr/security.json
   [junit4]   2> 	4	/solr/configs/solrCloudCollectionConfig
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	12	/solr/collections/people/state.json
   [junit4]   2> 	6	/solr/clusterstate.json
   [junit4]   2> 	6	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/overseer_elect/election/98886770933170191-127.0.0.1:42987_solr-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/live_nodes
   [junit4]   2> 	6	/solr/collections
   [junit4]   2> 
   [junit4]   2> 2058123 INFO  (SUITE-TestSubQueryTransformerDistrib-seed#[D7CA8611EAB239F5]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70), sim=RandomSimilarity(queryNorm=false): {}, locale=es-UY, timezone=UTC
   [junit4]   2> NOTE: Linux 4.10.0-33-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=8,threads=1,free=58577104,total=529530880
   [junit4]   2> NOTE: All tests run in this JVM: [BitVectorTest, TestCloudJSONFacetJoinDomain, TestConfigSetsAPIExclusivity, TestDocBasedVersionConstraints, CheckHdfsIndexTest, TestPHPSerializedResponseWriter, TestFoldingMultitermQuery, TestPostingsSolrHighlighter, FacetPivotSmallTest, RAMDirectoryFactoryTest, RollingRestartTest, TestDynamicFieldCollectionResource, TestTrieFacet, TestImplicitCoreProperties, TestFieldSortValues, TestQueryUtils, DocumentBuilderTest, TestRandomFaceting, ResponseLogComponentTest, TestLuceneIndexBackCompat, TolerantUpdateProcessorTest, CursorPagingTest, ShardSplitTest, TestBadConfig, SolrMetricsIntegrationTest, SolrCloudReportersTest, TestAuthenticationFramework, TestMaxScoreQueryParser, TestLeaderElectionZkExpiry, HdfsNNFailoverTest, TestInPlaceUpdatesDistrib, PeerSyncTest, TestRandomFlRTGCloud, TestMaxTokenLenTokenizer, SearchHandlerTest, TestComplexPhraseLeadingWildcard, TestUtils, TestWordDelimiterFilterFactory, EnumFieldTest, AssignBackwardCompatibilityTest, ZkControllerTest, TestReplicaProperties, TestSSLRandomization, SolrPluginUtilsTest, TestRestManager, SecurityConfHandlerTest, TestLegacyNumericUtils, CleanupOldIndexTest, BaseCdcrDistributedZkTest, TermsComponentTest, TestHdfsBackupRestoreCore, TestRecovery, TestHttpShardHandlerFactory, MultiThreadedOCPTest, TestStressVersions, TestBinaryField, TestManagedSchemaThreadSafety, CachingDirectoryFactoryTest, TestMergePolicyConfig, TestSubQueryTransformerDistrib]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSubQueryTransformerDistrib -Dtests.seed=D7CA8611EAB239F5 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es-UY -Dtests.timezone=UTC -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J0 | TestSubQueryTransformerDistrib (suite) <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:46357/solr: create the collection time out:180s
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([D7CA8611EAB239F5]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:626)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:867)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
   [junit4]    > 	at org.apache.solr.response.transform.TestSubQueryTransformerDistrib.setupCluster(TestSubQueryTransformerDistrib.java:74)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4] Completed [409/744 (2!)] on J0 in 215.78s, 0 tests, 1 error <<< FAILURES!

[...truncated 48340 lines...]

[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk-9) - Build # 669 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/669/
Java: 64bit/jdk-9 -XX:-UseCompressedOops -XX:+UseSerialGC --illegal-access=deny

1 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI

Error Message:
Error from server at https://127.0.0.1:40025/solr/awhollynewcollection_0: {"awhollynewcollection_0":5}

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:40025/solr/awhollynewcollection_0: {"awhollynewcollection_0":5}
	at __randomizedtesting.SeedInfo.seed([2C209BD83716278:4AB77D0985424DED]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:626)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:867)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:972)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:972)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:972)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:972)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:972)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:460)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 12801 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2C209BD83716278-001/init-core-data-001
   [junit4]   2> 969978 WARN  (SUITE-CollectionsAPIDistributedZkTest-seed#[2C209BD83716278]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=46 numCloses=46
   [junit4]   2> 969978 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[2C209BD83716278]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 969979 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[2C209BD83716278]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 969979 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[2C209BD83716278]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 969979 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[2C209BD83716278]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2C209BD83716278-001/tempDir-001
   [junit4]   2> 969979 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[2C209BD83716278]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 969980 INFO  (Thread-4777) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 969980 INFO  (Thread-4777) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 969981 ERROR (Thread-4777) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 970080 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[2C209BD83716278]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:44579
   [junit4]   2> 970089 INFO  (jetty-launcher-2694-thread-3) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 970089 INFO  (jetty-launcher-2694-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 970089 INFO  (jetty-launcher-2694-thread-4) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 970089 INFO  (jetty-launcher-2694-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 970092 INFO  (jetty-launcher-2694-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3fb75122{/solr,null,AVAILABLE}
   [junit4]   2> 970093 INFO  (jetty-launcher-2694-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3f308263{/solr,null,AVAILABLE}
   [junit4]   2> 970093 INFO  (jetty-launcher-2694-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@16cc5dd0{/solr,null,AVAILABLE}
   [junit4]   2> 970093 INFO  (jetty-launcher-2694-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@43ad0972{/solr,null,AVAILABLE}
   [junit4]   2> 970096 INFO  (jetty-launcher-2694-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@7fb42eea{SSL,[ssl, http/1.1]}{127.0.0.1:40025}
   [junit4]   2> 970097 INFO  (jetty-launcher-2694-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@2b1e0f24{SSL,[ssl, http/1.1]}{127.0.0.1:42349}
   [junit4]   2> 970097 INFO  (jetty-launcher-2694-thread-4) [    ] o.e.j.s.Server Started @971375ms
   [junit4]   2> 970097 INFO  (jetty-launcher-2694-thread-1) [    ] o.e.j.s.Server Started @971375ms
   [junit4]   2> 970097 INFO  (jetty-launcher-2694-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40025}
   [junit4]   2> 970097 INFO  (jetty-launcher-2694-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42349}
   [junit4]   2> 970096 INFO  (jetty-launcher-2694-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@79bf3a40{SSL,[ssl, http/1.1]}{127.0.0.1:38711}
   [junit4]   2> 970096 INFO  (jetty-launcher-2694-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@6e606af6{SSL,[ssl, http/1.1]}{127.0.0.1:45249}
   [junit4]   2> 970097 INFO  (jetty-launcher-2694-thread-2) [    ] o.e.j.s.Server Started @971375ms
   [junit4]   2> 970097 ERROR (jetty-launcher-2694-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 970097 INFO  (jetty-launcher-2694-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38711}
   [junit4]   2> 970097 INFO  (jetty-launcher-2694-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 970097 ERROR (jetty-launcher-2694-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 970097 INFO  (jetty-launcher-2694-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 970098 ERROR (jetty-launcher-2694-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 970098 INFO  (jetty-launcher-2694-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 970098 INFO  (jetty-launcher-2694-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 970098 INFO  (jetty-launcher-2694-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 970098 INFO  (jetty-launcher-2694-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 970098 INFO  (jetty-launcher-2694-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 970098 INFO  (jetty-launcher-2694-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 970098 INFO  (jetty-launcher-2694-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T21:21:36.019490Z
   [junit4]   2> 970098 INFO  (jetty-launcher-2694-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T21:21:36.019546Z
   [junit4]   2> 970098 INFO  (jetty-launcher-2694-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 970098 INFO  (jetty-launcher-2694-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T21:21:36.019743Z
   [junit4]   2> 970097 INFO  (jetty-launcher-2694-thread-3) [    ] o.e.j.s.Server Started @971375ms
   [junit4]   2> 970098 INFO  (jetty-launcher-2694-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45249}
   [junit4]   2> 970099 ERROR (jetty-launcher-2694-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 970099 INFO  (jetty-launcher-2694-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 970099 INFO  (jetty-launcher-2694-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 970099 INFO  (jetty-launcher-2694-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 970099 INFO  (jetty-launcher-2694-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T21:21:36.020656Z
   [junit4]   2> 970101 INFO  (jetty-launcher-2694-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 970101 INFO  (jetty-launcher-2694-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 970101 INFO  (jetty-launcher-2694-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 970101 INFO  (jetty-launcher-2694-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 970104 INFO  (jetty-launcher-2694-thread-4) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 970104 INFO  (jetty-launcher-2694-thread-1) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 970104 INFO  (jetty-launcher-2694-thread-4) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 970104 INFO  (jetty-launcher-2694-thread-1) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 970105 INFO  (jetty-launcher-2694-thread-2) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 970105 INFO  (jetty-launcher-2694-thread-2) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 970106 INFO  (jetty-launcher-2694-thread-3) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 970106 INFO  (jetty-launcher-2694-thread-3) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 970107 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f5569769d0001, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 970108 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f5569769d0004, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 970109 INFO  (jetty-launcher-2694-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44579/solr
   [junit4]   2> 970109 INFO  (jetty-launcher-2694-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44579/solr
   [junit4]   2> 970111 INFO  (jetty-launcher-2694-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44579/solr
   [junit4]   2> 970111 INFO  (jetty-launcher-2694-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44579/solr
   [junit4]   2> 970114 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f5569769d0008, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 970173 INFO  (jetty-launcher-2694-thread-1) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 970173 INFO  (jetty-launcher-2694-thread-4) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 970174 INFO  (jetty-launcher-2694-thread-1) [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42349_solr
   [junit4]   2> 970174 INFO  (jetty-launcher-2694-thread-2) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 970174 INFO  (jetty-launcher-2694-thread-3) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 970174 INFO  (jetty-launcher-2694-thread-4) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40025_solr
   [junit4]   2> 970174 INFO  (jetty-launcher-2694-thread-1) [    ] o.a.s.c.Overseer Overseer (id=98891628275367945-127.0.0.1:42349_solr-n_0000000000) starting
   [junit4]   2> 970174 INFO  (jetty-launcher-2694-thread-3) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45249_solr
   [junit4]   2> 970174 INFO  (jetty-launcher-2694-thread-2) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38711_solr
   [junit4]   2> 970174 INFO  (zkCallback-2713-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 970174 INFO  (zkCallback-2715-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 970174 INFO  (zkCallback-2714-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 970174 INFO  (zkCallback-2716-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 970174 INFO  (zkCallback-2715-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
   [junit4]   2> 970174 INFO  (zkCallback-2713-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
   [junit4]   2> 970177 INFO  (zkCallback-2716-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
   [junit4]   2> 970177 INFO  (zkCallback-2714-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
   [junit4]   2> 970182 INFO  (jetty-launcher-2694-thread-1) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42349_solr
   [junit4]   2> 970182 INFO  (zkCallback-2715-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 970182 INFO  (zkCallback-2716-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 970183 INFO  (zkCallback-2714-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 970183 INFO  (zkCallback-2713-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 970198 INFO  (jetty-launcher-2694-thread-4) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36776a72
   [junit4]   2> 970214 INFO  (jetty-launcher-2694-thread-4) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36776a72
   [junit4]   2> 970214 INFO  (jetty-launcher-2694-thread-4) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36776a72
   [junit4]   2> 970215 INFO  (jetty-launcher-2694-thread-4) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2C209BD83716278-001/tempDir-001/node4
   [junit4]   2> 970215 INFO  (jetty-launcher-2694-thread-3) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36776a72
   [junit4]   2> 970220 INFO  (jetty-launcher-2694-thread-2) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36776a72
   [junit4]   2> 970220 INFO  (jetty-launcher-2694-thread-3) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36776a72
   [junit4]   2> 970220 INFO  (jetty-launcher-2694-thread-3) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36776a72
   [junit4]   2> 970221 INFO  (jetty-launcher-2694-thread-3) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2C209BD83716278-001/tempDir-001/node3
   [junit4]   2> 970225 INFO  (jetty-launcher-2694-thread-2) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36776a72
   [junit4]   2> 970225 INFO  (jetty-launcher-2694-thread-2) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36776a72
   [junit4]   2> 970226 INFO  (jetty-launcher-2694-thread-2) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2C209BD83716278-001/tempDir-001/node2
   [junit4]   2> 970230 INFO  (jetty-launcher-2694-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36776a72
   [junit4]   2> 970235 INFO  (jetty-launcher-2694-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36776a72
   [junit4]   2> 970235 INFO  (jetty-launcher-2694-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36776a72
   [junit4]   2> 970236 INFO  (jetty-launcher-2694-thread-1) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2C209BD83716278-001/tempDir-001/node1
   [junit4]   2> 970281 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[2C209BD83716278]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 970282 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[2C209BD83716278]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44579/solr ready
   [junit4]   2> 970291 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testCollectionsAPI
   [junit4]   2> 970291 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 970300 INFO  (qtp72167170-14316) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=00fa3981-a912-4607-86dc-4d7ee9ae0a9c&replicationFactor=1&collection.configName=conf2&maxShardsPerNode=2&name=awhollynewcollection_0&nrtReplicas=1&action=CREATE&numShards=5&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 970301 INFO  (qtp72167170-14316) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=00fa3981-a912-4607-86dc-4d7ee9ae0a9c&replicationFactor=1&collection.configName=conf2&maxShardsPerNode=2&name=awhollynewcollection_0&nrtReplicas=1&action=CREATE&numShards=5&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 970301 INFO  (OverseerThreadFactory-4856-thread-1) [    ] o.a.s.c.CreateCollectionCmd Create collection awhollynewcollection_0
   [junit4]   2> 970302 INFO  (zkCallback-2725-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeCreated path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 970407 INFO  (OverseerStateUpdate-98891628275367945-127.0.0.1:42349_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"awhollynewcollection_0",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"awhollynewcollection_0_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:40025/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 970409 INFO  (OverseerStateUpdate-98891628275367945-127.0.0.1:42349_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"awhollynewcollection_0",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"awhollynewcollection_0_shard2_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:42349/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 970410 INFO  (OverseerStateUpdate-98891628275367945-127.0.0.1:42349_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"awhollynewcollection_0",
   [junit4]   2>   "shard":"shard3",
   [junit4]   2>   "core":"awhollynewcollection_0_shard3_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:45249/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 970412 INFO  (OverseerStateUpdate-98891628275367945-127.0.0.1:42349_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"awhollynewcollection_0",
   [junit4]   2>   "shard":"shard4",
   [junit4]   2>   "core":"awhollynewcollection_0_shard4_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:38711/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 970413 INFO  (OverseerStateUpdate-98891628275367945-127.0.0.1:42349_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"awhollynewcollection_0",
   [junit4]   2>   "shard":"shard5",
   [junit4]   2>   "core":"awhollynewcollection_0_shard5_replica_n8",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:40025/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 970515 INFO  (zkCallback-2725-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 970624 INFO  (qtp72167170-14315) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf2&newCollection=true&collection=awhollynewcollection_0&version=2&replicaType=NRT&async=00fa3981-a912-4607-86dc-4d7ee9ae0a9c4885345647281700&coreNodeName=core_node5&name=awhollynewcollection_0_shard2_replica_n2&action=CREATE&numShards=5&shard=shard2&wt=javabin} status=0 QTime=0
   [junit4]   2> 970625 INFO  (parallelCoreAdminExecutor-4861-thread-1) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf2&newCollection=true&collection=awhollynewcollection_0&version=2&replicaType=NRT&async=00fa3981-a912-4607-86dc-4d7ee9ae0a9c4885345647281700&coreNodeName=core_node5&name=awhollynewcollection_0_shard2_replica_n2&action=CREATE&numShards=5&shard=shard2&wt=javabin
   [junit4]   2> 970625 INFO  (parallelCoreAdminExecutor-4861-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 970642 INFO  (qtp893956854-14282) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf2&newCollection=true&collection=awhollynewcollection_0&version=2&replicaType=NRT&async=00fa3981-a912-4607-86dc-4d7ee9ae0a9c4885345648794359&coreNodeName=core_node7&name=awhollynewcollection_0_shard3_replica_n4&action=CREATE&numShards=5&shard=shard3&wt=javabin} status=0 QTime=0
   [junit4]   2> 970644 INFO  (parallelCoreAdminExecutor-4858-thread-1) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf2&newCollection=true&collection=awhollynewcollection_0&version=2&replicaType=NRT&async=00fa3981-a912-4607-86dc-4d7ee9ae0a9c4885345648794359&coreNodeName=core_node7&name=awhollynewcollection_0_shard3_replica_n4&action=CREATE&numShards=5&shard=shard3&wt=javabin
   [junit4]   2> 970645 INFO  (parallelCoreAdminExecutor-4858-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 970646 INFO  (qtp1261336574-14302) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf2&newCollection=true&collection=awhollynewcollection_0&version=2&replicaType=NRT&async=00fa3981-a912-4607-86dc-4d7ee9ae0a9c4885345645746771&coreNodeName=core_node3&name=awhollynewcollection_0_shard1_replica_n1&action=CREATE&numShards=5&shard=shard1&wt=javabin} status=0 QTime=1
   [junit4]   2> 970646 INFO  (qtp1261336574-14289) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf2&newCollection=true&collection=awhollynewcollection_0&version=2&replicaType=NRT&async=00fa3981-a912-4607-86dc-4d7ee9ae0a9c4885345651799497&coreNodeName=core_node10&name=awhollynewcollection_0_shard5_replica_n8&action=CREATE&numShards=5&shard=shard5&wt=javabin} status=0 QTime=0
   [junit4]   2> 970646 INFO  (parallelCoreAdminExecutor-4857-thread-1) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf2&newCollection=true&collection=awhollynewcollection_0&version=2&replicaType=NRT&async=00fa3981-a912-4607-86dc-4d7ee9ae0a9c4885345645746771&coreNodeName=core_node3&name=awhollynewcollection_0_shard1_replica_n1&action=CREATE&numShards=5&shard=shard1&wt=javabin
   [junit4]   2> 970646 INFO  (parallelCoreAdminExecutor-4857-thread-2) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf2&newCollection=true&collection=awhollynewcollection_0&version=2&replicaType=NRT&async=00fa3981-a912-4607-86dc-4d7ee9ae0a9c4885345651799497&coreNodeName=core_node10&name=awhollynewcollection_0_shard5_replica_n8&action=CREATE&numShards=5&shard=shard5&wt=javabin
   [junit4]   2> 970647 INFO  (parallelCoreAdminExecutor-4857-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 970647 INFO  (qtp1835538210-14310) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf2&newCollection=true&collection=awhollynewcollection_0&version=2&replicaType=NRT&async=00fa3981-a912-4607-86dc-4d7ee9ae0a9c4885345650435956&coreNodeName=core_node9&name=awhollynewcollection_0_shard4_replica_n6&action=CREATE&numShards=5&shard=shard4&wt=javabin} status=0 QTime=0
   [junit4]   2> 970647 INFO  (parallelCoreAdminExecutor-4859-thread-1) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf2&newCollection=true&collection=awhollynewcollection_0&version=2&replicaType=NRT&async=00fa3981-a912-4607-86dc-4d7ee9ae0a9c4885345650435956&coreNodeName=core_node9&name=awhollynewcollection_0_shard4_replica_n6&action=CREATE&numShards=5&shard=shard4&wt=javabin
   [junit4]   2> 970648 INFO  (parallelCoreAdminExecutor-4859-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 970648 INFO  (qtp72167170-14297) [    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 00fa3981-a912-4607-86dc-4d7ee9ae0a9c4885345647281700
   [junit4]   2> 970648 INFO  (qtp72167170-14297) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=00fa3981-a912-4607-86dc-4d7ee9ae0a9c4885345647281700&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 970751 INFO  (zkCallback-2715-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 970751 INFO  (zkCallback-2716-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 970751 INFO  (zkCallback-2715-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 970751 INFO  (zkCallback-2714-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 970751 INFO  (zkCallback-2713-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 970751 INFO  (zkCallback-2716-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 970751 INFO  (zkCallback-2713-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 970751 INFO  (zkCallback-2725-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 970751 INFO  (zkCallback-2714-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 971651 INFO  (qtp72167170-14313) [    ] o.a.s.h.a.CoreAdminOperation Checking request status for : 00fa3981-a912-4607-86dc-4d7ee9ae0a9c4885345647281700
   [junit4]   2> 971652 INFO  (qtp72167170-14313) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=00fa3981-a912-4607-86dc-4d7ee9ae0a9c4885345647281700&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 971679 INFO  (parallelCoreAdminExecutor-4861-thread-1) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 971682 INFO  (parallelCoreAdminExecutor-4858-thread-1) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 971683 INFO  (parallelCoreAdminExecutor-4859-thread-1) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 971683 INFO  (parallelCoreAdminExecutor-4857-thread-2) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 971686 INFO  (parallelCoreAdminExecutor-4857-thread-1) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 971699 INFO  (parallelCoreAdminExecutor-4861-thread-1) [    ] o.a.s.s.IndexSchema [awhollynewcollection_0_shard2_replica_n2] Schema name=minimal
   [junit4]   2> 971700 INFO  (parallelCoreAdminExecutor-4858-thread-1) [    ] o.a.s.s.IndexSchema [awhollynewcollection_0_shard3_replica_n4] Schema name=minimal
   [junit4]   2> 971701 INFO  (parallelCoreAdminExecutor-4857-thread-2) [    ] o.a.s.s.IndexSchema [awhollynewcollection_0_shard5_replica_n8] Schema name=minimal
   [junit4]   2> 971701 INFO  (parallelCoreAdminExecutor-4861-thread-1) [    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 971701 INFO  (parallelCoreAdminExecutor-4861-thread-1) [    ] o.a.s.c.CoreContainer Creating SolrCore 'awhollynewcollection_0_shard2_replica_n2' using configuration from collection awhollynewcollection_0, trusted=true
   [junit4]   2> 971701 INFO  (parallelCoreAdminExecutor-4861-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.awhollynewcollection_0.shard2.replica_n2' (registry 'solr.core.awhollynewcollection_0.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36776a72
   [junit4]   2> 971701 INFO  (parallelCoreAdminExecutor-4861-thread-1) [    ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 971701 INFO  (parallelCoreAdminExecutor-4859-thread-1) [    ] o.a.s.s.IndexSchema [awhollynewcollection_0_shard4_replica_n6] Schema name=minimal
   [junit4]   2> 971701 INFO  (parallelCoreAdminExecutor-4861-thread-1) [    ] o.a.s.c.SolrCore [[awhollynewcollection_0_shard2_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2C209BD83716278-001/tempDir-001/node1/awhollynewcollection_0_shard2_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2C209BD83716278-001/tempDir-001/node1/awhollynewcollection_0_shard2_replica_n2/data/]
   [junit4]   2> 971702 INFO  (parallelCoreAdminExecutor-4858-thread-1) [    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 971702 INFO  (parallelCoreAdminExecutor-4858-thread-1) [    ] o.a.s.c.CoreContainer Creating SolrCore 'awhollynewcollection_0_shard3_replica_n4' using configuration from collection awhollynewcollection_0, trusted=true
   [junit4]   2> 971702 INFO  (parallelCoreAdminExecutor-4858-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.awhollynewcollection_0.shard3.replica_n4' (registry 'solr.core.awhollynewcollection_0.shard3.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36776a72
   [junit4]   2> 971702 INFO  (parallelCoreAdminExecutor-4857-thread-2) [    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 971702 INFO  (parallelCoreAdminExecutor-4857-thread-2) [    ] o.a.s.c.CoreContainer Creating SolrCore 'awhollynewcollection_0_shard5_replica_n8' using configuration from collection awhollynewcollection_0, trusted=true
   [junit4]   2> 971702 INFO  (parallelCoreAdminExecutor-4858-thread-1) [    ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 971702 INFO  (parallelCoreAdminExecutor-4858-thread-1) [    ] o.a.s.c.SolrCore [[awhollynewcollection_0_shard3_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2C209BD83716278-001/tempDir-001/node3/awhollynewcollection_0_shard3_replica_n4], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2C209BD83716278-001/tempDir-001/node3/awhollynewcollection_0_shard3_replica_n4/data/]
   [junit4]   2> 971702 INFO  (parallelCoreAdminExecutor-4857-thread-2) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.awhollynewcollection_0.shard5.replica_n8' (registry 'solr.core.awhollynewcollection_0.shard5.replica_n8') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36776a72
   [junit4]   2> 971702 INFO  (parallelCoreAdminExecutor-4857-thread-2) [    ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 971703 INFO  (parallelCoreAdminExecutor-4857-thread-2) [    ] o.a.s.c.SolrCore [[awhollynewcollection_0_shard5_replica_n8] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2C209BD83716278-001/tempDir-001/node4/awhollynewcollection_0_shard5_replica_n8], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2C209BD83716278-001/tempDir-001/node4/awhollynewcollection_0_shard5_replica_n8/data/]
   [junit4]   2> 971703 INFO  (parallelCoreAdminExecutor-4857-thread-1) [    ] o.a.s.s.IndexSchema [awhollynewcollection_0_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 971703 INFO  (parallelCoreAdminExecutor-4859-thread-1) [    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 971703 INFO  (parallelCoreAdminExecutor-4859-thread-1) [    ] o.a.s.c.CoreContainer Creating SolrCore 'awhollynewcollection_0_shard4_replica_n6' using configuration from collection awhollynewcollection_0, trusted=true
   [junit4]   2> 971703 INFO  (parallelCoreAdminExecutor-4859-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.awhollynewcollection_0.shard4.replica_n6' (registry 'solr.core.awhollynewcollection_0.shard4.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36776a72
   [junit4]   2> 971704 INFO  (parallelCoreAdminExecutor-4859-thread-1) [    ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 971704 INFO  (parallelCoreAdminExecutor-4859-thread-1) [    ] o.a.s.c.SolrCore [[awhollynewcollection_0_shard4_replica_n6] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2C209BD83716278-001/tempDir-001/node2/awhollynewcollection_0_shard4_replica_n6], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2C209BD83716278-001/tempDir-001/node2/awhollynewcollection_0_shard4_replica_n6/data/]
   [junit4]   2> 971704 INFO  (parallelCoreAdminExecutor-4857-thread-1) [    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 971704 INFO  (parallelCoreAdminExecutor-4857-thread-1) [    ] o.a.s.c.CoreContainer Creating SolrCore 'awhollynewcollection_0_shard1_replica_n1' using configuration from collection awhollynewcollection_0, trusted=true
   [junit4]   2> 971705 INFO  (parallelCoreAdminExecutor-4857-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.awhollynewcollection_0.shard1.replica_n1' (registry 'solr.core.awhollynewcollection_0.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36776a72
   [junit4]   2> 971705 INFO  (parallelCoreAdminExecutor-4857-thread-1) [    ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 971705 INFO  (parallelCoreAdminExecutor-4857-thread-1) [    ] o.a.s.c.SolrCore [[awhollynewcollection_0_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2C209BD83716278-001/tempDir-001/node4/awhollynewcollection_0_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2C209BD83716278-001/tempDir-001/node4/awhollynewcollection_0_shard1_replica_n1/data/]
   [junit4]   2> 971755 INFO  (parallelCoreAdminExecutor-4857-thread-1) [    ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 971755 INFO  (parallelCoreAdminExecutor-4857-thread-1) [    ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 971756 INFO  (parallelCoreAdminExecutor-4857-thread-1) [    ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 971756 INFO  (parallelCoreAdminExecutor-4857-thread-1) [    ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 971757 INFO  (parallelCoreAdminExecutor-4859-thread-1) [    ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 971757 INFO  (parallelCoreAdminExecutor-4859-thread-1) [    ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 971757 INFO  (parallelCoreAdminExecutor-4857-thread-1) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@3f176333[awhollynewcollection_0_shard1_replica_n1] main]
   [junit4]   2> 971757 INFO  (parallelCoreAdminExecutor-4857-thread-2) [    ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 971757 INFO  (parallelCoreAdminExecutor-4857-thread-2) [    ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 971757 INFO  (parallelCoreAdminExecutor-4861-thread-1) [    ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 971757 INFO  (parallelCoreAdminExecutor-4861-thread-1) [    ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 971758 INFO  (parallelCoreAdminExecutor-4859-thread-1) [    ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 971758 INFO  (parallelCoreAdminExecutor-4857-thread-1) [    ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf2
   [junit4]   2> 971758 INFO  (parallelCoreAdminExecutor-4859-thread-1) [    ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 971758 INFO  (parallelCoreAdminExecutor-4857-thread-2) [    ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 971758 INFO  (parallelCoreAdminExecutor-4857-thread-1) [    ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf2
   [junit4]   2> 971758 INFO  (parallelCoreAdminExecutor-4857-thread-2) [    ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 971758 INFO  (parallelCoreAdminExecutor-4861-thread-1) [    ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 971758 INFO  (parallelCoreAdminExecutor-4861-thread-1) [    ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 971758 INFO  (parallelCoreAdminExecutor-4857-thread-1) [    ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 971759 INFO  (parallelCoreAdminExecutor-4859-thread-1) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@70574dc1[awhollynewcollection_0_shard4_replica_n6] main]
   [junit4]   2> 971759 INFO  (parallelCoreAdminExecutor-4857-thread-2) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@4393dbb8[awhollynewcollection_0_shard5_replica_n8] main]
   [junit4]   2> 971759 INFO  (parallelCoreAdminExecutor-4861-thread-1) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@75e0b051[awhollynewcollection_0_shard2_replica_n2] main]
   [junit4]   2> 971759 INFO  (searcherExecutor-4869-thread-1) [    ] o.a.s.c.SolrCore [awhollynewcollection_0_shard1_replica_n1] Registered new searcher Searcher@3f176333[awhollynewcollection_0_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 971759 INFO  (parallelCoreAdminExecutor-4857-thread-1) [    ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582266054271303680
   [junit4]   2> 971759 INFO  (parallelCoreAdminExecutor-4859-thread-1) [    ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf2
   [junit4]   2> 971759 INFO  (parallelCoreAdminExecutor-4861-thread-1) [    ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf2
   [junit4]   2> 971759 INFO  (parallelCoreAdminExecutor-4857-thread-2) [    ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf2
   [junit4]   2> 971759 INFO  (parallelCoreAdminExecutor-4859-thread-1) [    ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf2
   [junit4]   2> 971759 INFO  (parallelCoreAdminExecutor-4861-thread-1) [    ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf2
   [junit4]   2> 971759 INFO  (parallelCoreAdminExecutor-4857-thread-2) [    ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf2
   [junit4]   2> 971759 INFO  (parallelCoreAdminExecutor-4861-thread-1) [    ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 971759 INFO  (parallelCoreAdminExecutor-4857-thread-2) [    ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 971759 INFO  (parallelCoreAdminExecutor-4859-thread-1) [    ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 971760 INFO  (parallelCoreAdminExecutor-4861-thread-1) [    ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582266054272352256
   [junit4]   2> 971760 INFO  (searcherExecutor-4867-thread-1) [    ] o.a.s.c.SolrCore [awhollynewcollection_0_shard5_replica_n8] Registered new searcher Searcher@4393dbb8[awhollynewcollection_0_shard5_replica_n8] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 971760 INFO  (searcherExecutor-4868-thread-1) [    ] o.a.s.c.SolrCore [awhollynewcollection_0_shard4_replica_n6] Registered new searcher Searcher@70574dc1[awhollynewcollection_0_shard4_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 971760 INFO  (parallelCoreAdminExecutor-4857-thread-2) [    ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582266054272352256
   [junit4]   2> 971760 INFO  (parallelCoreAdminExecutor-4859-thread-1) [    ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582266054272352256
   [junit4]   2> 971761 INFO  (parallelCoreAdminExecutor-4858-thread-1) [    ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 971761 INFO  (parallelCoreAdminExecutor-4858-thread-1) [    ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 971761 INFO  (searcherExecutor-4865-thread-1) [    ] o.a.s.c.SolrCore [awhollynewcollection_0_shard2_replica_n2] Registered new searcher Searcher@75e0b051[awhollynewcollection_0_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 971761 INFO  (parallelCoreAdminExecutor-4857-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 971761 INFO  (parallelCoreAdminExecutor-4857-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 971761 INFO  (parallelCoreAdminExecutor-4857-thread-1) [    ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:40025/solr/awhollynewcollection_0_shard1_replica_n1/
   [junit4]   2> 971761 INFO  (parallelCoreAdminExecutor-4857-thread-1) [    ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 971761 INFO  (parallelCoreAdminExecutor-4857-thread-1) [    ] o.a.s.c.SyncStrategy https://127.0.0.1:40025/solr/awhollynewcollection_0_shard1_replica_n1/ has no replicas
   [junit4]   2> 971761 INFO  (parallelCoreAdminExecutor-4857-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 971762 INFO  (parallelCoreAdminExecutor-4858-thread-1) [    ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 971762 INFO  (parallelCoreAdminExecutor-4858-thread-1) [    ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 971762 INFO  (parallelCoreAdminExecutor-4861-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 971762 INFO  (parallelCoreAdminExecutor-4861-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 971762 INFO  (parallelCoreAdminExecutor-4861-thread-1) [    ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:42349/solr/awhollynewcollection_0_shard2_replica_n2/
   [junit4]   2> 971762 INFO  (parallelCoreAdminExecutor-4861-thread-1) [    ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 971762 INFO  (parallelCoreAdminExecutor-4861-thread-1) [    ] o.a.s.c.SyncStrategy https://127.0.0.1:42349/solr/awhollynewcollection_0_shard2_replica_n2/ has no replicas
   [junit4]   2> 971762 INFO  (parallelCoreAdminExecutor-4861-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 971762 INFO  (parallelCoreAdminExecutor-4858-thread-1) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@3d6fb792[awhollynewcollection_0_shard3_replica_n4] main]
   [junit4]   2> 971762 INFO  (parallelCoreAdminExecutor-4857-thread-2) [    ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 971762 INFO  (parallelCoreAdminExecutor-4857-thread-2) [    ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 971763 INFO  (parallelCoreAdminExecutor-4857-thread-2) [    ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:40025/solr/awhollynewcollection_0_shard5_replica_n8/
   [junit4]   2> 971763 INFO  (parallelCoreAdminExecutor-4857-thread-2) [    ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 971763 INFO  (parallelCoreAdminExecutor-4857-thread-2) [    ] o.a.s.c.SyncStrategy https://127.0.0.1:40025/solr/awhollynewcollection_0_shard5_replica_n8/ has no replicas
   [junit4]   2> 971763 INFO  (parallelCoreAdminExecutor-4857-thread-2) [    ] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 971763 INFO  (parallelCoreAdminExecutor-4858-thread-1) [    ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf2
   [junit4]   2> 971763 INFO  (parallelCoreAdminExecutor-4857-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:40025/solr/awhollynewcollection_0_shard1_replica_n1/ shard1
   [junit4]   2> 971763 INFO  (parallelCoreAdminExecutor-4859-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 971763 INFO  (parallelCoreAdminExecutor-4858-thread-1) [    ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf2
   [junit4]   2> 971763 INFO  (parallelCoreAdminExecutor-4859-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 971763 INFO  (parallelCoreAdminExecutor-4859-thread-1) [    ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:38711/solr/awhollynewcollection_0_shard4_replica_n6/
   [junit4]   2> 971763 INFO  (parallelCoreAdminExecutor-4859-thread-1) [    ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 971763 INFO  (parallelCoreAdminExecutor-4859-thread-1) [    ] o.a.s.c.SyncStrategy https://127.0.0.1:38711/solr/awhollynewcollection_0_shard4_replica_n6/ has no replicas
   [junit4]   2> 971763 INFO  (parallelCoreAdminExecutor-4859-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 971763 INFO  (parallelCoreAdminExecutor-4858-thread-1) [    ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 971763 INFO  (parallelCoreAdminExecutor-4861-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:42349/solr/awhollynewcollection_0_shard2_replica_n2/ shard2
   [junit4]   2> 971764 INFO  (searcherExecutor-4866-thread-1) [    ] o.a.s.c.SolrCore [awhollynewcollection_0_shard3_replica_n4] Registered new searcher Searcher@3d6fb792[awhollynewcollection_0_shard3_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 971764 INFO  (parallelCoreAdminExecutor-4858-thread-1) [    ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582266054276546560
   [junit4]   2> 971764 INFO  (parallelCoreAdminExecutor-4859-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:38711/solr/awhollynewcollection_0_shard4_replica_n6/ shard4
   [junit4]   2> 971764 INFO  (parallelCoreAdminExecutor-4857-thread-2) [    ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:40025/solr/awhollynewcollection_0_shard5_replica_n8/ shard5
   [junit4]   2> 971766 INFO  (parallelCoreAdminExecutor-4858-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 971766 INFO  (parallelCoreAdminExecutor-4858-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 971766 INFO  (parallelCoreAdminExecutor-4858-thread-1) [    ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:45249/solr/awhollynewcollection_0_shard3_replica_n4/
   [junit4]   2> 971766 INFO  (parallelCoreAdminExecutor-4858-thread-1) [    ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 971766 INFO  (parallelCoreAdminExecutor-4858-thread-1) [    ] o.a.s.c.SyncStrategy https://127.0.0.1:45249/solr/awhollynewcollection_0_shard3_replica_n4/ has no replicas
   [junit4]   2> 971766 INFO  (parallelCoreAdminExecutor-4858-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 971767 INFO  (parallelCoreAdminExecutor-4858-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:45249/solr/awhollynewcollection_0_shard3_replica_n4/ shard3
   [junit4]   2> 971868 INFO  (zkCallback-2716-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 971868 INFO  (zkCallback-2714-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 971868 INFO  (zkCallback-2714-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 971868 INFO  (zkCallback-2715-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 971868 INFO  (zkCallback-2715-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 971868 INFO  (zkCallback-2713-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 971868 INFO  (zkCallback-2713-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 971868 INFO  (zkCallback-2725-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 971868 INFO  (zkCallback-2716-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 971913 INFO  (parallelCoreAdminExecutor-4857-thread-1) [    ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 971914 INFO  (parallelCoreAdminExecutor-4861-thread-1) [    ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 971915 INFO  (parallelCoreAdminExecutor-4857-thread-2) [    ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 971915 INFO  (parallelCoreAdminExecutor-4859-thread-1) [    ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 971917 INFO  (parallelCoreAdminExecutor-4858-thread-1) [    ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 972019 INFO  (zkCallback-2713-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 972019 INFO  (zkCallback-2725-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 972020 INFO  (zkCallback-2715-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 972020 INFO  (zkCallback-2715-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 972020 INFO  (zkCallback-2716-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 972019 INFO  (zkCallback-2714-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 972019 INFO  (zkCallback-2714-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 972019 INFO  (zkCallback-2713-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 972019 INFO  (zkCallback-2716-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 972021 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.c.ChaosMonkey monkey: stop jetty! 40025
   [junit4]   2> 972021 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=989043448
   [junit4]   2> 972021 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 972022 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3400c9a5: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@481e37ec
   [junit4]   2> 972024 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 972024 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@58159874: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@4973648c
   [junit4]   2> 972026 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 972026 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3cea985b: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@5999682c
   [junit4]   2> 972026 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:40025_solr
   [junit4]   2> 972027 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 972027 INFO  (zkCallback-2725-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 972027 INFO  (zkCallback-2714-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 972027 INFO  (zkCallback-2713-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 972027 INFO  (zkCallback-2725-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 972027 INFO  (zkCallback-2716-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 972027 INFO  (zkCallback-2715-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 972027 INFO  (coreCloseExecutor-4890-thread-1) [    ] o.a.s.c.SolrCore [awhollynewcollection_0_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@52883297
   [junit4]   2> 972027 INFO  (coreCloseExecutor-4890-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.awhollynewcollection_0.shard1.replica_n1, tag=1384657559
   [junit4]   2> 972027 INFO  (coreCloseExecutor-4890-thread-2) [    ] o.a.s.c.SolrCore [awhollynewcollection_0_shard5_replica_n8]  CLOSING SolrCore org.apache.solr.core.SolrCore@77e18352
   [junit4]   2> 972027 INFO  (coreCloseExecutor-4890-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7ca9ae74: rootName = null, domain = solr.core.awhollynewcollection_0.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.awhollynewcollection_0.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@637af953
   [junit4]   2> 972032 INFO  (coreCloseExecutor-4890-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.awhollynewcollection_0.shard1.leader, tag=1384657559
   [junit4]   2> 972032 INFO  (coreCloseExecutor-4890-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.awhollynewcollection_0.shard5.replica_n8, tag=2011267922
   [junit4]   2> 972032 INFO  (coreCloseExecutor-4890-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@ab8f017: rootName = null, domain = solr.core.awhollynewcollection_0.shard5.replica_n8, service url = null, agent id = null] for registry solr.core.awhollynewcollection_0.shard5.replica_n8 / com.codahale.metrics.MetricRegistry@7adda6a1
   [junit4]   2> 972038 INFO  (coreCloseExecutor-4890-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.awhollynewcollection_0.shard5.leader, tag=2011267922
   [junit4]   2> 972040 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@7fb42eea{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 972041 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3f308263{/solr,null,UNAVAILABLE}
   [junit4]   2> 972041 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.c.MiniSolrCloudCluster ============ Restarting jetty
   [junit4]   2> 972041 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.c.ChaosMonkey monkey: starting jetty! 40025
   [junit4]   2> 972041 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 972042 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@cff9871{/solr,null,AVAILABLE}
   [junit4]   2> 972042 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@164a8f18{SSL,[ssl, http/1.1]}{127.0.0.1:40025}
   [junit4]   2> 972042 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.e.j.s.Server Started @973321ms
   [junit4]   2> 972043 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40025}
   [junit4]   2> 972043 ERROR (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 972043 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 972043 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 972043 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 972043 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T21:21:37.964446Z
   [junit4]   2> 972044 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 972046 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 972046 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 972048 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44579/solr
   [junit4]   2> 972052 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 972052 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 972053 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40025_solr
   [junit4]   2> 972053 INFO  (zkCallback-2715-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 972053 INFO  (zkCallback-2716-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 972053 INFO  (zkCallback-2713-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 972053 INFO  (zkCallback-2725-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 972053 INFO  (zkCallback-2725-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 972057 INFO  (zkCallback-2731-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 972076 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36776a72
   [junit4]   2> 972083 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36776a72
   [junit4]   2> 972083 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36776a72
   [junit4]   2> 972085 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.c.CorePropertiesLocator Found 2 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2C209BD83716278-001/tempDir-001/node4
   [junit4]   2> 972085 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.s.c.CorePropertiesLocator Cores are: [awhollynewcollection_0_shard5_replica_n8, awhollynewcollection_0_shard1_replica_n1]
   [junit4]   2> 972085 INFO  (coreLoadExecutor-4897-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 972089 INFO  (coreLoadExecutor-4897-thread-2) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 972107 INFO  (coreLoadExecutor-4897-thread-1) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 972111 INFO  (coreLoadExecutor-4897-thread-1) [    ] o.a.s.s.IndexSchema [awhollynewcollection_0_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 972112 INFO  (coreLoadExecutor-4897-thread-2) [    ] o.a.s.s.IndexSchema [awhollynewcollection_0_shard5_replica_n8] Schema name=minimal
   [junit4]   2> 972112 INFO  (coreLoadExecutor-4897-thread-1) [    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 972113 INFO  (coreLoadExecutor-4897-thread-2) [    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 972117 INFO  (coreLoadExecutor-4897-thread-2) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 972117 INFO  (coreLoadExecutor-4897-thread-1) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 972138 INFO  (coreLoadExecutor-4897-thread-2) [    ] o.a.s.s.IndexSchema [awhollynewcollection_0_shard5_replica_n8] Schema name=minimal
   [junit4]   2> 972138 INFO  (coreLoadExecutor-4897-thread-1) [    ] o.a.s.s.IndexSchema [awhollynewcollection_0_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 972139 INFO  (coreLoadExecutor-4897-thread-1) [    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 972139 INFO  (coreLoadExecutor-4897-thread-2) [    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 972139 INFO  (coreLoadExecutor-4897-thread-1) [    ] o.a.s.c.CoreContainer Creating SolrCore 'awhollynewcollection_0_shard1_replica_n1' using configuration from collection awhollynewcollection_0, trusted=true
   [junit4]   2> 972139 INFO  (coreLoadExecutor-4897-thread-2) [    ] o.a.s.c.CoreContainer Creating SolrCore 'awhollynewcollection_0_shard5_replica_n8' using configuration from collection awhollynewcollection_0, trusted=true
   [junit4]   2> 972139 INFO  (coreLoadExecutor-4897-thread-2) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.awhollynewcollection_0.shard5.replica_n8' (registry 'solr.core.awhollynewcollection_0.shard5.replica_n8') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36776a72
   [junit4]   2> 972139 INFO  (coreLoadExecutor-4897-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.awhollynewcollection_0.shard1.replica_n1' (registry 'solr.core.awhollynewcollection_0.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@36776a72
   [junit4]   2> 972139 INFO  (coreLoadExecutor-4897-thread-2) [    ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 972139 INFO  (coreLoadExecutor-4897-thread-1) [    ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 972139 INFO  (coreLoadExecutor-4897-thread-2) [    ] o.a.s.c.SolrCore [[awhollynewcollection_0_shard5_replica_n8] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2C209BD83716278-001/tempDir-001/node4/awhollynewcollection_0_shard5_replica_n8], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2C209BD83716278-001/tempDir-001/node4/awhollynewcollection_0_shard5_replica_n8/data/]
   [junit4]   2> 972139 INFO  (coreLoadExecutor-4897-thread-1) [    ] o.a.s.c.SolrCore [[awhollynewcollection_0_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2C209BD83716278-001/tempDir-001/node4/awhollynewcollection_0_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2C209BD83716278-001/tempDir-001/node4/awhollynewcollection_0_shard1_replica_n1/data/]
   [junit4]   2> 972154 INFO  (zkCallback-2715-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 972154 INFO  (zkCallback-2716-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 972154 INFO  (zkCallback-2715-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 972154 INFO  (zkCallback-2716-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 972154 INFO  (zkCallback-2731-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 972154 INFO  (zkCallback-2731-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 972154 INFO  (zkCallback-2713-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 972154 INFO  (zkCallback-2713-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/awhollynewcollection_0/state.json] for collection [awhollynewcollection_0] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 972160 INFO  (coreLoadExecutor-4897-thread-1) [    ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 972160 INFO  (coreLoadExecutor-4897-thread-2) [    ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 972160 INFO  (coreLoadExecutor-4897-thread-1) [    ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 972160 INFO  (coreLoadExecutor-4897-thread-2) [    ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 972160 INFO  (coreLoadExecutor-4897-thread-1) [    ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 972160 INFO  (coreLoadExecutor-4897-thread-2) [    ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 972160 INFO  (coreLoadExecutor-4897-thread-1) [    ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 972160 INFO  (coreLoadExecutor-4897-thread-2) [    ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 972161 INFO  (coreLoadExecutor-4897-thread-1) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@5b52b851[awhollynewcollection_0_shard1_replica_n1] main]
   [junit4]   2> 972161 INFO  (coreLoadExecutor-4897-thread-2) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@1407f127[awhollynewcollection_0_shard5_replica_n8] main]
   [junit4]   2> 972162 INFO  (coreLoadExecutor-4897-thread-1) [    ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf2
   [junit4]   2> 972162 INFO  (coreLoadExecutor-4897-thread-2) [    ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf2
   [junit4]   2> 972162 INFO  (coreLoadExecutor-4897-thread-1) [    ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf2
   [junit4]   2> 972162 INFO  (coreLoadExecutor-4897-thread-2) [    ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf2
   [junit4]   2> 972162 INFO  (coreLoadExecutor-4897-thread-1) [    ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 972162 INFO  (coreLoadExecutor-4897-thread-2) [    ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 972163 INFO  (searcherExecutor-4899-thread-1) [    ] o.a.s.c.SolrCore [awhollynewcollection_0_shard5_replica_n8] Registered new searcher Searcher@1407f127[awhollynewcollection_0_shard5_replica_n8] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 972163 INFO  (searcherExecutor-4898-thread-1) [    ] o.a.s.c.SolrCore [awhollynewcollection_0_shard1_replica_n1] Registered new searcher Searcher@5b52b851[awhollynewcollection_0_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 972163 INFO  (coreLoadExecutor-4897-thread-2) [    ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582266054694928384
   [junit4]   2> 972163 INFO  (coreLoadExecutor-4897-thread-1) [    ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582266054694928384
   [junit4]   2> 972164 ERROR (TEST-CollectionsAPIDistributedZkTest.testCollectionsAPI-seed#[2C209BD83716278]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any 

[...truncated too long message...]

cuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 
   [junit4]   2> 1055031 INFO  (qtp72167170-14297) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:42349_solr&onlyIfLeaderActive=true&core=addReplicaColl_shard1_replica_n2&coreNodeName=core_node10&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=400 QTime=8002
   [junit4]   2> 1055778 WARN  (zkCallback-2715-thread-1) [    ] o.a.s.c.ZkController Unable to register nodeLost path for 127.0.0.1:42349_solr
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling/nodeLost/127.0.0.1:42349_solr
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.lambda$create$7(SolrZkClient.java:357)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:357)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.lambda$registerLiveNodesListener$2(ZkController.java:879)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.lambda$refreshLiveNodes$1(ZkStateReader.java:749)
   [junit4]   2> 	at java.base/java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4724)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:748)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.access$1000(ZkStateReader.java:72)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1154)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1149)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$0(SolrZkClient.java:262)
   [junit4]   2> 	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
   [junit4]   2> 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 1055779 INFO  (jetty-closer-2695-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@16cc5dd0{/solr,null,UNAVAILABLE}
   [junit4]   2> 1055780 WARN  (zkCallback-2713-thread-5) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1055780 INFO  (jetty-closer-2695-thread-4) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@43ad0972{/solr,null,UNAVAILABLE}
   [junit4]   2> 1055783 INFO  (jetty-closer-2695-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3fb75122{/solr,null,UNAVAILABLE}
   [junit4]   2> 1055783 ERROR (SUITE-CollectionsAPIDistributedZkTest-seed#[2C209BD83716278]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1055784 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[2C209BD83716278]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:44579 44579
   [junit4]   2> 1055790 INFO  (Thread-4824) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:44579 44579
   [junit4]   2> 1055791 WARN  (Thread-4824) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	22	/solr/configs/conf
   [junit4]   2> 	18	/solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	44	/solr/collections/addReplicaColl/state.json
   [junit4]   2> 	32	/solr/collections/reloaded_collection/state.json
   [junit4]   2> 	24	/solr/collections/nodes_used_collection/state.json
   [junit4]   2> 	18	/solr/clusterprops.json
   [junit4]   2> 	18	/solr/clusterstate.json
   [junit4]   2> 	13	/solr/collections/acollectionafterbaddelete/state.json
   [junit4]   2> 	13	/solr/collections/halfdeletedcollection/state.json
   [junit4]   2> 	10	/solr/collections/onlyinzk/state.json
   [junit4]   2> 	5	/solr/collections/created_and_deleted/state.json
   [junit4]   2> 	5	/solr/collections/withconfigset2/state.json
   [junit4]   2> 	4	/solr/collections/halfcollectionblocker/state.json
   [junit4]   2> 	4	/solr/collections/awhollynewcollection_0/state.json
   [junit4]   2> 	4	/solr/collections/halfcollection/state.json
   [junit4]   2> 	4	/solr/collections/halfcollectionblocker2/state.json
   [junit4]   2> 	2	/solr/collections/addReplicaColl/leader_elect/shard1/election/98891628275367945-core_node5-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	332	/solr/collections
   [junit4]   2> 	18	/solr/live_nodes
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2C209BD83716278-001
   [junit4]   2> Oct 25, 2017 9:23:01 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=18034, maxDocsPerChunk=982, blockSize=258), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=18034, blockSize=258)), sim=RandomSimilarity(queryNorm=true): {}, locale=fo-DK, timezone=Etc/GMT+6
   [junit4]   2> NOTE: Linux 4.10.0-33-generic amd64/Oracle Corporation 9 (64-bit)/cpus=8,threads=1,free=271478128,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [TestRecoveryHdfs, DocValuesMissingTest, RequiredFieldsTest, DistributedFacetPivotWhiteBoxTest, TestSolrCoreParser, TestCSVResponseWriter, ScriptEngineTest, TestCopyFieldCollectionResource, OverseerTest, TestJsonRequest, TestClusterProperties, TestLRUStatsCache, TestFuzzyAnalyzedSuggestions, TestCoreDiscovery, DocExpirationUpdateProcessorFactoryTest, TestRTimerTree, NodeLostTriggerTest, TestLocalFSCloudBackupRestore, TestManagedSchemaAPI, FieldMutatingUpdateProcessorTest, UniqFieldsUpdateProcessorFactoryTest, TestDistributedMissingSort, SubstringBytesRefFilterTest, PropertiesRequestHandlerTest, TestFieldTypeResource, TestIndexSearcher, IndexSchemaTest, LoggingHandlerTest, XsltUpdateRequestHandlerTest, AutoscalingHistoryHandlerTest, SuggesterTest, RestartWhileUpdatingTest, TestEmbeddedSolrServerConstructors, TestCloudPseudoReturnFields, HdfsDirectoryTest, AsyncCallRequestStatusResponseTest, TestCharFilters, TestNumericTokenStream, TestStreamBody, TestConfigReload, PreAnalyzedFieldManagedSchemaCloudTest, TestSolrXml, CoreSorterTest, TestUninvertingReader, TestElisionMultitermQuery, FullHLLTest, TestSolrCoreProperties, TestLMJelinekMercerSimilarityFactory, CdcrReplicationDistributedZkTest, TestCoreContainer, OverseerTaskQueueTest, TestMinMaxOnMultiValuedField, TestCollapseQParserPlugin, BadComponentTest, TestMultiValuedNumericRangeQuery, UpdateLogTest, DistributedSuggestComponentTest, TestGraphTermsQParserPlugin, TestConfigSetsAPI, TestMultiWordSynonyms, TestHashPartitioner, IndexBasedSpellCheckerTest, TestCryptoKeys, TestExtendedDismaxParser, WrapperMergePolicyFactoryTest, TestClassicSimilarityFactory, SaslZkACLProviderTest, TestShardHandlerFactory, HdfsCollectionsAPIDistributedZkTest, HighlighterTest, BlockCacheTest, TestSimpleQParserPlugin, TestConfigSets, TestSchemaManager, UtilsToolTest, TestSQLHandlerNonCloud, AutoScalingHandlerTest, RuleEngineTest, TestFileDictionaryLookup, TestUnifiedSolrHighlighter, FullSolrCloudDistribCmdsTest, TestStressUserVersions, TestSolrQueryResponse, TestReqParamsAPI, DocValuesNotIndexedTest, SolrIndexMetricsTest, TestNamedUpdateProcessors, HttpSolrCallGetCoreTest, TestDistribIDF, SuggesterWFSTTest, CdcrVersionReplicationTest, TlogReplayBufferedWhileIndexingTest, EchoParamsTest, TestQuerySenderListener, XmlUpdateRequestHandlerTest, RequestLoggingTest, TestFiltering, DirectSolrSpellCheckerTest, RecoveryZkTest, SimplePostToolTest, AliasIntegrationTest, ConnectionReuseTest, SolrMetricReporterTest, TestFieldCacheSortRandom, UUIDFieldTest, LeaderElectionContextKeyTest, TestSearchPerf, DistributedSpellCheckComponentTest, TestGroupingSearch, TestRequestStatusCollectionAPI, TestLegacyFieldReuse, FieldAnalysisRequestHandlerTest, TestConfigsApi, DeleteNodeTest, TestTrie, AlternateDirectoryTest, WordBreakSolrSpellCheckerTest, TestRebalanceLeaders, TestCustomDocTransformer, DistribJoinFromCollectionTest, LeaderInitiatedRecoveryOnCommitTest, UnloadDistributedZkTest, TestSolrCloudWithDelegationTokens, BasicDistributedZkTest, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest]
   [junit4] Completed [377/744 (1!)] on J2 in 86.33s, 19 tests, 1 error <<< FAILURES!

[...truncated 41337 lines...]

[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk-9) - Build # 668 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/668/
Java: 64bit/jdk-9 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC --illegal-access=deny

3 tests failed.
FAILED:  org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeLostTriggerRestoreState

Error Message:
The trigger did not fire at all

Stack Trace:
java.lang.AssertionError: The trigger did not fire at all
	at __randomizedtesting.SeedInfo.seed([5DFA10EE1C659877:7605C5B5861D8DA7]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeLostTriggerRestoreState(TriggerIntegrationTest.java:344)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI

Error Message:
Error from server at http://127.0.0.1:44551/solr/awhollynewcollection_0: {"awhollynewcollection_0":5}

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:44551/solr/awhollynewcollection_0: {"awhollynewcollection_0":5}
	at __randomizedtesting.SeedInfo.seed([5DFA10EE1C659877:158F645A1A56B7E2]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:626)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:867)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:972)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:972)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:972)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:972)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:972)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:460)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory

Error Message:
replica never fully recovered

Stack Trace:
java.lang.AssertionError: replica never fully recovered
	at __randomizedtesting.SeedInfo.seed([5DFA10EE1C659877:3006B413A62D6770]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.waitForRecovery(AutoscalingHistoryHandlerTest.java:303)
	at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory(AutoscalingHistoryHandlerTest.java:255)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 1716 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/test/temp/junit4-J1-20171025_174040_74213694681009236010860.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/test/temp/junit4-J2-20171025_174040_7421140466823336884270.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/test/temp/junit4-J0-20171025_174040_7425353127630048238775.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 293 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/test/temp/junit4-J2-20171025_174553_4131237839650363349245.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/test/temp/junit4-J1-20171025_174553_4134310886113934292056.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 9 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/test/temp/junit4-J0-20171025_174553_4136084279608391604194.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 1054 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/common/test/temp/junit4-J1-20171025_174702_47113030114767801439990.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/common/test/temp/junit4-J0-20171025_174702_4729253180349625821215.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/common/test/temp/junit4-J2-20171025_174702_47214196345681230608710.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 228 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/icu/test/temp/junit4-J1-20171025_174828_37917381913230767242430.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/icu/test/temp/junit4-J2-20171025_174828_3799660051015316207773.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/icu/test/temp/junit4-J0-20171025_174828_3792495479602601339384.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 252 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J0-20171025_174837_7954073438991989276034.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J1-20171025_174837_7955000889166451339618.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J2-20171025_174837_7953533334004051089727.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 154 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J1-20171025_174902_5101702837245701589986.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J0-20171025_174902_5117070044385835737689.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J2-20171025_174902_51114653997507229210955.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 166 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J1-20171025_174905_83813538642808124956911.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J2-20171025_174905_83816251339229851896738.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J0-20171025_174905_83812263620977906558639.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 153 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J0-20171025_174914_6299801856579866048659.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J1-20171025_174914_6297929247812584871646.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 157 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/stempel/test/temp/junit4-J2-20171025_174920_65810185456525088553154.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/stempel/test/temp/junit4-J1-20171025_174920_6585910218014263486917.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/stempel/test/temp/junit4-J0-20171025_174920_65814771523871506855274.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 169 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/uima/test/temp/junit4-J0-20171025_174923_2371082266022108955894.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 192 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/backward-codecs/test/temp/junit4-J1-20171025_174929_7725753711123497017990.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 22 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/backward-codecs/test/temp/junit4-J0-20171025_174929_77210117256851914213895.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 9 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/backward-codecs/test/temp/junit4-J2-20171025_174929_7724873280916397609364.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 1260 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/benchmark/test/temp/junit4-J1-20171025_175112_2745086801674408078264.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/benchmark/test/temp/junit4-J2-20171025_175112_27411014969409778236944.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/benchmark/test/temp/junit4-J0-20171025_175112_2746603171381492906735.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 233 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/classification/test/temp/junit4-J1-20171025_175119_3545701673554659173627.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/classification/test/temp/junit4-J0-20171025_175119_35410868541837154975984.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/classification/test/temp/junit4-J2-20171025_175119_35411394346992386316093.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 243 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/test/temp/junit4-J1-20171025_175127_3845107066742551344709.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 10 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/test/temp/junit4-J2-20171025_175127_38416413567231814691060.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 12 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/test/temp/junit4-J0-20171025_175127_38414797065151389113046.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 238 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/demo/test/temp/junit4-J1-20171025_175313_58417365750801551025457.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/demo/test/temp/junit4-J2-20171025_175313_58412565147742516867572.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/demo/test/temp/junit4-J0-20171025_175313_5832270032523946996680.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 170 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/expressions/test/temp/junit4-J2-20171025_175316_19211862963707955621121.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/expressions/test/temp/junit4-J1-20171025_175316_1926865157645384984719.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/expressions/test/temp/junit4-J0-20171025_175316_19115350611864078878900.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 226 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/facet/test/temp/junit4-J2-20171025_175321_4199075068645536005331.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/facet/test/temp/junit4-J0-20171025_175321_4191702038034911474495.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/facet/test/temp/junit4-J1-20171025_175321_41913795674465227443214.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 179 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/grouping/test/temp/junit4-J1-20171025_175353_5317645775987947421744.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/grouping/test/temp/junit4-J2-20171025_175353_53116942138010812192443.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/grouping/test/temp/junit4-J0-20171025_175353_53114916632158380629960.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 243 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/highlighter/test/temp/junit4-J0-20171025_175400_9909459744869605356813.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/highlighter/test/temp/junit4-J2-20171025_175400_99013043432672976093190.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/highlighter/test/temp/junit4-J1-20171025_175400_99014364737727437653984.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 160 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/join/test/temp/junit4-J2-20171025_175419_5786784452027848804056.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/join/test/temp/junit4-J0-20171025_175419_57817393127017500974109.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/join/test/temp/junit4-J1-20171025_175419_57811017012659801794892.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 149 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/memory/test/temp/junit4-J0-20171025_175438_8033734633939446497378.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/memory/test/temp/junit4-J1-20171025_175438_803690243130285491772.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 178 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/misc/test/temp/junit4-J2-20171025_175446_499738700036437011976.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 5 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/misc/test/temp/junit4-J1-20171025_175446_49912814515899346914915.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/misc/test/temp/junit4-J0-20171025_175446_49911870936268839612551.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 312 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queries/test/temp/junit4-J0-20171025_175458_68415313661671367270619.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queries/test/temp/junit4-J2-20171025_175458_68411398364602866409360.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queries/test/temp/junit4-J1-20171025_175458_6842097226161829429692.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 224 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queryparser/test/temp/junit4-J1-20171025_175505_2272451112601715816546.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queryparser/test/temp/junit4-J0-20171025_175505_2278719394701238331740.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queryparser/test/temp/junit4-J2-20171025_175505_2305850013421233603167.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 207 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/replicator/test/temp/junit4-J1-20171025_175511_59111154601289984851152.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/replicator/test/temp/junit4-J2-20171025_175511_59118272084445702999733.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/replicator/test/temp/junit4-J0-20171025_175511_59111420177117555972091.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 220 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/sandbox/test/temp/junit4-J2-20171025_175523_4096918081405380015174.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/sandbox/test/temp/junit4-J0-20171025_175523_4091601053774149030716.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/sandbox/test/temp/junit4-J1-20171025_175523_4092032961750451325071.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 415 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial-extras/test/temp/junit4-J1-20171025_175605_6489952577286978857421.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial-extras/test/temp/junit4-J0-20171025_175605_6482319516000839015356.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial-extras/test/temp/junit4-J2-20171025_175605_6486921260429350008349.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 148 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial/test/temp/junit4-J0-20171025_175618_64912413999654470878774.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 166 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial3d/test/temp/junit4-J2-20171025_175620_3751886115844027775272.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial3d/test/temp/junit4-J0-20171025_175620_37413289908817324133249.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 11 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial3d/test/temp/junit4-J1-20171025_175620_37416661728705799262008.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 247 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/suggest/test/temp/junit4-J0-20171025_175729_6871225838263146437652.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/suggest/test/temp/junit4-J1-20171025_175729_6879626336671811240024.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/suggest/test/temp/junit4-J2-20171025_175729_68713376308277646457046.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 1948 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_5DFA10EE1C659877-001/init-core-data-001
   [junit4]   2> 242578 WARN  (SUITE-CollectionsAPIDistributedZkTest-seed#[5DFA10EE1C659877]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=16 numCloses=16
   [junit4]   2> 242578 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[5DFA10EE1C659877]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 242578 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[5DFA10EE1C659877]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 242578 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[5DFA10EE1C659877]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 242579 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[5DFA10EE1C659877]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_5DFA10EE1C659877-001/tempDir-001
   [junit4]   2> 242579 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[5DFA10EE1C659877]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 242579 INFO  (Thread-847) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 242579 INFO  (Thread-847) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 242580 ERROR (Thread-847) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 242679 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[5DFA10EE1C659877]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:43601
   [junit4]   2> 242686 INFO  (jetty-launcher-448-thread-3) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 242686 INFO  (jetty-launcher-448-thread-4) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 242686 INFO  (jetty-launcher-448-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 242686 INFO  (jetty-launcher-448-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 242690 INFO  (jetty-launcher-448-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@30aaaa61{/solr,null,AVAILABLE}
   [junit4]   2> 242691 INFO  (jetty-launcher-448-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1a5a785b{/solr,null,AVAILABLE}
   [junit4]   2> 242692 INFO  (jetty-launcher-448-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7d2add08{/solr,null,AVAILABLE}
   [junit4]   2> 242692 INFO  (jetty-launcher-448-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7dc42b90{/solr,null,AVAILABLE}
   [junit4]   2> 242695 INFO  (jetty-launcher-448-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@30e84553{HTTP/1.1,[http/1.1]}{127.0.0.1:33945}
   [junit4]   2> 242695 INFO  (jetty-launcher-448-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@6d599fe4{HTTP/1.1,[http/1.1]}{127.0.0.1:40961}
   [junit4]   2> 242695 INFO  (jetty-launcher-448-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@6903e9cc{HTTP/1.1,[http/1.1]}{127.0.0.1:45045}
   [junit4]   2> 242695 INFO  (jetty-launcher-448-thread-4) [    ] o.e.j.s.Server Started @244255ms
   [junit4]   2> 242695 INFO  (jetty-launcher-448-thread-2) [    ] o.e.j.s.Server Started @244255ms
   [junit4]   2> 242695 INFO  (jetty-launcher-448-thread-3) [    ] o.e.j.s.Server Started @244255ms
   [junit4]   2> 242695 INFO  (jetty-launcher-448-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45045}
   [junit4]   2> 242695 INFO  (jetty-launcher-448-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33945}
   [junit4]   2> 242695 INFO  (jetty-launcher-448-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@70c0f70{HTTP/1.1,[http/1.1]}{127.0.0.1:44551}
   [junit4]   2> 242695 INFO  (jetty-launcher-448-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40961}
   [junit4]   2> 242695 INFO  (jetty-launcher-448-thread-1) [    ] o.e.j.s.Server Started @244256ms
   [junit4]   2> 242695 ERROR (jetty-launcher-448-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 242695 INFO  (jetty-launcher-448-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44551}
   [junit4]   2> 242695 ERROR (jetty-launcher-448-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 242696 INFO  (jetty-launcher-448-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 242696 INFO  (jetty-launcher-448-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 242696 INFO  (jetty-launcher-448-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 242696 ERROR (jetty-launcher-448-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 242696 INFO  (jetty-launcher-448-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 242696 ERROR (jetty-launcher-448-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 242696 INFO  (jetty-launcher-448-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 242696 INFO  (jetty-launcher-448-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 242696 INFO  (jetty-launcher-448-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 242696 INFO  (jetty-launcher-448-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 242696 INFO  (jetty-launcher-448-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 242696 INFO  (jetty-launcher-448-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 242696 INFO  (jetty-launcher-448-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T18:02:23.694610Z
   [junit4]   2> 242696 INFO  (jetty-launcher-448-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T18:02:23.694701Z
   [junit4]   2> 242696 INFO  (jetty-launcher-448-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 242696 INFO  (jetty-launcher-448-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 242696 INFO  (jetty-launcher-448-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T18:02:23.694825Z
   [junit4]   2> 242696 INFO  (jetty-launcher-448-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T18:02:23.694868Z
   [junit4]   2> 242703 INFO  (jetty-launcher-448-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 242703 INFO  (jetty-launcher-448-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 242703 INFO  (jetty-launcher-448-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 242704 INFO  (jetty-launcher-448-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 242707 INFO  (jetty-launcher-448-thread-3) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 242707 INFO  (jetty-launcher-448-thread-3) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 242707 INFO  (jetty-launcher-448-thread-2) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 242707 INFO  (jetty-launcher-448-thread-2) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 242708 INFO  (jetty-launcher-448-thread-4) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 242708 INFO  (jetty-launcher-448-thread-4) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 242708 INFO  (jetty-launcher-448-thread-1) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 242708 INFO  (jetty-launcher-448-thread-1) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 242709 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f54b315d90004, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 242710 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f54b315d90003, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 242713 INFO  (jetty-launcher-448-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43601/solr
   [junit4]   2> 242713 INFO  (jetty-launcher-448-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43601/solr
   [junit4]   2> 242715 INFO  (jetty-launcher-448-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43601/solr
   [junit4]   2> 242717 INFO  (jetty-launcher-448-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43601/solr
   [junit4]   2> 242748 INFO  (jetty-launcher-448-thread-3) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 242749 INFO  (jetty-launcher-448-thread-3) [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33945_solr
   [junit4]   2> 242750 INFO  (jetty-launcher-448-thread-3) [    ] o.a.s.c.Overseer Overseer (id=98890844967862283-127.0.0.1:33945_solr-n_0000000000) starting
   [junit4]   2> 242757 INFO  (jetty-launcher-448-thread-1) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 242757 INFO  (jetty-launcher-448-thread-3) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33945_solr
   [junit4]   2> 242759 INFO  (OverseerStateUpdate-98890844967862283-127.0.0.1:33945_solr-n_0000000000) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 242759 INFO  (zkCallback-472-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 242761 INFO  (jetty-launcher-448-thread-1) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44551_solr
   [junit4]   2> 242768 INFO  (zkCallback-472-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 242769 INFO  (zkCallback-469-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 242822 INFO  (jetty-launcher-448-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 242823 INFO  (jetty-launcher-448-thread-2) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 242825 INFO  (jetty-launcher-448-thread-4) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 242826 INFO  (jetty-launcher-448-thread-4) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 242826 INFO  (jetty-launcher-448-thread-4) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40961_solr
   [junit4]   2> 242827 INFO  (zkCallback-469-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 242827 INFO  (zkCallback-472-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 242827 INFO  (zkCallback-465-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 242829 INFO  (jetty-launcher-448-thread-2) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45045_solr
   [junit4]   2> 242829 INFO  (zkCallback-472-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 242830 INFO  (zkCallback-465-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 242830 INFO  (zkCallback-469-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 242832 INFO  (zkCallback-468-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 242833 INFO  (zkCallback-468-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 242835 INFO  (jetty-launcher-448-thread-3) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4db09985
   [junit4]   2> 242840 INFO  (jetty-launcher-448-thread-3) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4db09985
   [junit4]   2> 242840 INFO  (jetty-launcher-448-thread-3) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4db09985
   [junit4]   2> 242841 INFO  (jetty-launcher-448-thread-3) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_5DFA10EE1C659877-001/tempDir-001/node3
   [junit4]   2> 242850 INFO  (jetty-launcher-448-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4db09985
   [junit4]   2> 242861 INFO  (jetty-launcher-448-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4db09985
   [junit4]   2> 242861 INFO  (jetty-launcher-448-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4db09985
   [junit4]   2> 242862 INFO  (jetty-launcher-448-thread-1) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_5DFA10EE1C659877-001/tempDir-001/node1
   [junit4]   2> 242873 INFO  (jetty-launcher-448-thread-2) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4db09985
   [junit4]   2> 242875 INFO  (jetty-launcher-448-thread-4) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4db09985
   [junit4]   2> 242878 INFO  (jetty-launcher-448-thread-2) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4db09985
   [junit4]   2> 242878 INFO  (jetty-launcher-448-thread-2) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4db09985
   [junit4]   2> 242879 INFO  (jetty-launcher-448-thread-2) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_5DFA10EE1C659877-001/tempDir-001/node2
   [junit4]   2> 242880 INFO  (jetty-launcher-448-thread-4) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4db09985
   [junit4]   2> 242880 INFO  (jetty-launcher-448-thread-4) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4db09985
   [junit4]   2> 242881 INFO  (jetty-launcher-448-thread-4) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_5DFA10EE1C659877-001/tempDir-001/node4
   [junit4]   2> 242918 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[5DFA10EE1C659877]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 242918 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[5DFA10EE1C659877]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43601/solr ready
   [junit4]   2> 242929 INFO  (TEST-CollectionsAPIDistributedZkTest.addReplicaTest-seed#[5DFA10EE1C659877]) [    ] o.a.s.SolrTestCaseJ4 ###Starting addReplicaTest
   [junit4]   2> 242929 INFO  (TEST-CollectionsAPIDistributedZkTest.addReplicaTest-seed#[5DFA10EE1C659877]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 242932 INFO  (qtp1580116338-2800) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&maxShardsPerNode=4&name=addReplicaColl&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 242935 INFO  (OverseerThreadFactory-873-thread-1) [    ] o.a.s.c.CreateCollectionCmd Create collection addReplicaColl
   [junit4]   2> 243043 INFO  (OverseerStateUpdate-98890844967862283-127.0.0.1:33945_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"addReplicaColl",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"addReplicaColl_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:33945/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 243045 INFO  (OverseerStateUpdate-98890844967862283-127.0.0.1:33945_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"addReplicaColl",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"addReplicaColl_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:44551/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 243047 INFO  (OverseerStateUpdate-98890844967862283-127.0.0.1:33945_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"addReplicaColl",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"addReplicaColl_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:45045/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 243048 INFO  (OverseerStateUpdate-98890844967862283-127.0.0.1:33945_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"addReplicaColl",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"addReplicaColl_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:40961/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 243253 INFO  (qtp1580116338-2783) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf&newCollection=true&name=addReplicaColl_shard1_replica_n2&action=CREATE&numShards=2&collection=addReplicaColl&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 243254 INFO  (qtp1643211239-2801) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=addReplicaColl_shard2_replica_n4&action=CREATE&numShards=2&collection=addReplicaColl&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 243254 INFO  (qtp1580116338-2783) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 243254 INFO  (qtp499751496-2791) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=addReplicaColl_shard1_replica_n1&action=CREATE&numShards=2&collection=addReplicaColl&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 243254 INFO  (qtp1643211239-2801) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 243254 INFO  (qtp1962692915-2796) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf&newCollection=true&name=addReplicaColl_shard2_replica_n6&action=CREATE&numShards=2&collection=addReplicaColl&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 243254 INFO  (qtp499751496-2791) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 243254 INFO  (qtp1962692915-2796) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 243362 INFO  (zkCallback-468-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 243362 INFO  (zkCallback-468-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 243362 INFO  (zkCallback-469-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 243362 INFO  (zkCallback-465-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 243362 INFO  (zkCallback-472-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 243362 INFO  (zkCallback-465-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 243362 INFO  (zkCallback-469-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 243363 INFO  (zkCallback-472-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/addReplicaColl/state.json] for collection [addReplicaColl] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 244273 INFO  (qtp1643211239-2801) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 244273 INFO  (qtp499751496-2791) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 244274 INFO  (qtp1580116338-2783) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 244274 INFO  (qtp1962692915-2796) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 244281 INFO  (qtp1643211239-2801) [    ] o.a.s.s.IndexSchema [addReplicaColl_shard2_replica_n4] Schema name=minimal
   [junit4]   2> 244281 INFO  (qtp1962692915-2796) [    ] o.a.s.s.IndexSchema [addReplicaColl_shard2_replica_n6] Schema name=minimal
   [junit4]   2> 244281 INFO  (qtp1580116338-2783) [    ] o.a.s.s.IndexSchema [addReplicaColl_shard1_replica_n2] Schema name=minimal
   [junit4]   2> 244281 INFO  (qtp499751496-2791) [    ] o.a.s.s.IndexSchema [addReplicaColl_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 244288 INFO  (qtp1643211239-2801) [    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 244288 INFO  (qtp1643211239-2801) [    ] o.a.s.c.CoreContainer Creating SolrCore 'addReplicaColl_shard2_replica_n4' using configuration from collection addReplicaColl, trusted=true
   [junit4]   2> 244288 INFO  (qtp499751496-2791) [    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 244289 INFO  (qtp499751496-2791) [    ] o.a.s.c.CoreContainer Creating SolrCore 'addReplicaColl_shard1_replica_n1' using configuration from collection addReplicaColl, trusted=true
   [junit4]   2> 244289 INFO  (qtp1643211239-2801) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.addReplicaColl.shard2.replica_n4' (registry 'solr.core.addReplicaColl.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4db09985
   [junit4]   2> 244289 INFO  (qtp1580116338-2783) [    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 244289 INFO  (qtp1580116338-2783) [    ] o.a.s.c.CoreContainer Creating SolrCore 'addReplicaColl_shard1_replica_n2' using configuration from collection addReplicaColl, trusted=true
   [junit4]   2> 244289 INFO  (qtp1643211239-2801) [    ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 244289 INFO  (qtp1643211239-2801) [    ] o.a.s.c.SolrCore [[addReplicaColl_shard2_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_5DFA10EE1C659877-001/tempDir-001/node2/addReplicaColl_shard2_replica_n4], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_5DFA10EE1C659877-001/tempDir-001/node2/addReplicaColl_shard2_replica_n4/data/]
   [junit4]   2> 244289 INFO  (qtp499751496-2791) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.addReplicaColl.shard1.replica_n1' (registry 'solr.core.addReplicaColl.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4db09985
   [junit4]   2> 244289 INFO  (qtp1962692915-2796) [    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 244289 INFO  (qtp1962692915-2796) [    ] o.a.s.c.CoreContainer Creating SolrCore 'addReplicaColl_shard2_replica_n6' using configuration from collection addReplicaColl, trusted=true
   [junit4]   2> 244289 INFO  (qtp499751496-2791) [    ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 244289 INFO  (qtp1580116338-2783) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.addReplicaColl.shard1.replica_n2' (registry 'solr.core.addReplicaColl.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4db09985
   [junit4]   2> 244289 INFO  (qtp499751496-2791) [    ] o.a.s.c.SolrCore [[addReplicaColl_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_5DFA10EE1C659877-001/tempDir-001/node3/addReplicaColl_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_5DFA10EE1C659877-001/tempDir-001/node3/addReplicaColl_shard1_replica_n1/data/]
   [junit4]   2> 244290 INFO  (qtp1580116338-2783) [    ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 244290 INFO  (qtp1580116338-2783) [    ] o.a.s.c.SolrCore [[addReplicaColl_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_5DFA10EE1C659877-001/tempDir-001/node1/addReplicaColl_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_5DFA10EE1C659877-001/tempDir-001/node1/addReplicaColl_shard1_replica_n2/data/]
   [junit4]   2> 244290 INFO  (qtp1962692915-2796) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.addReplicaColl.shard2.replica_n6' (registry 'solr.core.addReplicaColl.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4db09985
   [junit4]   2> 244290 INFO  (qtp1962692915-2796) [    ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 244290 INFO  (qtp1962692915-2796) [    ] o.a.s.c.SolrCore [[addReplicaColl_shard2_replica_n6] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_5DFA10EE1C659877-001/tempDir-001/node4/addReplicaColl_shard2_replica_n6], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_5DFA10EE1C659877-001/tempDir-001/node4/addReplicaColl_shard2_replica_n6/data/]
   [junit4]   2> 244361 INFO  (qtp1643211239-2801) [    ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 244361 INFO  (qtp1643211239-2801) [    ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 244362 INFO  (qtp1643211239-2801) [    ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 244362 INFO  (qtp1643211239-2801) [    ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 244364 INFO  (qtp1643211239-2801) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@16c562b2[addReplicaColl_shard2_replica_n4] main]
   [junit4]   2> 244364 INFO  (qtp1643211239-2801) [    ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 244365 INFO  (qtp1643211239-2801) [    ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 244365 INFO  (qtp1643211239-2801) [    ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 244365 INFO  (qtp1580116338-2783) [    ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 244365 INFO  (qtp1580116338-2783) [    ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 244366 INFO  (searcherExecutor-882-thread-1) [    ] o.a.s.c.SolrCore [addReplicaColl_shard2_replica_n4] Registered new searcher Searcher@16c562b2[addReplicaColl_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 244366 INFO  (qtp1643211239-2801) [    ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582253521359601664
   [junit4]   2> 244367 INFO  (qtp1580116338-2783) [    ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 244367 INFO  (qtp1580116338-2783) [    ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 244367 INFO  (qtp499751496-2791) [    ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 244367 INFO  (qtp499751496-2791) [    ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 244369 INFO  (qtp499751496-2791) [    ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 244369 INFO  (qtp499751496-2791) [    ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 244369 INFO  (qtp1580116338-2783) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@643f69e7[addReplicaColl_shard1_replica_n2] main]
   [junit4]   2> 244370 INFO  (qtp1580116338-2783) [    ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 244370 INFO  (qtp1580116338-2783) [    ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 244370 INFO  (qtp499751496-2791) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@6edd286d[addReplicaColl_shard1_replica_n1] main]
   [junit4]   2> 244371 INFO  (qtp1580116338-2783) [    ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 244371 INFO  (qtp499751496-2791) [    ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 244371 INFO  (qtp499751496-2791) [    ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 244371 INFO  (qtp1643211239-2801) [    ] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 244372 INFO  (searcherExecutor-884-thread-1) [    ] o.a.s.c.SolrCore [addReplicaColl_shard1_replica_n2] Registered new searcher Searcher@643f69e7[addReplicaColl_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 244372 INFO  (qtp1580116338-2783) [    ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582253521365893120
   [juni

[...truncated too long message...]

nexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-analytics/test/temp/junit4-J1-20171025_184411_78617063836577702150442.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-analytics/test/temp/junit4-J0-20171025_184411_7863823029021348157808.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 553 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J2-20171025_184513_97817211223145469477566.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J1-20171025_184513_97715680423806600900451.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J0-20171025_184513_97714255900568050712522.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 1259 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J1-20171025_184526_5349496862871287947747.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J0-20171025_184526_53413584464522802605151.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 647 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J2-20171025_184532_50218049573284507309895.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J1-20171025_184532_5025525678219282801189.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J0-20171025_184532_50211763806010938587182.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 557 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J0-20171025_184552_0361459237009393876007.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J2-20171025_184552_03711044301425113083311.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J1-20171025_184552_03610997365483093490753.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 563 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J1-20171025_184601_00611581359450095956633.syserr
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J0-20171025_184601_00613695127722364299644.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 646 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J1-20171025_184606_7462187202576440377918.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J2-20171025_184606_7465683127550138807216.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J0-20171025_184606_74615068172230291193911.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 596 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J1-20171025_184633_84812267439882768151618.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J0-20171025_184633_84815247669914597783730.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 548 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-velocity/test/temp/junit4-J0-20171025_184642_4875786049331595906150.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 31633 lines...]

[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk-9) - Build # 667 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/667/
Java: 64bit/jdk-9 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC --illegal-access=deny

2 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI

Error Message:
Error from server at https://127.0.0.1:39647/solr/awhollynewcollection_0: {"awhollynewcollection_0":6}

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:39647/solr/awhollynewcollection_0: {"awhollynewcollection_0":6}
	at __randomizedtesting.SeedInfo.seed([2FC15380B23D99A9:67B42734B40EB63C]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:626)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:867)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:972)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:972)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:972)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:972)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:972)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:460)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory

Error Message:
replica never fully recovered

Stack Trace:
java.lang.AssertionError: replica never fully recovered
	at __randomizedtesting.SeedInfo.seed([2FC15380B23D99A9:423DF77D087566AE]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.waitForRecovery(AutoscalingHistoryHandlerTest.java:303)
	at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory(AutoscalingHistoryHandlerTest.java:255)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 1718 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/test/temp/junit4-J2-20171025_145555_31717670439372394939041.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/test/temp/junit4-J1-20171025_145555_3171856267568521458743.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/core/test/temp/junit4-J0-20171025_145555_31715079889749147503999.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 288 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/test/temp/junit4-J2-20171025_150127_82014337033815260813229.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 9 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/test/temp/junit4-J1-20171025_150127_8203297138607021608854.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 5 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/test-framework/test/temp/junit4-J0-20171025_150127_82013037935971106282831.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 1054 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/common/test/temp/junit4-J2-20171025_150244_0638352619435882183691.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/common/test/temp/junit4-J0-20171025_150244_0633923808390646813013.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/common/test/temp/junit4-J1-20171025_150244_063664128582811417447.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 223 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/icu/test/temp/junit4-J1-20171025_150413_12418258083153406375394.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/icu/test/temp/junit4-J0-20171025_150413_12416005248841140763841.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 5 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/icu/test/temp/junit4-J2-20171025_150413_12410678022579934426640.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 249 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J0-20171025_150423_50416034113722334196453.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J1-20171025_150423_50410054097828220988552.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J2-20171025_150423_50415994248281226810189.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 154 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J1-20171025_150447_9609831919823911326235.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J0-20171025_150447_96017209590388894133404.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J2-20171025_150447_960176797595129997011.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 163 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J2-20171025_150453_01713868065986073183109.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J0-20171025_150453_01718032530096349589456.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J1-20171025_150453_0177969496297867258574.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 153 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J0-20171025_150502_09617185288784581466367.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J1-20171025_150502_09615747919335477635153.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 157 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/stempel/test/temp/junit4-J2-20171025_150509_6471004580784012843964.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/stempel/test/temp/junit4-J1-20171025_150509_6472071461667855999658.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/stempel/test/temp/junit4-J0-20171025_150509_6474608223367481692060.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 169 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/analysis/uima/test/temp/junit4-J0-20171025_150512_0224397154646591680144.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 195 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/backward-codecs/test/temp/junit4-J1-20171025_150518_1206579179216741662997.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 19 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/backward-codecs/test/temp/junit4-J0-20171025_150518_12012763999243161714746.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 9 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/backward-codecs/test/temp/junit4-J2-20171025_150518_1202763576703644943100.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 1260 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/benchmark/test/temp/junit4-J1-20171025_150647_59110056680175636770347.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/benchmark/test/temp/junit4-J2-20171025_150647_59110478768987718113513.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/benchmark/test/temp/junit4-J0-20171025_150647_59010332101382804115788.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 233 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/classification/test/temp/junit4-J1-20171025_150654_74414402774914916508622.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/classification/test/temp/junit4-J2-20171025_150654_74410197517931490676416.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/classification/test/temp/junit4-J0-20171025_150654_7444759289578305995210.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 253 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/test/temp/junit4-J2-20171025_150704_3538949738257362439823.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/test/temp/junit4-J1-20171025_150704_35312963534556427744640.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 9 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/codecs/test/temp/junit4-J0-20171025_150704_3534893798594422762014.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 241 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/demo/test/temp/junit4-J1-20171025_150844_2343731989334552208080.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/demo/test/temp/junit4-J2-20171025_150844_2349758090274214111123.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/demo/test/temp/junit4-J0-20171025_150844_23316287713396421370309.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 170 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/expressions/test/temp/junit4-J1-20171025_150846_6041367049461771374697.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/expressions/test/temp/junit4-J0-20171025_150846_6047525732474611131131.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/expressions/test/temp/junit4-J2-20171025_150846_6046555956592753523996.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 217 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/facet/test/temp/junit4-J0-20171025_150851_86617396130880992698561.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/facet/test/temp/junit4-J2-20171025_150851_86617907659013404763639.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 12 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/facet/test/temp/junit4-J1-20171025_150851_86613249026910857777429.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 179 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/grouping/test/temp/junit4-J1-20171025_150919_3522894203654638176455.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/grouping/test/temp/junit4-J0-20171025_150919_35213428133922125336173.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/grouping/test/temp/junit4-J2-20171025_150919_3528885734892745386024.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 240 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/highlighter/test/temp/junit4-J1-20171025_150926_9615854530402088254680.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/highlighter/test/temp/junit4-J2-20171025_150926_9618814364175336669475.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 9 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/highlighter/test/temp/junit4-J0-20171025_150926_9615150052462378361597.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 160 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/join/test/temp/junit4-J2-20171025_150943_05112300462365506231592.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/join/test/temp/junit4-J0-20171025_150943_05116226613065516189606.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/join/test/temp/junit4-J1-20171025_150943_05113914387005762833169.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 149 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/memory/test/temp/junit4-J0-20171025_151003_6125278927937233243489.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/memory/test/temp/junit4-J1-20171025_151003_61218361148074102459940.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 178 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/misc/test/temp/junit4-J0-20171025_151011_7934540510274175046059.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 5 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/misc/test/temp/junit4-J2-20171025_151011_79318196292793472067676.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/misc/test/temp/junit4-J1-20171025_151011_79310378326493036996017.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 315 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queries/test/temp/junit4-J0-20171025_151025_7097199142373699675433.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queries/test/temp/junit4-J1-20171025_151025_70917549626294142737344.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queries/test/temp/junit4-J2-20171025_151025_70910468922884790004111.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 227 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queryparser/test/temp/junit4-J1-20171025_151032_8785213928967584231906.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queryparser/test/temp/junit4-J2-20171025_151032_8788808146288784040181.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/queryparser/test/temp/junit4-J0-20171025_151032_87813913513289807057017.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 207 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/replicator/test/temp/junit4-J1-20171025_151039_338869396222794769059.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/replicator/test/temp/junit4-J2-20171025_151039_3382651782771864877893.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/replicator/test/temp/junit4-J0-20171025_151039_3384631875448347050322.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 216 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/sandbox/test/temp/junit4-J0-20171025_151051_4686715859418325653159.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 7 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/sandbox/test/temp/junit4-J2-20171025_151051_46816746132977943640104.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/sandbox/test/temp/junit4-J1-20171025_151051_4688519357779188860387.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 415 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial-extras/test/temp/junit4-J0-20171025_151135_34617994599372917700719.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial-extras/test/temp/junit4-J1-20171025_151135_34612349442702218206002.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial-extras/test/temp/junit4-J2-20171025_151135_3478274502466486935796.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 148 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial/test/temp/junit4-J0-20171025_151151_82515869582486235095735.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 169 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial3d/test/temp/junit4-J2-20171025_151153_5173712086021112317521.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial3d/test/temp/junit4-J1-20171025_151153_5177461779426106758724.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 5 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/spatial3d/test/temp/junit4-J0-20171025_151153_51712846086620528422161.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 250 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/suggest/test/temp/junit4-J1-20171025_151253_5653347144847265757777.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/suggest/test/temp/junit4-J2-20171025_151253_565218984018863858570.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/build/suggest/test/temp/junit4-J0-20171025_151253_5653175965870911950985.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 2661 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2FC15380B23D99A9-001/init-core-data-001
   [junit4]   2> 1092774 WARN  (SUITE-CollectionsAPIDistributedZkTest-seed#[2FC15380B23D99A9]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=66 numCloses=66
   [junit4]   2> 1092775 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[2FC15380B23D99A9]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1092776 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[2FC15380B23D99A9]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 1092776 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[2FC15380B23D99A9]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1092777 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[2FC15380B23D99A9]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2FC15380B23D99A9-001/tempDir-001
   [junit4]   2> 1092778 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[2FC15380B23D99A9]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1092778 INFO  (Thread-3073) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1092778 INFO  (Thread-3073) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1092780 ERROR (Thread-3073) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1092878 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[2FC15380B23D99A9]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:38867
   [junit4]   2> 1092887 INFO  (jetty-launcher-1789-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1092887 INFO  (jetty-launcher-1789-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1092887 INFO  (jetty-launcher-1789-thread-3) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1092887 INFO  (jetty-launcher-1789-thread-4) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1092889 INFO  (jetty-launcher-1789-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4fecb2b4{/solr,null,AVAILABLE}
   [junit4]   2> 1092889 INFO  (jetty-launcher-1789-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5813751f{/solr,null,AVAILABLE}
   [junit4]   2> 1092889 INFO  (jetty-launcher-1789-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2906a424{/solr,null,AVAILABLE}
   [junit4]   2> 1092889 INFO  (jetty-launcher-1789-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@25e6b273{/solr,null,AVAILABLE}
   [junit4]   2> 1092892 INFO  (jetty-launcher-1789-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@7aec29d9{SSL,[ssl, http/1.1]}{127.0.0.1:44173}
   [junit4]   2> 1092892 INFO  (jetty-launcher-1789-thread-4) [    ] o.e.j.s.Server Started @1094513ms
   [junit4]   2> 1092892 INFO  (jetty-launcher-1789-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44173}
   [junit4]   2> 1092893 ERROR (jetty-launcher-1789-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1092893 INFO  (jetty-launcher-1789-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 1092893 INFO  (jetty-launcher-1789-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1092893 INFO  (jetty-launcher-1789-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 1092893 INFO  (jetty-launcher-1789-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T15:32:12.902577Z
   [junit4]   2> 1092893 INFO  (jetty-launcher-1789-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@9c76113{SSL,[ssl, http/1.1]}{127.0.0.1:40311}
   [junit4]   2> 1092893 INFO  (jetty-launcher-1789-thread-1) [    ] o.e.j.s.Server Started @1094514ms
   [junit4]   2> 1092893 INFO  (jetty-launcher-1789-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40311}
   [junit4]   2> 1092894 ERROR (jetty-launcher-1789-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1092894 INFO  (jetty-launcher-1789-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 1092894 INFO  (jetty-launcher-1789-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1092894 INFO  (jetty-launcher-1789-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 1092894 INFO  (jetty-launcher-1789-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T15:32:12.903538Z
   [junit4]   2> 1092895 INFO  (jetty-launcher-1789-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@75a2e466{SSL,[ssl, http/1.1]}{127.0.0.1:39133}
   [junit4]   2> 1092895 INFO  (jetty-launcher-1789-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@4ff64f0c{SSL,[ssl, http/1.1]}{127.0.0.1:39647}
   [junit4]   2> 1092895 INFO  (jetty-launcher-1789-thread-3) [    ] o.e.j.s.Server Started @1094516ms
   [junit4]   2> 1092895 INFO  (jetty-launcher-1789-thread-2) [    ] o.e.j.s.Server Started @1094516ms
   [junit4]   2> 1092895 INFO  (jetty-launcher-1789-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39133}
   [junit4]   2> 1092895 INFO  (jetty-launcher-1789-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39647}
   [junit4]   2> 1092896 ERROR (jetty-launcher-1789-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1092896 ERROR (jetty-launcher-1789-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1092896 INFO  (jetty-launcher-1789-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 1092896 INFO  (jetty-launcher-1789-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 1092896 INFO  (jetty-launcher-1789-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1092896 INFO  (jetty-launcher-1789-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1092896 INFO  (jetty-launcher-1789-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 1092896 INFO  (jetty-launcher-1789-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 1092896 INFO  (jetty-launcher-1789-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T15:32:12.905856Z
   [junit4]   2> 1092896 INFO  (jetty-launcher-1789-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T15:32:12.905911Z
   [junit4]   2> 1092896 INFO  (jetty-launcher-1789-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1092897 INFO  (jetty-launcher-1789-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1092898 INFO  (jetty-launcher-1789-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1092898 INFO  (jetty-launcher-1789-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1092906 INFO  (jetty-launcher-1789-thread-1) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 1092906 INFO  (jetty-launcher-1789-thread-4) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 1092906 INFO  (jetty-launcher-1789-thread-1) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1092906 INFO  (jetty-launcher-1789-thread-4) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1092907 INFO  (jetty-launcher-1789-thread-2) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 1092907 INFO  (jetty-launcher-1789-thread-3) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 1092908 INFO  (jetty-launcher-1789-thread-2) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1092908 INFO  (jetty-launcher-1789-thread-3) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 1092908 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f542997740002, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 1092909 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f542997740003, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 1092911 INFO  (jetty-launcher-1789-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38867/solr
   [junit4]   2> 1092911 INFO  (jetty-launcher-1789-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38867/solr
   [junit4]   2> 1092911 INFO  (jetty-launcher-1789-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38867/solr
   [junit4]   2> 1092912 INFO  (jetty-launcher-1789-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38867/solr
   [junit4]   2> 1092914 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f542997740005, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 1092958 INFO  (jetty-launcher-1789-thread-2) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1092958 INFO  (jetty-launcher-1789-thread-4) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1092959 INFO  (jetty-launcher-1789-thread-1) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1092959 INFO  (jetty-launcher-1789-thread-3) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1092959 INFO  (jetty-launcher-1789-thread-2) [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:39647_solr
   [junit4]   2> 1092959 INFO  (jetty-launcher-1789-thread-4) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44173_solr
   [junit4]   2> 1092959 INFO  (jetty-launcher-1789-thread-1) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40311_solr
   [junit4]   2> 1092959 INFO  (jetty-launcher-1789-thread-2) [    ] o.a.s.c.Overseer Overseer (id=98890254436794379-127.0.0.1:39647_solr-n_0000000000) starting
   [junit4]   2> 1092959 INFO  (jetty-launcher-1789-thread-3) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39133_solr
   [junit4]   2> 1092959 INFO  (zkCallback-1810-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1092959 INFO  (zkCallback-1809-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1092959 INFO  (zkCallback-1811-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1092960 INFO  (zkCallback-1808-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1092960 INFO  (zkCallback-1809-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1092960 INFO  (zkCallback-1810-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1092960 INFO  (zkCallback-1811-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1092960 INFO  (zkCallback-1808-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 1092972 INFO  (jetty-launcher-1789-thread-2) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39647_solr
   [junit4]   2> 1092973 INFO  (zkCallback-1811-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1092973 INFO  (zkCallback-1809-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1092973 INFO  (zkCallback-1808-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1092973 INFO  (zkCallback-1810-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1092985 INFO  (jetty-launcher-1789-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5ca2a33f
   [junit4]   2> 1092989 INFO  (jetty-launcher-1789-thread-4) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5ca2a33f
   [junit4]   2> 1092989 INFO  (jetty-launcher-1789-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5ca2a33f
   [junit4]   2> 1092989 INFO  (jetty-launcher-1789-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5ca2a33f
   [junit4]   2> 1092990 INFO  (jetty-launcher-1789-thread-1) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2FC15380B23D99A9-001/tempDir-001/node1
   [junit4]   2> 1092995 INFO  (jetty-launcher-1789-thread-4) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5ca2a33f
   [junit4]   2> 1092995 INFO  (jetty-launcher-1789-thread-4) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5ca2a33f
   [junit4]   2> 1092996 INFO  (jetty-launcher-1789-thread-4) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2FC15380B23D99A9-001/tempDir-001/node4
   [junit4]   2> 1093001 INFO  (jetty-launcher-1789-thread-3) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5ca2a33f
   [junit4]   2> 1093007 INFO  (jetty-launcher-1789-thread-3) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5ca2a33f
   [junit4]   2> 1093007 INFO  (jetty-launcher-1789-thread-3) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5ca2a33f
   [junit4]   2> 1093008 INFO  (jetty-launcher-1789-thread-3) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2FC15380B23D99A9-001/tempDir-001/node3
   [junit4]   2> 1093021 INFO  (jetty-launcher-1789-thread-2) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5ca2a33f
   [junit4]   2> 1093027 INFO  (jetty-launcher-1789-thread-2) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5ca2a33f
   [junit4]   2> 1093027 INFO  (jetty-launcher-1789-thread-2) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5ca2a33f
   [junit4]   2> 1093028 INFO  (jetty-launcher-1789-thread-2) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2FC15380B23D99A9-001/tempDir-001/node2
   [junit4]   2> 1093056 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[2FC15380B23D99A9]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1093056 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[2FC15380B23D99A9]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38867/solr ready
   [junit4]   2> 1093066 INFO  (TEST-CollectionsAPIDistributedZkTest.testCreateNodeSet-seed#[2FC15380B23D99A9]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testCreateNodeSet
   [junit4]   2> 1093066 INFO  (TEST-CollectionsAPIDistributedZkTest.testCreateNodeSet-seed#[2FC15380B23D99A9]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1093075 INFO  (qtp1774712883-11476) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&name=nodeset_collection&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=https://127.0.0.1:39133/solr,https://127.0.0.1:39647/solr&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1093076 INFO  (OverseerThreadFactory-4779-thread-1) [    ] o.a.s.c.CreateCollectionCmd Create collection nodeset_collection
   [junit4]   2> 1093076 WARN  (OverseerThreadFactory-4779-thread-1) [    ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (nodeset_collection) without cores.
   [junit4]   2> 1093180 INFO  (qtp1774712883-11476) [    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 1093180 INFO  (qtp1774712883-11476) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf&name=nodeset_collection&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=https://127.0.0.1:39133/solr,https://127.0.0.1:39647/solr&wt=javabin&version=2} status=0 QTime=105
   [junit4]   2> 1093181 INFO  (TEST-CollectionsAPIDistributedZkTest.testCreateNodeSet-seed#[2FC15380B23D99A9]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testCreateNodeSet
   [junit4]   2> 1093208 INFO  (TEST-CollectionsAPIDistributedZkTest.testZeroNumShards-seed#[2FC15380B23D99A9]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testZeroNumShards
   [junit4]   2> 1093209 INFO  (TEST-CollectionsAPIDistributedZkTest.testZeroNumShards-seed#[2FC15380B23D99A9]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1093210 INFO  (qtp1774712883-11497) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=nodeset_collection&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1093212 INFO  (OverseerCollectionConfigSetProcessor-98890254436794379-127.0.0.1:39647_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1093212 INFO  (OverseerThreadFactory-4779-thread-2) [    ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 1093917 INFO  (qtp1774712883-11497) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=nodeset_collection&action=DELETE&wt=javabin&version=2} status=0 QTime=706
   [junit4]   2> 1093918 INFO  (qtp1774712883-11501) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=10&collection.configName=conf&name=acollection&action=CREATE&numShards=0&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1093921 INFO  (OverseerThreadFactory-4779-thread-3) [    ] o.a.s.c.CreateCollectionCmd Create collection acollection
   [junit4]   2> 1093921 INFO  (OverseerCollectionConfigSetProcessor-98890254436794379-127.0.0.1:39647_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1093922 ERROR (OverseerThreadFactory-4779-thread-3) [    ] o.a.s.c.OverseerCollectionMessageHandler Collection: acollection operation: create failed:org.apache.solr.common.SolrException: numShards must be > 0
   [junit4]   2> 	at org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:144)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:229)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:464)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 
   [junit4]   2> 1093925 INFO  (qtp1774712883-11501) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=10&collection.configName=conf&name=acollection&action=CREATE&numShards=0&wt=javabin&version=2} status=400 QTime=6
   [junit4]   2> 1093925 INFO  (TEST-CollectionsAPIDistributedZkTest.testZeroNumShards-seed#[2FC15380B23D99A9]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testZeroNumShards
   [junit4]   2> 1093951 INFO  (TEST-CollectionsAPIDistributedZkTest.testCreationAndDeletion-seed#[2FC15380B23D99A9]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testCreationAndDeletion
   [junit4]   2> 1093952 INFO  (TEST-CollectionsAPIDistributedZkTest.testCreationAndDeletion-seed#[2FC15380B23D99A9]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1093953 INFO  (qtp1774712883-11504) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&name=created_and_deleted&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1093955 INFO  (OverseerThreadFactory-4779-thread-4) [    ] o.a.s.c.CreateCollectionCmd Create collection created_and_deleted
   [junit4]   2> 1093955 INFO  (OverseerCollectionConfigSetProcessor-98890254436794379-127.0.0.1:39647_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1094162 INFO  (OverseerStateUpdate-98890254436794379-127.0.0.1:39647_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"created_and_deleted",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"created_and_deleted_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:40311/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1094384 INFO  (qtp291678221-11473) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=created_and_deleted_shard1_replica_n1&action=CREATE&numShards=1&collection=created_and_deleted&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1094384 INFO  (qtp291678221-11473) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1094488 INFO  (zkCallback-1809-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/created_and_deleted/state.json] for collection [created_and_deleted] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1094488 INFO  (zkCallback-1809-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/created_and_deleted/state.json] for collection [created_and_deleted] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1095395 INFO  (qtp291678221-11473) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 1095402 INFO  (qtp291678221-11473) [    ] o.a.s.s.IndexSchema [created_and_deleted_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 1095404 INFO  (qtp291678221-11473) [    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1095404 INFO  (qtp291678221-11473) [    ] o.a.s.c.CoreContainer Creating SolrCore 'created_and_deleted_shard1_replica_n1' using configuration from collection created_and_deleted, trusted=true
   [junit4]   2> 1095404 INFO  (qtp291678221-11473) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.created_and_deleted.shard1.replica_n1' (registry 'solr.core.created_and_deleted.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5ca2a33f
   [junit4]   2> 1095404 INFO  (qtp291678221-11473) [    ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1095405 INFO  (qtp291678221-11473) [    ] o.a.s.c.SolrCore [[created_and_deleted_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2FC15380B23D99A9-001/tempDir-001/node1/created_and_deleted_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_2FC15380B23D99A9-001/tempDir-001/node1/created_and_deleted_shard1_replica_n1/data/]
   [junit4]   2> 1095451 INFO  (qtp291678221-11473) [    ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1095451 INFO  (qtp291678221-11473) [    ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1095451 INFO  (qtp291678221-11473) [    ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1095451 INFO  (qtp291678221-11473) [    ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1095452 INFO  (qtp291678221-11473) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@71e89631[created_and_deleted_shard1_replica_n1] main]
   [junit4]   2> 1095453 INFO  (qtp291678221-11473) [    ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 1095453 INFO  (qtp291678221-11473) [    ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1095453 INFO  (qtp291678221-11473) [    ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1095454 INFO  (searcherExecutor-4788-thread-1) [    ] o.a.s.c.SolrCore [created_and_deleted_shard1_replica_n1] Registered new searcher Searcher@71e89631[created_and_deleted_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1095454 INFO  (qtp291678221-11473) [    ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582244073793650688
   [junit4]   2> 1095458 INFO  (qtp291678221-11473) [    ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1095458 INFO  (qtp291678221-11473) [    ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1095458 INFO  (qtp291678221-11473) [    ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:40311/solr/created_and_deleted_shard1_replica_n1/
   [junit4]   2> 1095458 INFO  (qtp291678221-11473) [    ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1095458 INFO  (qtp291678221-11473) [    ] o.a.s.c.SyncStrategy https://127.0.0.1:40311/solr/created_and_deleted_shard1_replica_n1/ has no replicas
   [junit4]   2> 1095458 INFO  (qtp291678221-11473) [    ] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1095459 INFO  (qtp291678221-11473) [    ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:40311/solr/created_and_deleted_shard1_replica_n1/ shard1
   [junit4]   2> 1095560 INFO  (zkCallback-1809-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/created_and_deleted/state.json] for collection [created_and_deleted] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1095560 INFO  (zkCallback-1809-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/created_and_deleted/state.json] for collection [created_and_deleted] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1095609 INFO  (qtp291678221-11473) [    ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1095611 INFO  (qtp291678221-11473) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=created_and_deleted_shard1_replica_n1&action=CREATE&numShards=1&collection=created_and_deleted&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1227
   [junit4]   2> 1095613 INFO  (qtp1774712883-11504) [    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 1095712 INFO  (zkCallback-1809-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/created_and_deleted/state.json] for collection [created_and_deleted] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1095712 INFO  (zkCallback-1809-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/created_and_deleted/state.json] for collection [created_and_deleted] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1095957 INFO  (OverseerCollectionConfigSetProcessor-98890254436794379-127.0.0.1:39647_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1096614 INFO  (qtp1774712883-11504) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf&name=created_and_deleted&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=2661
   [junit4]   2> 1096615 INFO  (qtp1774712883-11476) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1096616 INFO  (qtp1774712883-11476) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1096617 INFO  (qtp1774712883-11497) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=created_and_deleted&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1096620 INFO  (OverseerThreadFactory-4779-thread-5) [    ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 1096621 INFO  (qtp291678221-11499) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.created_and_deleted.shard1.replica_n1, tag=null
   [junit4]   2> 1096622 INFO  (qtp291678221-11499) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@ca68748: rootName = null, domain = solr.core.created_and_deleted.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.created_and_deleted.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@27adfb11
   [junit4]   2> 1096639 INFO  (qtp291678221-11499) [    ] o.a.s.c.SolrCore [created_and_deleted_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@125c5426
   [junit4]   2> 1096639 INFO  (qtp291678221-11499) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.created_and_deleted.shard1.replica_n1, tag=308040742
   [junit4]   2> 1096639 INFO  (qtp291678221-11499) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.created_and_deleted.shard1.leader, tag=308040742
   [junit4]   2> 1096643 INFO  (qtp291678221-11499) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=created_and_deleted_shard1_replica_n1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=21
   [junit4]   2> 1097347 INFO  (qtp1774712883-11497) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=created_and_deleted&action=DELETE&wt=javabin&version=2} status=0 QTime=730
   [junit4]   2> 1097348 INFO  (qtp1774712883-11501) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1097348 INFO  (qtp1774712883-11501) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1097349 INFO  (TEST-CollectionsAPIDistributedZkTest.testCreationAndDeletion-seed#[2FC15380B23D99A9]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testCreationAndDeletion
   [junit4]   2> 1097385 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionReload-seed#[2FC15380B23D99A9]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testCollectionReload
   [junit4]   2> 1097386 INFO  (TEST-CollectionsAPIDistributedZkTest.testCollectionReload-seed#[2FC15380B23D99A9]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1097388 INFO  (qtp1774712883-11504) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&name=reloaded_collection&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1097389 INFO  (OverseerThreadFactory-4779-thread-5) [    ] o.a.s.c.CreateCollectionCmd Create collection reloaded_collection
   [junit4]   2> 1097390 INFO  (OverseerCollectionConfigSetProcessor-98890254436794379-127.0.0.1:39647_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000008 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1097594 INFO  (OverseerStateUpdate-98890254436794379-127.0.0.1:39647_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"reloaded_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"reloaded_collection_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:44173/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1097595 INFO  (OverseerStateUpdate-98890254436794379-127.0.0.1:39647_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"reloaded_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"reloaded_collection_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:39133/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1097596 INFO  (OverseerStateUpdate-98890254436794379-127.0.0.1:39647_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"reloaded_collection",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"reloaded_collection_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:40311/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1097596 INFO  (OverseerStateUpdate-98890254436794379-127.0.0.1:39647_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"reloaded_collection",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"reloaded_collection_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:39647/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1097803 INFO  (qtp291678221-11503) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf&newCollection=true&name=reloaded_collection_shard2_replica_n4&action=CREATE&numShards=2&collection=reloaded_collection&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1097803 INFO  (qtp1774712883-11501) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=reloaded_coll

[...truncated too long message...]

ure release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-analytics/test/temp/junit4-J1-20171025_161134_06110356519955381610880.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-analytics/test/temp/junit4-J2-20171025_161134_06112544772905693578609.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 553 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J2-20171025_161227_6149374023647745979335.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J1-20171025_161227_6145101050796863040460.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J0-20171025_161227_61310323192721695105113.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 1259 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J1-20171025_161240_46117585842047205361194.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J0-20171025_161240_4614862550506244740000.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 650 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J0-20171025_161246_49111300216232778058993.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J1-20171025_161246_49114289611063171065902.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J2-20171025_161246_49113937878769348620663.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 557 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J1-20171025_161305_73211514392824164499610.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J2-20171025_161305_7323376087658915798857.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J0-20171025_161305_7327463680535634809415.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 563 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J1-20171025_161314_58511697841244925880213.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J0-20171025_161314_5854253691743892858845.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 634 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J0-20171025_161320_09610428138154211645264.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 18 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J2-20171025_161320_09711955629972131139712.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J1-20171025_161320_0961035731290534750652.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 596 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J1-20171025_161339_74410494338214736176055.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J0-20171025_161339_7442367655829310339869.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 548 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/contrib/solr-velocity/test/temp/junit4-J0-20171025_161348_5335856360443303011768.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 31633 lines...]

[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk1.8.0_144) - Build # 666 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/666/
Java: 64bit/jdk1.8.0_144 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC

2 tests failed.
FAILED:  org.apache.solr.cloud.MoveReplicaHDFSTest.testFailedMove

Error Message:
Error from server at http://127.0.0.1:42241/solr: create the collection time out:180s

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:42241/solr: create the collection time out:180s
	at __randomizedtesting.SeedInfo.seed([A5CCBFB8831449CC:F016C4A34C79C1C]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:626)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:867)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.MoveReplicaTest.testFailedMove(MoveReplicaTest.java:238)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.MoveReplicaHDFSTest.test

Error Message:
Error from server at http://127.0.0.1:42241/solr: delete the collection time out:180s

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:42241/solr: delete the collection time out:180s
	at __randomizedtesting.SeedInfo.seed([A5CCBFB8831449CC:2D9880622DE82434]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:626)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:867)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
	at org.apache.solr.cloud.MiniSolrCloudCluster.deleteAllCollections(MiniSolrCloudCluster.java:444)
	at org.apache.solr.cloud.MoveReplicaTest.beforeTest(MoveReplicaTest.java:88)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 11968 lines...]
   [junit4] Suite: org.apache.solr.cloud.MoveReplicaHDFSTest
   [junit4]   2> 219357 INFO  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_A5CCBFB8831449CC-001/init-core-data-001
   [junit4]   2> 219357 WARN  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=24 numCloses=24
   [junit4]   2> 219357 INFO  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 219358 INFO  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 219358 INFO  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_A5CCBFB8831449CC-001/tempDir-001
   [junit4]   2> 219358 INFO  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 219358 INFO  (Thread-283) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 219358 INFO  (Thread-283) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 219359 ERROR (Thread-283) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 219459 INFO  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:41835
   [junit4]   2> 219466 INFO  (jetty-launcher-235-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 219466 INFO  (jetty-launcher-235-thread-3) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 219466 INFO  (jetty-launcher-235-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 219466 INFO  (jetty-launcher-235-thread-4) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 219470 INFO  (jetty-launcher-235-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1960c592{/solr,null,AVAILABLE}
   [junit4]   2> 219471 INFO  (jetty-launcher-235-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5bcda6e4{/solr,null,AVAILABLE}
   [junit4]   2> 219471 INFO  (jetty-launcher-235-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1e9dc045{/solr,null,AVAILABLE}
   [junit4]   2> 219476 INFO  (jetty-launcher-235-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@6e90c8aa{HTTP/1.1,[http/1.1]}{127.0.0.1:42241}
   [junit4]   2> 219476 INFO  (jetty-launcher-235-thread-2) [    ] o.e.j.s.Server Started @220881ms
   [junit4]   2> 219476 INFO  (jetty-launcher-235-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42241}
   [junit4]   2> 219476 ERROR (jetty-launcher-235-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 219476 INFO  (jetty-launcher-235-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 219476 INFO  (jetty-launcher-235-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 219476 INFO  (jetty-launcher-235-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 219476 INFO  (jetty-launcher-235-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T12:02:06.160Z
   [junit4]   2> 219477 INFO  (jetty-launcher-235-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@50b93c8e{HTTP/1.1,[http/1.1]}{127.0.0.1:34977}
   [junit4]   2> 219478 INFO  (jetty-launcher-235-thread-1) [    ] o.e.j.s.Server Started @220883ms
   [junit4]   2> 219478 INFO  (jetty-launcher-235-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34977}
   [junit4]   2> 219478 ERROR (jetty-launcher-235-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 219478 INFO  (jetty-launcher-235-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 219478 INFO  (jetty-launcher-235-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 219478 INFO  (jetty-launcher-235-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 219479 INFO  (jetty-launcher-235-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T12:02:06.163Z
   [junit4]   2> 219479 INFO  (jetty-launcher-235-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@53d00cdb{/solr,null,AVAILABLE}
   [junit4]   2> 219479 INFO  (jetty-launcher-235-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@f78a77c{HTTP/1.1,[http/1.1]}{127.0.0.1:42687}
   [junit4]   2> 219480 INFO  (jetty-launcher-235-thread-3) [    ] o.e.j.s.Server Started @220885ms
   [junit4]   2> 219480 INFO  (jetty-launcher-235-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42687}
   [junit4]   2> 219480 INFO  (jetty-launcher-235-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@4bb8f4a7{HTTP/1.1,[http/1.1]}{127.0.0.1:46169}
   [junit4]   2> 219480 ERROR (jetty-launcher-235-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 219480 INFO  (jetty-launcher-235-thread-4) [    ] o.e.j.s.Server Started @220886ms
   [junit4]   2> 219480 INFO  (jetty-launcher-235-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 219480 INFO  (jetty-launcher-235-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=46169}
   [junit4]   2> 219481 INFO  (jetty-launcher-235-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 219481 INFO  (jetty-launcher-235-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 219481 INFO  (jetty-launcher-235-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T12:02:06.165Z
   [junit4]   2> 219481 INFO  (jetty-launcher-235-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 219481 ERROR (jetty-launcher-235-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 219481 INFO  (jetty-launcher-235-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 219481 INFO  (jetty-launcher-235-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 219481 INFO  (jetty-launcher-235-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 219481 INFO  (jetty-launcher-235-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T12:02:06.165Z
   [junit4]   2> 219487 INFO  (jetty-launcher-235-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 219488 INFO  (jetty-launcher-235-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 219488 INFO  (jetty-launcher-235-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 219497 INFO  (jetty-launcher-235-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41835/solr
   [junit4]   2> 219498 INFO  (jetty-launcher-235-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41835/solr
   [junit4]   2> 219503 INFO  (jetty-launcher-235-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41835/solr
   [junit4]   2> 219505 INFO  (jetty-launcher-235-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41835/solr
   [junit4]   2> 219505 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f53693a5b0005, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 219508 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f53693a5b0006, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 219600 INFO  (jetty-launcher-235-thread-4) [n:127.0.0.1:46169_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 219601 INFO  (jetty-launcher-235-thread-4) [n:127.0.0.1:46169_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:46169_solr
   [junit4]   2> 219602 INFO  (jetty-launcher-235-thread-4) [n:127.0.0.1:46169_solr    ] o.a.s.c.Overseer Overseer (id=98889428241154058-127.0.0.1:46169_solr-n_0000000000) starting
   [junit4]   2> 219604 INFO  (jetty-launcher-235-thread-2) [n:127.0.0.1:42241_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 219605 INFO  (jetty-launcher-235-thread-2) [n:127.0.0.1:42241_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42241_solr
   [junit4]   2> 219606 INFO  (zkCallback-255-thread-1-processing-n:127.0.0.1:46169_solr) [n:127.0.0.1:46169_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 219607 INFO  (zkCallback-253-thread-1-processing-n:127.0.0.1:42687_solr) [n:127.0.0.1:42687_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 219607 INFO  (jetty-launcher-235-thread-3) [n:127.0.0.1:42687_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 219607 INFO  (zkCallback-257-thread-1-processing-n:127.0.0.1:42241_solr) [n:127.0.0.1:42241_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 219607 INFO  (zkCallback-256-thread-1-processing-n:127.0.0.1:34977_solr) [n:127.0.0.1:34977_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 219611 INFO  (jetty-launcher-235-thread-1) [n:127.0.0.1:34977_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 219611 INFO  (jetty-launcher-235-thread-3) [n:127.0.0.1:42687_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42687_solr
   [junit4]   2> 219612 INFO  (jetty-launcher-235-thread-1) [n:127.0.0.1:34977_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34977_solr
   [junit4]   2> 219612 INFO  (zkCallback-257-thread-1-processing-n:127.0.0.1:42241_solr) [n:127.0.0.1:42241_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 219614 INFO  (zkCallback-256-thread-1-processing-n:127.0.0.1:34977_solr) [n:127.0.0.1:34977_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
   [junit4]   2> 219614 INFO  (zkCallback-255-thread-1-processing-n:127.0.0.1:46169_solr) [n:127.0.0.1:46169_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
   [junit4]   2> 219614 INFO  (zkCallback-257-thread-1-processing-n:127.0.0.1:42241_solr) [n:127.0.0.1:42241_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 219618 INFO  (zkCallback-253-thread-1-processing-n:127.0.0.1:42687_solr) [n:127.0.0.1:42687_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
   [junit4]   2> 219631 INFO  (jetty-launcher-235-thread-4) [n:127.0.0.1:46169_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46169_solr
   [junit4]   2> 219631 INFO  (zkCallback-256-thread-1-processing-n:127.0.0.1:34977_solr) [n:127.0.0.1:34977_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 219632 INFO  (zkCallback-257-thread-1-processing-n:127.0.0.1:42241_solr) [n:127.0.0.1:42241_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 219633 INFO  (zkCallback-253-thread-1-processing-n:127.0.0.1:42687_solr) [n:127.0.0.1:42687_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 219634 INFO  (zkCallback-255-thread-1-processing-n:127.0.0.1:46169_solr) [n:127.0.0.1:46169_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 219675 INFO  (jetty-launcher-235-thread-3) [n:127.0.0.1:42687_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42687.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24add3de
   [junit4]   2> 219685 INFO  (jetty-launcher-235-thread-3) [n:127.0.0.1:42687_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42687.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24add3de
   [junit4]   2> 219685 INFO  (jetty-launcher-235-thread-3) [n:127.0.0.1:42687_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42687.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24add3de
   [junit4]   2> 219686 INFO  (jetty-launcher-235-thread-3) [n:127.0.0.1:42687_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_A5CCBFB8831449CC-001/tempDir-001/node3/.
   [junit4]   2> 219697 INFO  (jetty-launcher-235-thread-4) [n:127.0.0.1:46169_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46169.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24add3de
   [junit4]   2> 219702 INFO  (jetty-launcher-235-thread-4) [n:127.0.0.1:46169_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46169.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24add3de
   [junit4]   2> 219702 INFO  (jetty-launcher-235-thread-4) [n:127.0.0.1:46169_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46169.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24add3de
   [junit4]   2> 219703 INFO  (jetty-launcher-235-thread-4) [n:127.0.0.1:46169_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_A5CCBFB8831449CC-001/tempDir-001/node4/.
   [junit4]   2> 219709 INFO  (jetty-launcher-235-thread-1) [n:127.0.0.1:34977_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34977.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24add3de
   [junit4]   2> 219710 INFO  (jetty-launcher-235-thread-2) [n:127.0.0.1:42241_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42241.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24add3de
   [junit4]   2> 219716 INFO  (jetty-launcher-235-thread-1) [n:127.0.0.1:34977_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34977.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24add3de
   [junit4]   2> 219717 INFO  (jetty-launcher-235-thread-1) [n:127.0.0.1:34977_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34977.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24add3de
   [junit4]   2> 219717 INFO  (jetty-launcher-235-thread-2) [n:127.0.0.1:42241_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42241.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24add3de
   [junit4]   2> 219718 INFO  (jetty-launcher-235-thread-2) [n:127.0.0.1:42241_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42241.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24add3de
   [junit4]   2> 219718 INFO  (jetty-launcher-235-thread-1) [n:127.0.0.1:34977_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_A5CCBFB8831449CC-001/tempDir-001/node1/.
   [junit4]   2> 219719 INFO  (jetty-launcher-235-thread-2) [n:127.0.0.1:42241_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_A5CCBFB8831449CC-001/tempDir-001/node2/.
   [junit4]   2> 219767 INFO  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 219768 INFO  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41835/solr ready
   [junit4]   2> 219770 INFO  (qtp434916654-1265) [n:127.0.0.1:42241_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 219774 INFO  (qtp434916654-1265) [n:127.0.0.1:42241_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=4
   [junit4]   2> 220107 WARN  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 220596 WARN  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 220684 INFO  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
   [junit4]   2> 220697 WARN  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 220879 INFO  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 220904 INFO  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_localdomain_36423_hdfs____.964elw/webapp
   [junit4]   2> 221574 INFO  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:36423
   [junit4]   2> 221772 INFO  (OverseerCollectionConfigSetProcessor-98889428241154058-127.0.0.1:46169_solr-n_0000000000) [n:127.0.0.1:46169_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 222267 WARN  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 222270 INFO  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 222279 INFO  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_36597_datanode____qkopmf/webapp
   [junit4]   2> 222775 INFO  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36597
   [junit4]   2> 223134 WARN  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 223135 INFO  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 223151 INFO  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.m.log Extract jar:file:/home/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.4-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_33111_datanode____.mup6g8/webapp
   [junit4]   2> 223556 ERROR (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_A5CCBFB8831449CC-001/tempDir-002/hdfsBaseDir/data/data1/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_A5CCBFB8831449CC-001/tempDir-002/hdfsBaseDir/data/data2/]]  heartbeating to localhost.localdomain/127.0.0.1:41005) [    ] o.a.h.h.s.d.DirectoryScanner dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000
   [junit4]   2> 223646 INFO  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33111
   [junit4]   2> 223674 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0x113caafae968b9: from storage DS-67c4b51a-6503-4af4-bfc4-52253cc3f9cc node DatanodeRegistration(127.0.0.1:37081, datanodeUuid=1bbd2fdf-6612-4591-a791-8ae709a8131e, infoPort=39031, infoSecurePort=0, ipcPort=45947, storageInfo=lv=-56;cid=testClusterID;nsid=2063723733;c=0), blocks: 0, hasStaleStorage: true, processing time: 5 msecs
   [junit4]   2> 223674 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0x113caafae968b9: from storage DS-cf43937d-7ddc-43a9-bccf-2e432546bdca node DatanodeRegistration(127.0.0.1:37081, datanodeUuid=1bbd2fdf-6612-4591-a791-8ae709a8131e, infoPort=39031, infoSecurePort=0, ipcPort=45947, storageInfo=lv=-56;cid=testClusterID;nsid=2063723733;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
   [junit4]   2> 223776 ERROR (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_A5CCBFB8831449CC-001/tempDir-002/hdfsBaseDir/data/data3/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_A5CCBFB8831449CC-001/tempDir-002/hdfsBaseDir/data/data4/]]  heartbeating to localhost.localdomain/127.0.0.1:41005) [    ] o.a.h.h.s.d.DirectoryScanner dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value below 1 ms/sec. Assuming default value of 1000
   [junit4]   2> 223781 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0x113cab0275c801: from storage DS-4bc13c5b-2a01-4b82-87aa-973e1512fd9e node DatanodeRegistration(127.0.0.1:36393, datanodeUuid=4d8471fa-215a-4f76-8347-a2f84bc218fd, infoPort=37843, infoSecurePort=0, ipcPort=45793, storageInfo=lv=-56;cid=testClusterID;nsid=2063723733;c=0), blocks: 0, hasStaleStorage: true, processing time: 1 msecs
   [junit4]   2> 223781 INFO  (Block report processor) [    ] BlockStateChange BLOCK* processReport 0x113cab0275c801: from storage DS-c4cc419a-b434-45e9-a832-1703410d6cb5 node DatanodeRegistration(127.0.0.1:36393, datanodeUuid=4d8471fa-215a-4f76-8347-a2f84bc218fd, infoPort=37843, infoSecurePort=0, ipcPort=45793, storageInfo=lv=-56;cid=testClusterID;nsid=2063723733;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
   [junit4]   2> 224099 INFO  (TEST-MoveReplicaHDFSTest.testFailedMove-seed#[A5CCBFB8831449CC]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testFailedMove
   [junit4]   2> 224100 INFO  (TEST-MoveReplicaHDFSTest.testFailedMove-seed#[A5CCBFB8831449CC]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 224103 INFO  (qtp434916654-1267) [n:127.0.0.1:42241_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf1&name=movereplicatest_failed_coll&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 224104 INFO  (OverseerThreadFactory-541-thread-2-processing-n:127.0.0.1:46169_solr) [n:127.0.0.1:46169_solr    ] o.a.s.c.CreateCollectionCmd Create collection movereplicatest_failed_coll
   [junit4]   2> 224212 INFO  (OverseerStateUpdate-98889428241154058-127.0.0.1:46169_solr-n_0000000000) [n:127.0.0.1:46169_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"movereplicatest_failed_coll",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"movereplicatest_failed_coll_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:42241/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 224214 INFO  (OverseerStateUpdate-98889428241154058-127.0.0.1:46169_solr-n_0000000000) [n:127.0.0.1:46169_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"movereplicatest_failed_coll",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"movereplicatest_failed_coll_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:42687/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 224217 INFO  (OverseerStateUpdate-98889428241154058-127.0.0.1:46169_solr-n_0000000000) [n:127.0.0.1:46169_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"movereplicatest_failed_coll",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"movereplicatest_failed_coll_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:46169/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 224219 INFO  (OverseerStateUpdate-98889428241154058-127.0.0.1:46169_solr-n_0000000000) [n:127.0.0.1:46169_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"movereplicatest_failed_coll",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"movereplicatest_failed_coll_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:34977/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 224427 INFO  (qtp434916654-1257) [n:127.0.0.1:42241_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&newCollection=true&name=movereplicatest_failed_coll_shard1_replica_n1&action=CREATE&numShards=2&collection=movereplicatest_failed_coll&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 224427 INFO  (qtp434916654-1257) [n:127.0.0.1:42241_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 224429 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf1&newCollection=true&name=movereplicatest_failed_coll_shard1_replica_n2&action=CREATE&numShards=2&collection=movereplicatest_failed_coll&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 224429 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 224431 INFO  (qtp296257570-1278) [n:127.0.0.1:46169_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf1&newCollection=true&name=movereplicatest_failed_coll_shard2_replica_n4&action=CREATE&numShards=2&collection=movereplicatest_failed_coll&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 224431 INFO  (qtp296257570-1278) [n:127.0.0.1:46169_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 224432 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf1&newCollection=true&name=movereplicatest_failed_coll_shard2_replica_n6&action=CREATE&numShards=2&collection=movereplicatest_failed_coll&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 224432 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 224537 INFO  (zkCallback-255-thread-1-processing-n:127.0.0.1:46169_solr) [n:127.0.0.1:46169_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/movereplicatest_failed_coll/state.json] for collection [movereplicatest_failed_coll] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 224537 INFO  (zkCallback-257-thread-1-processing-n:127.0.0.1:42241_solr) [n:127.0.0.1:42241_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/movereplicatest_failed_coll/state.json] for collection [movereplicatest_failed_coll] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 224537 INFO  (zkCallback-256-thread-1-processing-n:127.0.0.1:34977_solr) [n:127.0.0.1:34977_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/movereplicatest_failed_coll/state.json] for collection [movereplicatest_failed_coll] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 224537 INFO  (zkCallback-253-thread-1-processing-n:127.0.0.1:42687_solr) [n:127.0.0.1:42687_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/movereplicatest_failed_coll/state.json] for collection [movereplicatest_failed_coll] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 224537 INFO  (zkCallback-256-thread-2-processing-n:127.0.0.1:34977_solr) [n:127.0.0.1:34977_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/movereplicatest_failed_coll/state.json] for collection [movereplicatest_failed_coll] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 224537 INFO  (zkCallback-253-thread-2-processing-n:127.0.0.1:42687_solr) [n:127.0.0.1:42687_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/movereplicatest_failed_coll/state.json] for collection [movereplicatest_failed_coll] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 224537 INFO  (zkCallback-255-thread-2-processing-n:127.0.0.1:46169_solr) [n:127.0.0.1:46169_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/movereplicatest_failed_coll/state.json] for collection [movereplicatest_failed_coll] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 224537 INFO  (zkCallback-257-thread-2-processing-n:127.0.0.1:42241_solr) [n:127.0.0.1:42241_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/movereplicatest_failed_coll/state.json] for collection [movereplicatest_failed_coll] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 225447 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 225452 INFO  (qtp434916654-1257) [n:127.0.0.1:42241_solr c:movereplicatest_failed_coll s:shard1 r:core_node3 x:movereplicatest_failed_coll_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 225452 INFO  (qtp296257570-1278) [n:127.0.0.1:46169_solr c:movereplicatest_failed_coll s:shard2 r:core_node7 x:movereplicatest_failed_coll_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 225481 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.s.IndexSchema [movereplicatest_failed_coll_shard1_replica_n2] Schema name=minimal
   [junit4]   2> 225483 INFO  (qtp296257570-1278) [n:127.0.0.1:46169_solr c:movereplicatest_failed_coll s:shard2 r:core_node7 x:movereplicatest_failed_coll_shard2_replica_n4] o.a.s.s.IndexSchema [movereplicatest_failed_coll_shard2_replica_n4] Schema name=minimal
   [junit4]   2> 225484 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 225484 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'movereplicatest_failed_coll_shard1_replica_n2' using configuration from collection movereplicatest_failed_coll, trusted=true
   [junit4]   2> 225484 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42687.solr.core.movereplicatest_failed_coll.shard1.replica_n2' (registry 'solr.core.movereplicatest_failed_coll.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24add3de
   [junit4]   2> 225497 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 225499 INFO  (qtp296257570-1278) [n:127.0.0.1:46169_solr c:movereplicatest_failed_coll s:shard2 r:core_node7 x:movereplicatest_failed_coll_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 225500 INFO  (qtp296257570-1278) [n:127.0.0.1:46169_solr c:movereplicatest_failed_coll s:shard2 r:core_node7 x:movereplicatest_failed_coll_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'movereplicatest_failed_coll_shard2_replica_n4' using configuration from collection movereplicatest_failed_coll, trusted=true
   [junit4]   2> 225500 INFO  (qtp296257570-1278) [n:127.0.0.1:46169_solr c:movereplicatest_failed_coll s:shard2 r:core_node7 x:movereplicatest_failed_coll_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46169.solr.core.movereplicatest_failed_coll.shard2.replica_n4' (registry 'solr.core.movereplicatest_failed_coll.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24add3de
   [junit4]   2> 225504 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.s.IndexSchema [movereplicatest_failed_coll_shard2_replica_n6] Schema name=minimal
   [junit4]   2> 225506 INFO  (qtp434916654-1257) [n:127.0.0.1:42241_solr c:movereplicatest_failed_coll s:shard1 r:core_node3 x:movereplicatest_failed_coll_shard1_replica_n1] o.a.s.s.IndexSchema [movereplicatest_failed_coll_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 225508 INFO  (qtp434916654-1257) [n:127.0.0.1:42241_solr c:movereplicatest_failed_coll s:shard1 r:core_node3 x:movereplicatest_failed_coll_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 225508 INFO  (qtp434916654-1257) [n:127.0.0.1:42241_solr c:movereplicatest_failed_coll s:shard1 r:core_node3 x:movereplicatest_failed_coll_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'movereplicatest_failed_coll_shard1_replica_n1' using configuration from collection movereplicatest_failed_coll, trusted=true
   [junit4]   2> 225508 INFO  (qtp434916654-1257) [n:127.0.0.1:42241_solr c:movereplicatest_failed_coll s:shard1 r:core_node3 x:movereplicatest_failed_coll_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42241.solr.core.movereplicatest_failed_coll.shard1.replica_n1' (registry 'solr.core.movereplicatest_failed_coll.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24add3de
   [junit4]   2> 225511 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 225511 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'movereplicatest_failed_coll_shard2_replica_n6' using configuration from collection movereplicatest_failed_coll, trusted=true
   [junit4]   2> 225511 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34977.solr.core.movereplicatest_failed_coll.shard2.replica_n6' (registry 'solr.core.movereplicatest_failed_coll.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24add3de
   [junit4]   2> 225521 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost.localdomain:41005/data
   [junit4]   2> 225521 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 225521 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 225521 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.c.SolrCore [[movereplicatest_failed_coll_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_A5CCBFB8831449CC-001/tempDir-001/node3/movereplicatest_failed_coll_shard1_replica_n2], dataDir=[hdfs://localhost.localdomain:41005/data/movereplicatest_failed_coll/core_node5/data/]
   [junit4]   2> 225524 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:41005/data/movereplicatest_failed_coll/core_node5/data/snapshot_metadata
   [junit4]   2> 225524 INFO  (qtp296257570-1278) [n:127.0.0.1:46169_solr c:movereplicatest_failed_coll s:shard2 r:core_node7 x:movereplicatest_failed_coll_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost.localdomain:41005/data
   [junit4]   2> 225525 INFO  (qtp296257570-1278) [n:127.0.0.1:46169_solr c:movereplicatest_failed_coll s:shard2 r:core_node7 x:movereplicatest_failed_coll_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 225525 INFO  (qtp296257570-1278) [n:127.0.0.1:46169_solr c:movereplicatest_failed_coll s:shard2 r:core_node7 x:movereplicatest_failed_coll_shard2_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 225525 INFO  (qtp296257570-1278) [n:127.0.0.1:46169_solr c:movereplicatest_failed_coll s:shard2 r:core_node7 x:movereplicatest_failed_coll_shard2_replica_n4] o.a.s.c.SolrCore [[movereplicatest_failed_coll_shard2_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_A5CCBFB8831449CC-001/tempDir-001/node4/movereplicatest_failed_coll_shard2_replica_n4], dataDir=[hdfs://localhost.localdomain:41005/data/movereplicatest_failed_coll/core_node7/data/]
   [junit4]   2> 225524 INFO  (qtp434916654-1257) [n:127.0.0.1:42241_solr c:movereplicatest_failed_coll s:shard1 r:core_node3 x:movereplicatest_failed_coll_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost.localdomain:41005/data
   [junit4]   2> 225526 INFO  (qtp434916654-1257) [n:127.0.0.1:42241_solr c:movereplicatest_failed_coll s:shard1 r:core_node3 x:movereplicatest_failed_coll_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 225526 INFO  (qtp434916654-1257) [n:127.0.0.1:42241_solr c:movereplicatest_failed_coll s:shard1 r:core_node3 x:movereplicatest_failed_coll_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 225526 INFO  (qtp434916654-1257) [n:127.0.0.1:42241_solr c:movereplicatest_failed_coll s:shard1 r:core_node3 x:movereplicatest_failed_coll_shard1_replica_n1] o.a.s.c.SolrCore [[movereplicatest_failed_coll_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_A5CCBFB8831449CC-001/tempDir-001/node2/movereplicatest_failed_coll_shard1_replica_n1], dataDir=[hdfs://localhost.localdomain:41005/data/movereplicatest_failed_coll/core_node3/data/]
   [junit4]   2> 225524 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost.localdomain:41005/data
   [junit4]   2> 225526 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 225526 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 225526 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.c.SolrCore [[movereplicatest_failed_coll_shard2_replica_n6] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_A5CCBFB8831449CC-001/tempDir-001/node1/movereplicatest_failed_coll_shard2_replica_n6], dataDir=[hdfs://localhost.localdomain:41005/data/movereplicatest_failed_coll/core_node8/data/]
   [junit4]   2> 225541 INFO  (qtp296257570-1278) [n:127.0.0.1:46169_solr c:movereplicatest_failed_coll s:shard2 r:core_node7 x:movereplicatest_failed_coll_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:41005/data/movereplicatest_failed_coll/core_node7/data/snapshot_metadata
   [junit4]   2> 225546 INFO  (qtp434916654-1257) [n:127.0.0.1:42241_solr c:movereplicatest_failed_coll s:shard1 r:core_node3 x:movereplicatest_failed_coll_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:41005/data/movereplicatest_failed_coll/core_node3/data/snapshot_metadata
   [junit4]   2> 225557 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:41005/data/movereplicatest_failed_coll/core_node8/data/snapshot_metadata
   [junit4]   2> 225617 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:41005/data/movereplicatest_failed_coll/core_node5/data
   [junit4]   2> 225617 INFO  (qtp296257570-1278) [n:127.0.0.1:46169_solr c:movereplicatest_failed_coll s:shard2 r:core_node7 x:movereplicatest_failed_coll_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:41005/data/movereplicatest_failed_coll/core_node7/data
   [junit4]   2> 225617 INFO  (qtp434916654-1257) [n:127.0.0.1:42241_solr c:movereplicatest_failed_coll s:shard1 r:core_node3 x:movereplicatest_failed_coll_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:41005/data/movereplicatest_failed_coll/core_node3/data
   [junit4]   2> 225622 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:41005/data/movereplicatest_failed_coll/core_node8/data
   [junit4]   2> 225648 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:41005/data/movereplicatest_failed_coll/core_node5/data/index
   [junit4]   2> 225661 INFO  (qtp434916654-1257) [n:127.0.0.1:42241_solr c:movereplicatest_failed_coll s:shard1 r:core_node3 x:movereplicatest_failed_coll_shard1_replica_n1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:41005/data/movereplicatest_failed_coll/core_node3/data/index
   [junit4]   2> 225661 INFO  (qtp296257570-1278) [n:127.0.0.1:46169_solr c:movereplicatest_failed_coll s:shard2 r:core_node7 x:movereplicatest_failed_coll_shard2_replica_n4] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:41005/data/movereplicatest_failed_coll/core_node7/data/index
   [junit4]   2> 225673 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost.localdomain:41005/data/movereplicatest_failed_coll/core_node8/data/index
   [junit4]   2> 225921 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:37081 is added to blk_1073741826_1002{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-c4cc419a-b434-45e9-a832-1703410d6cb5:NORMAL:127.0.0.1:36393|RBW], ReplicaUC[[DISK]DS-cf43937d-7ddc-43a9-bccf-2e432546bdca:NORMAL:127.0.0.1:37081|RBW]]} size 69
   [junit4]   2> 225921 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:36393 is added to blk_1073741825_1001{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-67c4b51a-6503-4af4-bfc4-52253cc3f9cc:NORMAL:127.0.0.1:37081|RBW], ReplicaUC[[DISK]DS-c4cc419a-b434-45e9-a832-1703410d6cb5:NORMAL:127.0.0.1:36393|RBW]]} size 69
   [junit4]   2> 225922 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:37081 is added to blk_1073741825_1001 size 69
   [junit4]   2> 225922 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:37081 is added to blk_1073741827_1003{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-67c4b51a-6503-4af4-bfc4-52253cc3f9cc:NORMAL:127.0.0.1:37081|RBW], ReplicaUC[[DISK]DS-c4cc419a-b434-45e9-a832-1703410d6cb5:NORMAL:127.0.0.1:36393|RBW]]} size 69
   [junit4]   2> 225922 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:37081 is added to blk_1073741828_1004{UCState=COMMITTED, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-4bc13c5b-2a01-4b82-87aa-973e1512fd9e:NORMAL:127.0.0.1:36393|RBW], ReplicaUC[[DISK]DS-cf43937d-7ddc-43a9-bccf-2e432546bdca:NORMAL:127.0.0.1:37081|RBW]]} size 69
   [junit4]   2> 225922 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:36393 is added to blk_1073741826_1002 size 69
   [junit4]   2> 225922 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:36393 is added to blk_1073741828_1004 size 69
   [junit4]   2> 225922 INFO  (Block report processor) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:36393 is added to blk_1073741827_1003 size 69
   [junit4]   2> 226367 INFO  (qtp434916654-1257) [n:127.0.0.1:42241_solr c:movereplicatest_failed_coll s:shard1 r:core_node3 x:movereplicatest_failed_coll_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 226367 INFO  (qtp434916654-1257) [n:127.0.0.1:42241_solr c:movereplicatest_failed_coll s:shard1 r:core_node3 x:movereplicatest_failed_coll_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 226367 INFO  (qtp434916654-1257) [n:127.0.0.1:42241_solr c:movereplicatest_failed_coll s:shard1 r:core_node3 x:movereplicatest_failed_coll_shard1_replica_n1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=3
   [junit4]   2> 226377 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 226377 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 226377 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=3
   [junit4]   2> 226463 INFO  (qtp434916654-1257) [n:127.0.0.1:42241_solr c:movereplicatest_failed_coll s:shard1 r:core_node3 x:movereplicatest_failed_coll_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 226463 INFO  (qtp434916654-1257) [n:127.0.0.1:42241_solr c:movereplicatest_failed_coll s:shard1 r:core_node3 x:movereplicatest_failed_coll_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 226469 INFO  (qtp296257570-1278) [n:127.0.0.1:46169_solr c:movereplicatest_failed_coll s:shard2 r:core_node7 x:movereplicatest_failed_coll_shard2_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 226469 INFO  (qtp296257570-1278) [n:127.0.0.1:46169_solr c:movereplicatest_failed_coll s:shard2 r:core_node7 x:movereplicatest_failed_coll_shard2_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 226469 INFO  (qtp296257570-1278) [n:127.0.0.1:46169_solr c:movereplicatest_failed_coll s:shard2 r:core_node7 x:movereplicatest_failed_coll_shard2_replica_n4] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=3
   [junit4]   2> 226474 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 226474 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 226474 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 226474 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 226474 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=3
   [junit4]   2> 226485 INFO  (qtp296257570-1278) [n:127.0.0.1:46169_solr c:movereplicatest_failed_coll s:shard2 r:core_node7 x:movereplicatest_failed_coll_shard2_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 226485 INFO  (qtp296257570-1278) [n:127.0.0.1:46169_solr c:movereplicatest_failed_coll s:shard2 r:core_node7 x:movereplicatest_failed_coll_shard2_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 226489 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 226489 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 226556 INFO  (qtp434916654-1257) [n:127.0.0.1:42241_solr c:movereplicatest_failed_coll s:shard1 r:core_node3 x:movereplicatest_failed_coll_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4b06d447[movereplicatest_failed_coll_shard1_replica_n1] main]
   [junit4]   2> 226557 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@4c5204d1[movereplicatest_failed_coll_shard2_replica_n6] main]
   [junit4]   2> 226559 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@4eea7201[movereplicatest_failed_coll_shard1_replica_n2] main]
   [junit4]   2> 226559 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 226559 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 226559 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 226560 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 226562 INFO  (qtp296257570-1278) [n:127.0.0.1:46169_solr c:movereplicatest_failed_coll s:shard2 r:core_node7 x:movereplicatest_failed_coll_shard2_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@537e0f7b[movereplicatest_failed_coll_shard2_replica_n4] main]
   [junit4]   2> 226562 INFO  (qtp434916654-1257) [n:127.0.0.1:42241_solr c:movereplicatest_failed_coll s:shard1 r:core_node3 x:movereplicatest_failed_coll_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 226562 INFO  (qtp434916654-1257) [n:127.0.0.1:42241_solr c:movereplicatest_failed_coll s:shard1 r:core_node3 x:movereplicatest_failed_coll_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 226563 INFO  (qtp296257570-1278) [n:127.0.0.1:46169_solr c:movereplicatest_failed_coll s:shard2 r:core_node7 x:movereplicatest_failed_coll_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 226563 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 226563 INFO  (qtp296257570-1278) [n:127.0.0.1:46169_solr c:movereplicatest_failed_coll s:shard2 r:core_node7 x:movereplicatest_failed_coll_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 226563 INFO  (qtp434916654-1257) [n:127.0.0.1:42241_solr c:movereplicatest_failed_coll s:shard1 r:core_node3 x:movereplicatest_failed_coll_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 226564 INFO  (qtp296257570-1278) [n:127.0.0.1:46169_solr c:movereplicatest_failed_coll s:shard2 r:core_node7 x:movereplicatest_failed_coll_shard2_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 226564 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 226565 INFO  (searcherExecutor-550-thread-1-processing-n:127.0.0.1:42687_solr x:movereplicatest_failed_coll_shard1_replica_n2 s:shard1 c:movereplicatest_failed_coll r:core_node5) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.c.SolrCore [movereplicatest_failed_coll_shard1_replica_n2] Registered new searcher Searcher@4eea7201[movereplicatest_failed_coll_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 226565 INFO  (searcherExecutor-553-thread-1-processing-n:127.0.0.1:34977_solr x:movereplicatest_failed_coll_shard2_replica_n6 s:shard2 c:movereplicatest_failed_coll r:core_node8) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.c.SolrCore [movereplicatest_failed_coll_shard2_replica_n6] Registered new searcher Searcher@4c5204d1[movereplicatest_failed_coll_shard2_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 226565 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582230859414503424
   [junit4]   2> 226565 INFO  (searcherExecutor-551-thread-1-processing-n:127.0.0.1:46169_solr x:movereplicatest_failed_coll_shard2_replica_n4 s:shard2 c:movereplicatest_failed_coll r:core_node7) [n:127.0.0.1:46169_solr c:movereplicatest_failed_coll s:shard2 r:core_node7 x:movereplicatest_failed_coll_shard2_replica_n4] o.a.s.c.SolrCore [movereplicatest_failed_coll_shard2_replica_n4] Registered new searcher Searcher@537e0f7b[movereplicatest_failed_coll_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 226565 INFO  (qtp296257570-1278) [n:127.0.0.1:46169_solr c:movereplicatest_failed_coll s:shard2 r:core_node7 x:movereplicatest_failed_coll_shard2_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582230859414503424
   [junit4]   2> 226565 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582230859414503424
   [junit4]   2> 226566 INFO  (searcherExecutor-552-thread-1-processing-n:127.0.0.1:42241_solr x:movereplicatest_failed_coll_shard1_replica_n1 s:shard1 c:movereplicatest_failed_coll r:core_node3) [n:127.0.0.1:42241_solr c:movereplicatest_failed_coll s:shard1 r:core_node3 x:movereplicatest_failed_coll_shard1_replica_n1] o.a.s.c.SolrCore [movereplicatest_failed_coll_shard1_replica_n1] Registered new searcher Searcher@4b06d447[movereplicatest_failed_coll_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 226569 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 226569 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 226569 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:34977/solr/movereplicatest_failed_coll_shard2_replica_n6/
   [junit4]   2> 226570 INFO  (zkCallback-257-thread-2-processing-n:127.0.0.1:42241_solr) [n:127.0.0.1:42241_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/movereplicatest_failed_coll/state.json] for collection [movereplicatest_failed_coll] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 226570 INFO  (zkCallback-256-thread-1-processing-n:127.0.0.1:34977_solr) [n:127.0.0.1:34977_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/movereplicatest_failed_coll/state.json] for collection [movereplicatest_failed_coll] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 226570 INFO  (zkCallback-257-thread-1-processing-n:127.0.0.1:42241_solr) [n:127.0.0.1:42241_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/movereplicatest_failed_coll/state.json] for collection [movereplicatest_failed_coll] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 226570 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.u.PeerSync PeerSync: core=movereplicatest_failed_coll_shard2_replica_n6 url=http://127.0.0.1:34977/solr START replicas=[http://127.0.0.1:46169/solr/movereplicatest_failed_coll_shard2_replica_n4/] nUpdates=100
   [junit4]   2> 226570 INFO  (zkCallback-256-thread-2-processing-n:127.0.0.1:34977_solr) [n:127.0.0.1:34977_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/movereplicatest_failed_coll/state.json] for collection [movereplicatest_failed_coll] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 226570 INFO  (zkCallback-255-thread-1-processing-n:127.0.0.1:46169_solr) [n:127.0.0.1:46169_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/movereplicatest_failed_coll/state.json] for collection [movereplicatest_failed_coll] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 226570 INFO  (zkCallback-255-thread-2-processing-n:127.0.0.1:46169_solr) [n:127.0.0.1:46169_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/movereplicatest_failed_coll/state.json] for collection [movereplicatest_failed_coll] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 226570 INFO  (zkCallback-253-thread-2-processing-n:127.0.0.1:42687_solr) [n:127.0.0.1:42687_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/movereplicatest_failed_coll/state.json] for collection [movereplicatest_failed_coll] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 226570 INFO  (zkCallback-253-thread-1-processing-n:127.0.0.1:42687_solr) [n:127.0.0.1:42687_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/movereplicatest_failed_coll/state.json] for collection [movereplicatest_failed_coll] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 226571 INFO  (qtp434916654-1257) [n:127.0.0.1:42241_solr c:movereplicatest_failed_coll s:shard1 r:core_node3 x:movereplicatest_failed_coll_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582230859420794880
   [junit4]   2> 226572 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 226572 INFO  (qtp296257570-1264) [n:127.0.0.1:46169_solr c:movereplicatest_failed_coll s:shard2 r:core_node7 x:movereplicatest_failed_coll_shard2_replica_n4] o.a.s.c.S.Request [movereplicatest_failed_coll_shard2_replica_n4]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 226673 INFO  (zkCallback-253-thread-2-processing-n:127.0.0.1:42687_solr) [n:127.0.0.1:42687_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/movereplicatest_failed_coll/state.json] for collection [movereplicatest_failed_coll] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 226673 INFO  (zkCallback-257-thread-1-processing-n:127.0.0.1:42241_solr) [n:127.0.0.1:42241_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/movereplicatest_failed_coll/state.json] for collection [movereplicatest_failed_coll] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 226673 INFO  (zkCallback-255-thread-2-processing-n:127.0.0.1:46169_solr) [n:127.0.0.1:46169_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/movereplicatest_failed_coll/state.json] for collection [movereplicatest_failed_coll] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 226673 INFO  (zkCallback-255-thread-1-processing-n:127.0.0.1:46169_solr) [n:127.0.0.1:46169_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/movereplicatest_failed_coll/state.json] for collection [movereplicatest_failed_coll] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 226673 INFO  (zkCallback-256-thread-1-processing-n:127.0.0.1:34977_solr) [n:127.0.0.1:34977_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/movereplicatest_failed_coll/state.json] for collection [movereplicatest_failed_coll] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 226673 INFO  (zkCallback-253-thread-1-processing-n:127.0.0.1:42687_solr) [n:127.0.0.1:42687_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/movereplicatest_failed_coll/state.json] for collection [movereplicatest_failed_coll] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 226673 INFO  (zkCallback-256-thread-2-processing-n:127.0.0.1:34977_solr) [n:127.0.0.1:34977_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/movereplicatest_failed_coll/state.json] for collection [movereplicatest_failed_coll] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 226673 INFO  (zkCallback-257-thread-2-processing-n:127.0.0.1:42241_solr) [n:127.0.0.1:42241_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/movereplicatest_failed_coll/state.json] for collection [movereplicatest_failed_coll] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 226870 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.u.PeerSync PeerSync: core=movereplicatest_failed_coll_shard2_replica_n6 url=http://127.0.0.1:34977/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 226870 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 226870 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 226870 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 226876 INFO  (qtp678491577-1274) [n:127.0.0.1:34977_solr c:movereplicatest_failed_coll s:shard2 r:core_node8 x:movereplicatest_failed_coll_shard2_replica_n6] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:34977/solr/movereplicatest_failed_coll_shard2_replica_n6/ shard2
   [junit4]   2> 227073 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 227073 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 227073 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:42687/solr/movereplicatest_failed_coll_shard1_replica_n2/
   [junit4]   2> 227073 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=movereplicatest_failed_coll_shard1_replica_n2 url=http://127.0.0.1:42687/solr START replicas=[http://127.0.0.1:42241/solr/movereplicatest_failed_coll_shard1_replica_n1/] nUpdates=100
   [junit4]   2> 227076 INFO  (qtp434916654-1260) [n:127.0.0.1:42241_solr c:movereplicatest_failed_coll s:shard1 r:core_node3 x:movereplicatest_failed_coll_shard1_replica_n1] o.a.s.c.S.Request [movereplicatest_failed_coll_shard1_replica_n1]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 227374 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=movereplicatest_failed_coll_shard1_replica_n2 url=http://127.0.0.1:42687/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 227374 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 227374 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 227374 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 227379 INFO  (qtp1064890825-1258) [n:127.0.0.1:42687_solr c:movereplicatest_failed_coll s:shard1 r:core_node5 x:movereplicatest_failed_coll_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:42687/solr/movereplicatest_failed_coll_shard1_replica_n2/ shard1
   [junit4]   2> 404105 ERROR (qtp434916654-1267) [n:127.0.0.1:42241_solr    ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: create the collection time out:180s
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:312)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:244)
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:222)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:

[...truncated too long message...]

nHandler.java:174)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.solr.common.SolrException: No registered leader was found after waiting for 1220000ms , collection: movereplicatest_failed_coll slice: shard2 saw state=null with live_nodes=[]
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:816)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:781)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1178)
   [junit4]   2> 	... 41 more
   [junit4]   2> 
   [junit4]   2> 614286 INFO  (qtp296257570-1278) [n:127.0.0.1:46169_solr c:movereplicatest_failed_coll s:shard2 r:core_node7 x:movereplicatest_failed_coll_shard2_replica_n4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf1&newCollection=true&name=movereplicatest_failed_coll_shard2_replica_n4&action=CREATE&numShards=2&collection=movereplicatest_failed_coll&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=389855
   [junit4]   2> 614287 ERROR (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 614287 INFO  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41835 41835
   [junit4]   2> 620070 INFO  (Thread-283) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41835 41835
   [junit4]   2> 620072 WARN  (Thread-283) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	7	/solr/aliases.json
   [junit4]   2> 	7	/solr/clusterprops.json
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 	4	/solr/configs/conf1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	20	/solr/collections/movereplicatest_failed_coll/state.json
   [junit4]   2> 	7	/solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	8	/solr/collections
   [junit4]   2> 	7	/solr/live_nodes
   [junit4]   2> 
   [junit4]   2> 620074 WARN  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.a.h.h.s.d.DirectoryScanner DirectoryScanner: shutdown has been called
   [junit4]   2> 620087 INFO  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
   [junit4]   2> 620189 WARN  (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_A5CCBFB8831449CC-001/tempDir-002/hdfsBaseDir/data/data3/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_A5CCBFB8831449CC-001/tempDir-002/hdfsBaseDir/data/data4/]]  heartbeating to localhost.localdomain/127.0.0.1:41005) [    ] o.a.h.h.s.d.IncrementalBlockReportManager IncrementalBlockReportManager interrupted
   [junit4]   2> 620189 WARN  (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_A5CCBFB8831449CC-001/tempDir-002/hdfsBaseDir/data/data3/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_A5CCBFB8831449CC-001/tempDir-002/hdfsBaseDir/data/data4/]]  heartbeating to localhost.localdomain/127.0.0.1:41005) [    ] o.a.h.h.s.d.DataNode Ending block pool service for: Block pool BP-588554403-88.99.242.108-1508932927024 (Datanode Uuid 4d8471fa-215a-4f76-8347-a2f84bc218fd) service to localhost.localdomain/127.0.0.1:41005
   [junit4]   2> 620193 WARN  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.a.h.h.s.d.DirectoryScanner DirectoryScanner: shutdown has been called
   [junit4]   2> 620202 INFO  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
   [junit4]   2> 620303 WARN  (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_A5CCBFB8831449CC-001/tempDir-002/hdfsBaseDir/data/data1/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_A5CCBFB8831449CC-001/tempDir-002/hdfsBaseDir/data/data2/]]  heartbeating to localhost.localdomain/127.0.0.1:41005) [    ] o.a.h.h.s.d.IncrementalBlockReportManager IncrementalBlockReportManager interrupted
   [junit4]   2> 620304 WARN  (DataNode: [[[DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_A5CCBFB8831449CC-001/tempDir-002/hdfsBaseDir/data/data1/, [DISK]file:/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_A5CCBFB8831449CC-001/tempDir-002/hdfsBaseDir/data/data2/]]  heartbeating to localhost.localdomain/127.0.0.1:41005) [    ] o.a.h.h.s.d.DataNode Ending block pool service for: Block pool BP-588554403-88.99.242.108-1508932927024 (Datanode Uuid 1bbd2fdf-6612-4591-a791-8ae709a8131e) service to localhost.localdomain/127.0.0.1:41005
   [junit4]   2> 620326 INFO  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0
   [junit4]   2> 620457 INFO  (SUITE-MoveReplicaHDFSTest-seed#[A5CCBFB8831449CC]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41835 41835
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.MoveReplicaHDFSTest_A5CCBFB8831449CC-001
   [junit4]   2> Oct 25, 2017 12:08:47 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 66 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=678, maxMBSortInHeap=6.209549580760092, sim=RandomSimilarity(queryNorm=false): {}, locale=zh-HK, timezone=Etc/GMT+1
   [junit4]   2> NOTE: Linux 4.10.0-33-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=8,threads=5,free=307258632,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [TestCollationField, NodeMutatorTest, TestDynamicFieldResource, CollectionsAPIDistributedZkTest, TestConfigSetsAPIZkFailure, TestNonDefinedSimilarityFactory, TestCollectionsAPIViaSolrCloudCluster, MoveReplicaHDFSTest]
   [junit4] Completed [128/744 (1!)] on J1 in 410.82s, 2 tests, 2 errors <<< FAILURES!

[...truncated 49302 lines...]

[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_144) - Build # 665 - Still unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/665/
Java: 32bit/jdk1.8.0_144 -server -XX:+UseG1GC

2 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth:     1) Thread[id=1336, name=jetty-launcher-252-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth: 
   1) Thread[id=1336, name=jetty-launcher-252-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
        at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
        at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
        at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
        at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
        at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
        at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
        at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
        at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
	at __randomizedtesting.SeedInfo.seed([DA50A602DC832462]:0)


FAILED:  org.apache.solr.cloud.autoscaling.ExecutePlanActionTest.testIntegration

Error Message:
Timed out waiting for replicas of collection to be 2 again null Live Nodes: [127.0.0.1:34457_solr] Last available state: DocCollection(testIntegration//collections/testIntegration/state.json/9)={   "pullReplicas":"0",   "replicationFactor":"2",   "shards":{"shard1":{       "range":"80000000-7fffffff",       "state":"active",       "replicas":{         "core_node3":{           "core":"testIntegration_shard1_replica_n1",           "base_url":"https://127.0.0.1:34457/solr",           "node_name":"127.0.0.1:34457_solr",           "state":"active",           "type":"NRT",           "leader":"true"},         "core_node4":{           "core":"testIntegration_shard1_replica_n2",           "base_url":"https://127.0.0.1:42271/solr",           "node_name":"127.0.0.1:42271_solr",           "state":"down",           "type":"NRT"}}}},   "router":{"name":"compositeId"},   "maxShardsPerNode":"1",   "autoAddReplicas":"false",   "nrtReplicas":"2",   "tlogReplicas":"0"}

Stack Trace:
java.lang.AssertionError: Timed out waiting for replicas of collection to be 2 again
null
Live Nodes: [127.0.0.1:34457_solr]
Last available state: DocCollection(testIntegration//collections/testIntegration/state.json/9)={
  "pullReplicas":"0",
  "replicationFactor":"2",
  "shards":{"shard1":{
      "range":"80000000-7fffffff",
      "state":"active",
      "replicas":{
        "core_node3":{
          "core":"testIntegration_shard1_replica_n1",
          "base_url":"https://127.0.0.1:34457/solr",
          "node_name":"127.0.0.1:34457_solr",
          "state":"active",
          "type":"NRT",
          "leader":"true"},
        "core_node4":{
          "core":"testIntegration_shard1_replica_n2",
          "base_url":"https://127.0.0.1:42271/solr",
          "node_name":"127.0.0.1:42271_solr",
          "state":"down",
          "type":"NRT"}}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"1",
  "autoAddReplicas":"false",
  "nrtReplicas":"2",
  "tlogReplicas":"0"}
	at __randomizedtesting.SeedInfo.seed([DA50A602DC832462:6A31A82EF9BC8547]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:269)
	at org.apache.solr.cloud.autoscaling.ExecutePlanActionTest.testIntegration(ExecutePlanActionTest.java:209)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 11777 lines...]
   [junit4] Suite: org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.security.hadoop.TestImpersonationWithHadoopAuth_DA50A602DC832462-001/init-core-data-001
   [junit4]   2> 243868 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[DA50A602DC832462]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 243869 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[DA50A602DC832462]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 243869 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[DA50A602DC832462]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 243913 WARN  (SUITE-TestImpersonationWithHadoopAuth-seed#[DA50A602DC832462]-worker) [    ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
   [junit4]   2> 243990 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[DA50A602DC832462]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.security.hadoop.TestImpersonationWithHadoopAuth_DA50A602DC832462-001/tempDir-001
   [junit4]   2> 243991 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[DA50A602DC832462]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 243991 INFO  (Thread-238) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 243991 INFO  (Thread-238) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 243992 ERROR (Thread-238) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 244091 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[DA50A602DC832462]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:38287
   [junit4]   2> 244100 INFO  (jetty-launcher-252-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 244100 INFO  (jetty-launcher-252-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 244102 INFO  (jetty-launcher-252-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1a2c6f5{/solr,null,AVAILABLE}
   [junit4]   2> 244102 INFO  (jetty-launcher-252-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@778322{/solr,null,AVAILABLE}
   [junit4]   2> 244104 INFO  (jetty-launcher-252-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@c0e63a{HTTP/1.1,[http/1.1]}{127.0.0.1:41933}
   [junit4]   2> 244105 INFO  (jetty-launcher-252-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@15f3243{HTTP/1.1,[http/1.1]}{127.0.0.1:42689}
   [junit4]   2> 244105 INFO  (jetty-launcher-252-thread-2) [    ] o.e.j.s.Server Started @245622ms
   [junit4]   2> 244105 INFO  (jetty-launcher-252-thread-1) [    ] o.e.j.s.Server Started @245622ms
   [junit4]   2> 244105 INFO  (jetty-launcher-252-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41933}
   [junit4]   2> 244105 INFO  (jetty-launcher-252-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42689}
   [junit4]   2> 244105 ERROR (jetty-launcher-252-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 244105 ERROR (jetty-launcher-252-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 244105 INFO  (jetty-launcher-252-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 244105 INFO  (jetty-launcher-252-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 244105 INFO  (jetty-launcher-252-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 244105 INFO  (jetty-launcher-252-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 244105 INFO  (jetty-launcher-252-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 244105 INFO  (jetty-launcher-252-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 244105 INFO  (jetty-launcher-252-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T09:06:43.853Z
   [junit4]   2> 244105 INFO  (jetty-launcher-252-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T09:06:43.853Z
   [junit4]   2> 244108 INFO  (jetty-launcher-252-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 244108 INFO  (jetty-launcher-252-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 244120 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f52c8ab9c0002, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 244124 INFO  (jetty-launcher-252-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38287/solr
   [junit4]   2> 244127 INFO  (jetty-launcher-252-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38287/solr
   [junit4]   2> 244183 INFO  (jetty-launcher-252-thread-1) [n:127.0.0.1:42689_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 244183 INFO  (jetty-launcher-252-thread-2) [n:127.0.0.1:41933_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 244184 INFO  (jetty-launcher-252-thread-1) [n:127.0.0.1:42689_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42689_solr
   [junit4]   2> 244184 INFO  (jetty-launcher-252-thread-2) [n:127.0.0.1:41933_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41933_solr
   [junit4]   2> 244184 INFO  (jetty-launcher-252-thread-1) [n:127.0.0.1:42689_solr    ] o.a.s.c.Overseer Overseer (id=98888738651504646-127.0.0.1:42689_solr-n_0000000000) starting
   [junit4]   2> 244184 INFO  (zkCallback-263-thread-1-processing-n:127.0.0.1:41933_solr) [n:127.0.0.1:41933_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 244185 INFO  (zkCallback-264-thread-1-processing-n:127.0.0.1:42689_solr) [n:127.0.0.1:42689_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 244188 INFO  (jetty-launcher-252-thread-1) [n:127.0.0.1:42689_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42689_solr
   [junit4]   2> 244188 INFO  (zkCallback-264-thread-1-processing-n:127.0.0.1:42689_solr) [n:127.0.0.1:42689_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 244188 INFO  (zkCallback-263-thread-1-processing-n:127.0.0.1:41933_solr) [n:127.0.0.1:41933_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 244226 INFO  (jetty-launcher-252-thread-2) [n:127.0.0.1:41933_solr    ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HadoopAuthPlugin
   [junit4]   2> 244229 INFO  (jetty-launcher-252-thread-1) [n:127.0.0.1:42689_solr    ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HadoopAuthPlugin
   [junit4]   2> 244240 INFO  (jetty-launcher-252-thread-1) [n:127.0.0.1:42689_solr    ] o.a.s.s.HadoopAuthPlugin Params: {proxyuser.anyHostUsersGroup.hosts=*, proxyuser.wrongHost.hosts=1.1.1.1.1.1, proxyuser.bogusGroup.groups=__some_bogus_group, proxyuser.localHostAnyGroup.groups=*, cookie.domain=127.0.0.1, proxyuser.wrongHost.groups=*, type=simple, proxyuser.noHosts.groups=*, proxyuser.anyHostUsersGroup.groups=jenkins, proxyuser.noGroups.hosts=*, proxyuser.anyHostAnyUser.groups=*, delegation-token.token-kind=solr-dt, proxyuser.bogusGroup.hosts=*, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, signer.secret.provider.zookeeper.path=/token, zk-dt-secret-manager.enable=true, proxyuser.localHostAnyGroup.hosts=localhost.localdomain,localhost,127.0.0.1, proxyuser.anyHostAnyUser.hosts=*, signer.secret.provider=zookeeper}
   [junit4]   2> 244240 INFO  (jetty-launcher-252-thread-2) [n:127.0.0.1:41933_solr    ] o.a.s.s.HadoopAuthPlugin Params: {proxyuser.anyHostUsersGroup.hosts=*, proxyuser.wrongHost.hosts=1.1.1.1.1.1, proxyuser.bogusGroup.groups=__some_bogus_group, proxyuser.localHostAnyGroup.groups=*, cookie.domain=127.0.0.1, proxyuser.wrongHost.groups=*, type=simple, proxyuser.noHosts.groups=*, proxyuser.anyHostUsersGroup.groups=jenkins, proxyuser.noGroups.hosts=*, proxyuser.anyHostAnyUser.groups=*, delegation-token.token-kind=solr-dt, proxyuser.bogusGroup.hosts=*, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, signer.secret.provider.zookeeper.path=/token, zk-dt-secret-manager.enable=true, proxyuser.localHostAnyGroup.hosts=localhost.localdomain,localhost,127.0.0.1, proxyuser.anyHostAnyUser.hosts=*, signer.secret.provider=zookeeper}
   [junit4]   2> 244304 INFO  (jetty-launcher-252-thread-2) [n:127.0.0.1:41933_solr    ] o.a.c.f.i.CuratorFrameworkImpl Starting
   [junit4]   2> 244304 INFO  (jetty-launcher-252-thread-1) [n:127.0.0.1:42689_solr    ] o.a.c.f.i.CuratorFrameworkImpl Starting
   [junit4]   2> 244316 INFO  (jetty-launcher-252-thread-1-EventThread) [n:127.0.0.1:42689_solr    ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
   [junit4]   2> 244316 INFO  (jetty-launcher-252-thread-2-EventThread) [n:127.0.0.1:41933_solr    ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
   [junit4]   2> 244401 INFO  (jetty-launcher-252-thread-1) [n:127.0.0.1:42689_solr    ] o.a.s.c.CoreContainer PKIAuthenticationPlugin is managing internode requests
   [junit4]   2> 244401 INFO  (jetty-launcher-252-thread-2) [n:127.0.0.1:41933_solr    ] o.a.s.c.CoreContainer PKIAuthenticationPlugin is managing internode requests
   [junit4]   2> 244428 INFO  (jetty-launcher-252-thread-1) [n:127.0.0.1:42689_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42689.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1472ff8
   [junit4]   2> 244429 INFO  (jetty-launcher-252-thread-2) [n:127.0.0.1:41933_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41933.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1472ff8
   [junit4]   2> 244434 INFO  (jetty-launcher-252-thread-1) [n:127.0.0.1:42689_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42689.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1472ff8
   [junit4]   2> 244434 INFO  (jetty-launcher-252-thread-1) [n:127.0.0.1:42689_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42689.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1472ff8
   [junit4]   2> 244434 INFO  (jetty-launcher-252-thread-1) [n:127.0.0.1:42689_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.security.hadoop.TestImpersonationWithHadoopAuth_DA50A602DC832462-001/tempDir-001/node1/.
   [junit4]   2> 244435 INFO  (jetty-launcher-252-thread-2) [n:127.0.0.1:41933_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41933.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1472ff8
   [junit4]   2> 244435 INFO  (jetty-launcher-252-thread-2) [n:127.0.0.1:41933_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41933.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1472ff8
   [junit4]   2> 244436 INFO  (jetty-launcher-252-thread-2) [n:127.0.0.1:41933_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.security.hadoop.TestImpersonationWithHadoopAuth_DA50A602DC832462-001/tempDir-001/node2/.
   [junit4]   2> 244465 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[DA50A602DC832462]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 244465 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[DA50A602DC832462]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38287/solr ready
   [junit4]   2> 244477 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyNullProxyUser-seed#[DA50A602DC832462]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNullProxyUser
   [junit4]   2> 244486 INFO  (qtp16593301-1299) [    ] o.a.s.s.SolrDispatchFilter Error authenticating
   [junit4]   2> java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.PseudoAuthenticationHandler.authenticate(PseudoAuthenticationHandler.java:195)
   [junit4]   2> 	at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
   [junit4]   2> 	at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
   [junit4]   2> 	at org.apache.solr.security.HadoopAuthFilter.doFilter(HadoopAuthFilter.java:110)
   [junit4]   2> 	at org.apache.solr.security.HadoopAuthPlugin.doAuthenticate(HadoopAuthPlugin.java:245)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:451)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 244487 WARN  (qtp16593301-1299) [    ] o.e.j.s.ServletHandler /solr/admin/collections
   [junit4]   2> org.apache.solr.common.SolrException: Error during request authentication, 
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:457)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.PseudoAuthenticationHandler.authenticate(PseudoAuthenticationHandler.java:195)
   [junit4]   2> 	at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
   [junit4]   2> 	at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
   [junit4]   2> 	at org.apache.solr.security.HadoopAuthFilter.doFilter(HadoopAuthFilter.java:110)
   [junit4]   2> 	at org.apache.solr.security.HadoopAuthPlugin.doAuthenticate(HadoopAuthPlugin.java:245)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:451)
   [junit4]   2> 	... 26 more
   [junit4]   2> 244491 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyNullProxyUser-seed#[DA50A602DC832462]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNullProxyUser
   [junit4]   2> 244501 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyValidateGroup-seed#[DA50A602DC832462]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateGroup
   [junit4]   2> 244529 INFO  (qtp16593301-1287) [n:127.0.0.1:42689_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=jenkins&action=LIST&user.name=anyHostUsersGroup&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 244529 INFO  (qtp16593301-1287) [n:127.0.0.1:42689_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=jenkins&action=LIST&user.name=anyHostUsersGroup&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 244533 WARN  (TEST-TestImpersonationWithHadoopAuth.testProxyValidateGroup-seed#[DA50A602DC832462]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostUsersGroup&p=anyHostUsersGroup&t=simple-dt&e=1508958404250&s=4xhxFDZakWFKVhTDQfahE7hGUys="; Domain=127.0.0.1; Expires= , 25-   -2017 19:06:44 GMT; HttpOnly". Invalid 'expires' attribute: , 25- -2017 19:06:44 GMT
   [junit4]   2> 244534 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyValidateGroup-seed#[DA50A602DC832462]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateGroup
   [junit4]   2> 244542 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyWrongHost-seed#[DA50A602DC832462]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyWrongHost
   [junit4]   2> 258922 WARN  (jetty-launcher-252-thread-2-SendThread(127.0.0.1:38287)) [n:127.0.0.1:41933_solr    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 14486ms for sessionid 0x15f52c8ab9c0005
   [junit4]   2> 258922 WARN  (jetty-launcher-252-thread-1-SendThread(127.0.0.1:38287)) [n:127.0.0.1:42689_solr    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 14527ms for sessionid 0x15f52c8ab9c0008
   [junit4]   2> 258922 WARN  (jetty-launcher-252-thread-1-SendThread(127.0.0.1:38287)) [n:127.0.0.1:42689_solr    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 14487ms for sessionid 0x15f52c8ab9c0006
   [junit4]   2> 258922 WARN  (jetty-launcher-252-thread-2-SendThread(127.0.0.1:38287)) [n:127.0.0.1:41933_solr    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 14526ms for sessionid 0x15f52c8ab9c0007
   [junit4]   2> 258922 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f52c8ab9c0005, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 258923 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f52c8ab9c0008, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 258923 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f52c8ab9c0007, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 258923 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f52c8ab9c0006, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 259023 WARN  (zkCallback-264-thread-1-processing-n:127.0.0.1:42689_solr) [n:127.0.0.1:42689_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1cbb2ad name: ZooKeeperConnection Watcher:127.0.0.1:38287/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
   [junit4]   2> 259023 WARN  (zkCallback-264-thread-1-processing-n:127.0.0.1:42689_solr) [n:127.0.0.1:42689_solr    ] o.a.s.c.c.ConnectionManager zkClient has disconnected
   [junit4]   2> 259031 WARN  (zkCallback-271-thread-3) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@129313 name: ZooKeeperConnection Watcher:127.0.0.1:38287/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
   [junit4]   2> 259031 WARN  (zkCallback-271-thread-3) [    ] o.a.s.c.c.ConnectionManager zkClient has disconnected
   [junit4]   2> 259041 WARN  (zkCallback-263-thread-4-processing-n:127.0.0.1:41933_solr) [n:127.0.0.1:41933_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@14e2fcb name: ZooKeeperConnection Watcher:127.0.0.1:38287/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
   [junit4]   2> 259041 WARN  (zkCallback-263-thread-4-processing-n:127.0.0.1:41933_solr) [n:127.0.0.1:41933_solr    ] o.a.s.c.c.ConnectionManager zkClient has disconnected
   [junit4]   2> 259235 WARN  (TEST-TestImpersonationWithHadoopAuth.testProxyWrongHost-seed#[DA50A602DC832462]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=wrongHost&p=wrongHost&t=simple-dt&e=1508958404292&s=mVGLVXAqXH7N656PeDvLRZCSiAs="; Domain=127.0.0.1; Expires= , 25-   -2017 19:06:44 GMT; HttpOnly". Invalid 'expires' attribute: , 25- -2017 19:06:44 GMT
   [junit4]   2> 259235 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyWrongHost-seed#[DA50A602DC832462]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyWrongHost
   [junit4]   2> 259249 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyValidateHost-seed#[DA50A602DC832462]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateHost
   [junit4]   2> 259251 INFO  (qtp16593301-1291) [n:127.0.0.1:42689_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&user.name=localHostAnyGroup&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 259251 INFO  (qtp16593301-1291) [n:127.0.0.1:42689_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&user.name=localHostAnyGroup&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 259252 WARN  (TEST-TestImpersonationWithHadoopAuth.testProxyValidateHost-seed#[DA50A602DC832462]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=simple-dt&e=1508958418999&s=IrgZdqhEoc0qWCB6lwLEONCikN0="; Domain=127.0.0.1; Expires= , 25-   -2017 19:06:58 GMT; HttpOnly". Invalid 'expires' attribute: , 25- -2017 19:06:58 GMT
   [junit4]   2> 259252 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyValidateHost-seed#[DA50A602DC832462]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateHost
   [junit4]   2> 259263 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyValidateAnyHostAnyUser-seed#[DA50A602DC832462]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateAnyHostAnyUser
   [junit4]   2> 259264 INFO  (qtp16593301-1291) [n:127.0.0.1:42689_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&user.name=anyHostAnyUser&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 259264 INFO  (qtp16593301-1291) [n:127.0.0.1:42689_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&user.name=anyHostAnyUser&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 259265 WARN  (TEST-TestImpersonationWithHadoopAuth.testProxyValidateAnyHostAnyUser-seed#[DA50A602DC832462]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostAnyUser&p=anyHostAnyUser&t=simple-dt&e=1508958419012&s=JtFQrofhWpYfdVeKYhfgGS00HfI="; Domain=127.0.0.1; Expires= , 25-   -2017 19:06:59 GMT; HttpOnly". Invalid 'expires' attribute: , 25- -2017 19:06:59 GMT
   [junit4]   2> 259268 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyValidateAnyHostAnyUser-seed#[DA50A602DC832462]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateAnyHostAnyUser
   [junit4]   2> 259281 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigHosts-seed#[DA50A602DC832462]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigHosts
   [junit4]   2> 259289 WARN  (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigHosts-seed#[DA50A602DC832462]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noHosts&p=noHosts&t=simple-dt&e=1508958419034&s=9VZGppUrL0VVz/BTzZ8MBAiz/bQ="; Domain=127.0.0.1; Expires= , 25-   -2017 19:06:59 GMT; HttpOnly". Invalid 'expires' attribute: , 25- -2017 19:06:59 GMT
   [junit4]   2> 259289 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigHosts-seed#[DA50A602DC832462]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigHosts
   [junit4]   2> 259305 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigGroups-seed#[DA50A602DC832462]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigGroups
   [junit4]   2> 259309 WARN  (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigGroups-seed#[DA50A602DC832462]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noGroups&p=noGroups&t=simple-dt&e=1508958419054&s=/WReLnS3CgKflNwQ4NX6DxbHQO4="; Domain=127.0.0.1; Expires= , 25-   -2017 19:06:59 GMT; HttpOnly". Invalid 'expires' attribute: , 25- -2017 19:06:59 GMT
   [junit4]   2> 259309 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigGroups-seed#[DA50A602DC832462]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigGroups
   [junit4] IGNOR/A 0.01s J2 | TestImpersonationWithHadoopAuth.testForwarding
   [junit4]    > Assumption #1: 'awaitsfix' test group is disabled (@AwaitsFix(bugUrl=https://issues.apache.org/jira/browse/HADOOP-9893))
   [junit4]   2> 259332 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidProxyUser-seed#[DA50A602DC832462]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidProxyUser
   [junit4]   2> 259336 WARN  (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidProxyUser-seed#[DA50A602DC832462]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bar&p=bar&t=simple-dt&e=1508958419082&s=dFUxZtKyqt2henv949Icat4JHTE="; Domain=127.0.0.1; Expires= , 25-   -2017 19:06:59 GMT; HttpOnly". Invalid 'expires' attribute: , 25- -2017 19:06:59 GMT
   [junit4]   2> 259336 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidProxyUser-seed#[DA50A602DC832462]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidProxyUser
   [junit4]   2> 259354 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidGroup-seed#[DA50A602DC832462]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidGroup
   [junit4]   2> 259370 WARN  (qtp16593301-1287) [n:127.0.0.1:42689_solr    ] o.a.h.s.ShellBasedUnixGroupsMapping got exception trying to get groups for user bar: id: ‘bar’: no such user
   [junit4]   2> id: ‘bar’: no such user
   [junit4]   2> 
   [junit4]   2> 259373 WARN  (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidGroup-seed#[DA50A602DC832462]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bogusGroup&p=bogusGroup&t=simple-dt&e=1508958419103&s=dIfWnXd5yL0NJYd2HJUUFvU46xQ="; Domain=127.0.0.1; Expires= , 25-   -2017 19:06:59 GMT; HttpOnly". Invalid 'expires' attribute: , 25- -2017 19:06:59 GMT
   [junit4]   2> 259373 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidGroup-seed#[DA50A602DC832462]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidGroup
   [junit4]   2> 259559 INFO  (jetty-closer-253-thread-2) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@c0e63a{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 259559 INFO  (jetty-closer-253-thread-2) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=13388675
   [junit4]   2> 259559 INFO  (jetty-closer-253-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 259559 INFO  (jetty-closer-253-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@db7276: rootName = solr_41933, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@169d41c
   [junit4]   2> 259559 INFO  (jetty-closer-253-thread-1) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@15f3243{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 259559 INFO  (jetty-closer-253-thread-1) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1323663
   [junit4]   2> 259559 INFO  (jetty-closer-253-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 259559 INFO  (jetty-closer-253-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@c5d31: rootName = solr_42689, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1ffd9a9
   [junit4]   2> 259564 INFO  (jetty-closer-253-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 259564 INFO  (jetty-closer-253-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@bf6eb2: rootName = solr_41933, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1e0d072
   [junit4]   2> 259566 INFO  (jetty-closer-253-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 259566 INFO  (jetty-closer-253-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@12d1983: rootName = solr_42689, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1e0d072
   [junit4]   2> 259567 INFO  (jetty-closer-253-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 259567 INFO  (jetty-closer-253-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1697058: rootName = solr_41933, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@17ee863
   [junit4]   2> 259571 INFO  (jetty-closer-253-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 259571 INFO  (jetty-closer-253-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5d6f35: rootName = solr_42689, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@17ee863
   [junit4]   2> 260324 INFO  (jetty-launcher-252-thread-2-EventThread) [n:127.0.0.1:41933_solr    ] o.a.c.f.s.ConnectionStateManager State change: SUSPENDED
   [junit4]   2> 260336 INFO  (jetty-closer-253-thread-2) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:41933_solr
   [junit4]   2> 260339 INFO  (jetty-closer-253-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 260340 INFO  (jetty-closer-253-thread-2) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 260340 INFO  (zkCallback-263-thread-3-processing-n:127.0.0.1:41933_solr) [n:127.0.0.1:41933_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 260340 ERROR (Thread[Thread-256,5,TGRP-TestImpersonationWithHadoopAuth]) [n:127.0.0.1:41933_solr    ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 260348 INFO  (jetty-closer-253-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1a2c6f5{/solr,null,UNAVAILABLE}
   [junit4]   2> 260579 INFO  (jetty-closer-253-thread-1) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:42689_solr
   [junit4]   2> 260579 INFO  (jetty-closer-253-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 260580 INFO  (jetty-closer-253-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 260582 INFO  (jetty-closer-253-thread-1) [    ] o.a.s.c.Overseer Overseer (id=98888738651504646-127.0.0.1:42689_solr-n_0000000000) closing
   [junit4]   2> 260582 INFO  (OverseerStateUpdate-98888738651504646-127.0.0.1:42689_solr-n_0000000000) [n:127.0.0.1:42689_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:42689_solr
   [junit4]   2> 260582 WARN  (OverseerAutoScalingTriggerThread-98888738651504646-127.0.0.1:42689_solr-n_0000000000) [n:127.0.0.1:42689_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 260582 INFO  (zkCallback-264-thread-2-processing-n:127.0.0.1:42689_solr) [n:127.0.0.1:42689_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0)
   [junit4]   2> 260584 ERROR (Thread[Thread-255,5,TGRP-TestImpersonationWithHadoopAuth]) [n:127.0.0.1:42689_solr    ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 260764 INFO  (jetty-closer-253-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@778322{/solr,null,UNAVAILABLE}
   [junit4]   2> 260768 ERROR (SUITE-TestImpersonationWithHadoopAuth-seed#[DA50A602DC832462]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 260768 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[DA50A602DC832462]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38287 38287
   [junit4]   2> 261156 INFO  (Thread-238) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38287 38287
   [junit4]   2> 261156 WARN  (Thread-238) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/aliases.json
   [junit4]   2> 	3	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	4	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMKeyIdRoot
   [junit4]   2> 	4	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMSeqNumRoot
   [junit4]   2> 	3	/solr/clusterstate.json
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_1
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_3
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_2
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_4
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	4	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot
   [junit4]   2> 	3	/solr/live_nodes
   [junit4]   2> 	3	/solr/collections
   [junit4]   2> 	3	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot
   [junit4]   2> 
   [junit4]   2> 261157 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[DA50A602DC832462]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> Oct 25, 2017 9:07:00 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> Oct 25, 2017 9:07:20 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth: 
   [junit4]   2>    1) Thread[id=1336, name=jetty-launcher-252-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
   [junit4]   2>         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
   [junit4]   2>         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
   [junit4]   2>         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]   2>         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
   [junit4]   2> Oct 25, 2017 9:07:20 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=1336, name=jetty-launcher-252-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
   [junit4]   2> 281212 ERROR (jetty-launcher-252-thread-2-EventThread) [n:127.0.0.1:41933_solr    ] o.a.c.f.i.CuratorFrameworkImpl Watcher exception
   [junit4]   2> java.lang.InterruptedException
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1039)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
   [junit4]   2> 	at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
   [junit4]   2> 	at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
   [junit4]   2> 	at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]   2> 	at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
   [junit4]   2> Oct 25, 2017 9:07:20 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: All leaked threads terminated.
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=921, maxMBSortInHeap=7.067794740045122, sim=RandomSimilarity(queryNorm=true): {}, locale=ar-YE, timezone=Asia/Qyzylorda
   [junit4]   2> NOTE: Linux 4.10.0-33-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=249183872,total=390070272
   [junit4]   2> NOTE: All tests run in this JVM: [TestGraphMLResponseWriter, SolrXmlInZkTest, ZkFailoverTest, TestDynamicLoading, TestShardHandlerFactory, TestFunctionQuery, TestMultiValuedNumericRangeQuery, WordBreakSolrSpellCheckerTest, TestSchemaSimilarityResource, BasicDistributedZk2Test, CollectionReloadTest, ZkNodePropsTest, TestImpersonationWithHadoopAuth]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestImpersonationWithHadoopAuth -Dtests.seed=DA50A602DC832462 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar-YE -Dtests.timezone=Asia/Qyzylorda -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J2 | TestImpersonationWithHadoopAuth (suite) <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth: 
   [junit4]    >    1) Thread[id=1336, name=jetty-launcher-252-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
   [junit4]    >         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
   [junit4]    >         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
   [junit4]    >         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
   [junit4]    >         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]    >         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]    >         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]    >         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]    >         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]    >         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]    >         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([DA50A602DC832462]:0)
   [junit4] Completed [84/744 (1!)] on J2 in 37.37s, 10 tests, 1 error, 1 skipped <<< FAILURES!

[...truncated 2114 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.ExecutePlanActionTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.ExecutePlanActionTest_DA50A602DC832462-001/init-core-data-001
   [junit4]   2> 2042556 WARN  (SUITE-ExecutePlanActionTest-seed#[DA50A602DC832462]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1399 numCloses=1399
   [junit4]   2> 2042556 INFO  (SUITE-ExecutePlanActionTest-seed#[DA50A602DC832462]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 2042557 INFO  (SUITE-ExecutePlanActionTest-seed#[DA50A602DC832462]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 2042557 INFO  (SUITE-ExecutePlanActionTest-seed#[DA50A602DC832462]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 2042557 INFO  (SUITE-ExecutePlanActionTest-seed#[DA50A602DC832462]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.ExecutePlanActionTest_DA50A602DC832462-001/tempDir-001
   [junit4]   2> 2042557 INFO  (SUITE-ExecutePlanActionTest-seed#[DA50A602DC832462]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2042558 INFO  (Thread-7298) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2042558 INFO  (Thread-7298) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2042559 ERROR (Thread-7298) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2042658 INFO  (SUITE-ExecutePlanActionTest-seed#[DA50A602DC832462]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:45667
   [junit4]   2> 2042690 INFO  (jetty-launcher-5935-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2042690 INFO  (jetty-launcher-5935-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2042706 INFO  (jetty-launcher-5935-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@a0fdcf{/solr,null,AVAILABLE}
   [junit4]   2> 2042707 INFO  (jetty-launcher-5935-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@18dc1a8{/solr,null,AVAILABLE}
   [junit4]   2> 2042709 INFO  (jetty-launcher-5935-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@2abb74{SSL,[ssl, http/1.1]}{127.0.0.1:42271}
   [junit4]   2> 2042709 INFO  (jetty-launcher-5935-thread-2) [    ] o.e.j.s.Server Started @2044227ms
   [junit4]   2> 2042709 INFO  (jetty-launcher-5935-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42271}
   [junit4]   2> 2042709 INFO  (jetty-launcher-5935-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@135b416{SSL,[ssl, http/1.1]}{127.0.0.1:34457}
   [junit4]   2> 2042709 INFO  (jetty-launcher-5935-thread-1) [    ] o.e.j.s.Server Started @2044227ms
   [junit4]   2> 2042709 INFO  (jetty-launcher-5935-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34457}
   [junit4]   2> 2042709 ERROR (jetty-launcher-5935-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2042709 ERROR (jetty-launcher-5935-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2042709 INFO  (jetty-launcher-5935-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 2042709 INFO  (jetty-launcher-5935-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 2042709 INFO  (jetty-launcher-5935-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2042709 INFO  (jetty-launcher-5935-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2042709 INFO  (jetty-launcher-5935-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 2042710 INFO  (jetty-launcher-5935-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 2042710 INFO  (jetty-launcher-5935-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T09:36:42.458Z
   [junit4]   2> 2042710 INFO  (jetty-launcher-5935-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T09:36:42.458Z
   [junit4]   2> 2042713 INFO  (jetty-launcher-5935-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2042713 INFO  (jetty-launcher-5935-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2042723 INFO  (jetty-launcher-5935-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45667/solr
   [junit4]   2> 2042723 INFO  (jetty-launcher-5935-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45667/solr
   [junit4]   2> 2042764 INFO  (jetty-launcher-5935-thread-2) [n:127.0.0.1:42271_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2042764 INFO  (jetty-launcher-5935-thread-1) [n:127.0.0.1:34457_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2042764 INFO  (jetty-launcher-5935-thread-2) [n:127.0.0.1:42271_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42271_solr
   [junit4]   2> 2042764 INFO  (jetty-launcher-5935-thread-1) [n:127.0.0.1:34457_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34457_solr
   [junit4]   2> 2042764 INFO  (jetty-launcher-5935-thread-2) [n:127.0.0.1:42271_solr    ] o.a.s.c.Overseer Overseer (id=98888856522326021-127.0.0.1:42271_solr-n_0000000000) starting
   [junit4]   2> 2042765 INFO  (zkCallback-5947-thread-1-processing-n:127.0.0.1:34457_solr) [n:127.0.0.1:34457_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2042765 INFO  (zkCallback-5946-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2042768 DEBUG (OverseerAutoScalingTriggerThread-98888856522326021-127.0.0.1:42271_solr-n_0000000000) [n:127.0.0.1:42271_solr    ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
   [junit4]   2> 2042768 INFO  (jetty-launcher-5935-thread-2) [n:127.0.0.1:42271_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42271_solr
   [junit4]   2> 2042768 DEBUG (OverseerAutoScalingTriggerThread-98888856522326021-127.0.0.1:42271_solr-n_0000000000) [n:127.0.0.1:42271_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 2042768 INFO  (zkCallback-5946-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2042768 INFO  (zkCallback-5947-thread-1-processing-n:127.0.0.1:34457_solr) [n:127.0.0.1:34457_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2042768 DEBUG (OverseerAutoScalingTriggerThread-98888856522326021-127.0.0.1:42271_solr-n_0000000000) [n:127.0.0.1:42271_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:34457_solr, 127.0.0.1:42271_solr]
   [junit4]   2> 2042768 DEBUG (OverseerAutoScalingTriggerThread-98888856522326021-127.0.0.1:42271_solr-n_0000000000) [n:127.0.0.1:42271_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 2042768 DEBUG (OverseerAutoScalingTriggerThread-98888856522326021-127.0.0.1:42271_solr-n_0000000000) [n:127.0.0.1:42271_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 2042769 DEBUG (OverseerAutoScalingTriggerThread-98888856522326021-127.0.0.1:42271_solr-n_0000000000) [n:127.0.0.1:42271_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 2042769 DEBUG (OverseerAutoScalingTriggerThread-98888856522326021-127.0.0.1:42271_solr-n_0000000000) [n:127.0.0.1:42271_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 2042769 DEBUG (ScheduledTrigger-8976-thread-1) [n:127.0.0.1:42271_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:34457_solr, 127.0.0.1:42271_solr]
   [junit4]   2> 2042902 INFO  (jetty-launcher-5935-thread-2) [n:127.0.0.1:42271_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42271.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1472ff8
   [junit4]   2> 2042907 INFO  (jetty-launcher-5935-thread-2) [n:127.0.0.1:42271_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42271.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1472ff8
   [junit4]   2> 2042907 INFO  (jetty-launcher-5935-thread-2) [n:127.0.0.1:42271_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42271.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1472ff8
   [junit4]   2> 2042908 INFO  (jetty-launcher-5935-thread-2) [n:127.0.0.1:42271_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.ExecutePlanActionTest_DA50A602DC832462-001/tempDir-001/node2/.
   [junit4]   2> 2042941 INFO  (jetty-launcher-5935-thread-1) [n:127.0.0.1:34457_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34457.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1472ff8
   [junit4]   2> 2042946 INFO  (jetty-launcher-5935-thread-1) [n:127.0.0.1:34457_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34457.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1472ff8
   [junit4]   2> 2042946 INFO  (jetty-launcher-5935-thread-1) [n:127.0.0.1:34457_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34457.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1472ff8
   [junit4]   2> 2042947 INFO  (jetty-launcher-5935-thread-1) [n:127.0.0.1:34457_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.ExecutePlanActionTest_DA50A602DC832462-001/tempDir-001/node1/.
   [junit4]   2> 2042964 INFO  (SUITE-ExecutePlanActionTest-seed#[DA50A602DC832462]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2042964 INFO  (SUITE-ExecutePlanActionTest-seed#[DA50A602DC832462]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45667/solr ready
   [junit4]   2> 2043013 INFO  (TEST-ExecutePlanActionTest.testExecute-seed#[DA50A602DC832462]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testExecute
   [junit4]   2> 2043014 DEBUG (zkCallback-5946-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
   [junit4]   2> 2043014 DEBUG (OverseerAutoScalingTriggerThread-98888856522326021-127.0.0.1:42271_solr-n_0000000000) [n:127.0.0.1:42271_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 2043016 DEBUG (OverseerAutoScalingTriggerThread-98888856522326021-127.0.0.1:42271_solr-n_0000000000) [n:127.0.0.1:42271_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 2043016 DEBUG (OverseerAutoScalingTriggerThread-98888856522326021-127.0.0.1:42271_solr-n_0000000000) [n:127.0.0.1:42271_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 2043016 DEBUG (OverseerAutoScalingTriggerThread-98888856522326021-127.0.0.1:42271_solr-n_0000000000) [n:127.0.0.1:42271_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 2043042 INFO  (qtp14897804-31860) [n:127.0.0.1:34457_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&maxShardsPerNode=1&name=testExecute&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2043043 INFO  (OverseerThreadFactory-8978-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr    ] o.a.s.c.CreateCollectionCmd Create collection testExecute
   [junit4]   2> 2043150 INFO  (OverseerStateUpdate-98888856522326021-127.0.0.1:42271_solr-n_0000000000) [n:127.0.0.1:42271_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testExecute",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testExecute_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:34457/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2043151 INFO  (OverseerStateUpdate-98888856522326021-127.0.0.1:42271_solr-n_0000000000) [n:127.0.0.1:42271_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testExecute",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testExecute_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:42271/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 2043363 INFO  (qtp14897804-31856) [n:127.0.0.1:34457_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testExecute_shard1_replica_n1&action=CREATE&numShards=1&collection=testExecute&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2043364 INFO  (qtp14897804-31856) [n:127.0.0.1:34457_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2043403 INFO  (qtp28602008-31845) [n:127.0.0.1:42271_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=testExecute_shard1_replica_n2&action=CREATE&numShards=1&collection=testExecute&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2043403 INFO  (qtp28602008-31845) [n:127.0.0.1:42271_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2043506 INFO  (zkCallback-5946-thread-1-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testExecute/state.json] for collection [testExecute] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2043506 INFO  (zkCallback-5947-thread-1-processing-n:127.0.0.1:34457_solr) [n:127.0.0.1:34457_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testExecute/state.json] for collection [testExecute] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2043506 INFO  (zkCallback-5947-thread-2-processing-n:127.0.0.1:34457_solr) [n:127.0.0.1:34457_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testExecute/state.json] for collection [testExecute] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2043507 INFO  (zkCallback-5946-thread-2-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testExecute/state.json] for collection [testExecute] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2044380 INFO  (qtp14897804-31856) [n:127.0.0.1:34457_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 2044389 INFO  (qtp14897804-31856) [n:127.0.0.1:34457_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.s.IndexSchema [testExecute_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 2044392 INFO  (qtp14897804-31856) [n:127.0.0.1:34457_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2044392 INFO  (qtp14897804-31856) [n:127.0.0.1:34457_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testExecute_shard1_replica_n1' using configuration from collection testExecute, trusted=true
   [junit4]   2> 2044393 INFO  (qtp14897804-31856) [n:127.0.0.1:34457_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34457.solr.core.testExecute.shard1.replica_n1' (registry 'solr.core.testExecute.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1472ff8
   [junit4]   2> 2044393 INFO  (qtp14897804-31856) [n:127.0.0.1:34457_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2044393 INFO  (qtp14897804-31856) [n:127.0.0.1:34457_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.c.SolrCore [[testExecute_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.ExecutePlanActionTest_DA50A602DC832462-001/tempDir-001/node1/testExecute_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.ExecutePlanActionTest_DA50A602DC832462-001/tempDir-001/node1/./testExecute_shard1_replica_n1/data/]
   [junit4]   2> 2044411 INFO  (qtp28602008-31845) [n:127.0.0.1:42271_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 2044416 INFO  (qtp28602008-31845) [n:127.0.0.1:42271_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2] o.a.s.s.IndexSchema [testExecute_shard1_replica_n2] Schema name=minimal
   [junit4]   2> 2044418 INFO  (qtp28602008-31845) [n:127.0.0.1:42271_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2044418 INFO  (qtp28602008-31845) [n:127.0.0.1:42271_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'testExecute_shard1_replica_n2' using configuration from collection testExecute, trusted=true
   [junit4]   2> 2044418 INFO  (qtp28602008-31845) [n:127.0.0.1:42271_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42271.solr.core.testExecute.shard1.replica_n2' (registry 'solr.core.testExecute.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1472ff8
   [junit4]   2> 2044418 INFO  (qtp28602008-31845) [n:127.0.0.1:42271_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2044419 INFO  (qtp28602008-31845) [n:127.0.0.1:42271_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2] o.a.s.c.SolrCore [[testExecute_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.ExecutePlanActionTest_DA50A602DC832462-001/tempDir-001/node2/testExecute_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.ExecutePlanActionTest_DA50A602DC832462-001/tempDir-001/node2/./testExecute_shard1_replica_n2/data/]
   [junit4]   2> 2044434 INFO  (qtp14897804-31856) [n:127.0.0.1:34457_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2044434 INFO  (qtp14897804-31856) [n:127.0.0.1:34457_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2044435 INFO  (qtp14897804-31856) [n:127.0.0.1:34457_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2044435 INFO  (qtp14897804-31856) [n:127.0.0.1:34457_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2044436 INFO  (qtp14897804-31856) [n:127.0.0.1:34457_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@60d594[testExecute_shard1_replica_n1] main]
   [junit4]   2> 2044437 INFO  (qtp14897804-31856) [n:127.0.0.1:34457_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 2044437 INFO  (qtp14897804-31856) [n:127.0.0.1:34457_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 2044438 INFO  (qtp14897804-31856) [n:127.0.0.1:34457_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2044438 INFO  (searcherExecutor-8983-thread-1-processing-n:127.0.0.1:34457_solr x:testExecute_shard1_replica_n1 s:shard1 c:testExecute r:core_node3) [n:127.0.0.1:34457_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.c.SolrCore [testExecute_shard1_replica_n1] Registered new searcher Searcher@60d594[testExecute_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2044438 INFO  (qtp14897804-31856) [n:127.0.0.1:34457_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582221706328539136
   [junit4]   2> 2044442 INFO  (qtp14897804-31856) [n:127.0.0.1:34457_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 2044448 INFO  (qtp28602008-31845) [n:127.0.0.1:42271_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2044448 INFO  (qtp28602008-31845) [n:127.0.0.1:42271_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2044448 INFO  (qtp28602008-31845) [n:127.0.0.1:42271_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2044448 INFO  (qtp28602008-31845) [n:127.0.0.1:42271_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2044449 INFO  (qtp28602008-31845) [n:127.0.0.1:42271_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@1bb6ee8[testExecute_shard1_replica_n2] main]
   [junit4]   2> 2044450 INFO  (qtp28602008-31845) [n:127.0.0.1:42271_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 2044450 INFO  (qtp28602008-31845) [n:127.0.0.1:42271_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 2044451 INFO  (qtp28602008-31845) [n:127.0.0.1:42271_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2044451 INFO  (searcherExecutor-8984-thread-1-processing-n:127.0.0.1:42271_solr x:testExecute_shard1_replica_n2 s:shard1 c:testExecute r:core_node4) [n:127.0.0.1:42271_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2] o.a.s.c.SolrCore [testExecute_shard1_replica_n2] Registered new searcher Searcher@1bb6ee8[testExecute_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2044451 INFO  (qtp28602008-31845) [n:127.0.0.1:42271_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582221706342170624
   [junit4]   2> 2044543 INFO  (zkCallback-5947-thread-2-processing-n:127.0.0.1:34457_solr) [n:127.0.0.1:34457_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testExecute/state.json] for collection [testExecute] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2044543 INFO  (zkCallback-5946-thread-3-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testExecute/state.json] for collection [testExecute] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2044543 INFO  (zkCallback-5947-thread-1-processing-n:127.0.0.1:34457_solr) [n:127.0.0.1:34457_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testExecute/state.json] for collection [testExecute] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2044543 INFO  (zkCallback-5946-thread-2-processing-n:127.0.0.1:42271_solr) [n:127.0.0.1:42271_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testExecute/state.json] for collection [testExecute] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2044942 INFO  (qtp14897804-31856) [n:127.0.0.1:34457_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2044942 INFO  (qtp14897804-31856) [n:127.0.0.1:34457_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 2044942 INFO  (qtp14897804-31856) [n:127.0.0.1:34457_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:34457/solr/testExecute_shard1_replica_n1/
   [junit4]   2> 2044943 INFO  (qtp14897804-31856) [n:127.0.0.1:34457_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=testExecute_shard1_replica_n1 url=https://127.0.0.1:34457/solr START replicas=[https://127.0.0.1:42271/solr/testExecute_shard1_replica_n2/] nUpdates=100
   [junit4]   2> 2044947 INFO  (qtp28602008-31847) [n:127.0.0.1:42271

[...truncated too long message...]

cheduledTriggers.waitForPendingTasks(ScheduledTriggers.java:289)
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$2(ScheduledTriggers.java:221)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:460)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:867)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
   [junit4]   2> 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
   [junit4]   2> 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.SolrClientCloudManager.request(SolrClientCloudManager.java:99)
   [junit4]   2> 	... 9 more
   [junit4]   2> 2703315 WARN  (OverseerThreadFactory-9013-thread-1-processing-n:127.0.0.1:34457_solr) [n:127.0.0.1:34457_solr    ] o.a.s.c.MoveReplicaCmd Timed out waiting for leader's replica to recover, collection=testExecute shard=shard1 on node=127.0.0.1:34457_solr
   [junit4]   2> 2703319 INFO  (OverseerThreadFactory-9013-thread-1-processing-n:127.0.0.1:34457_solr) [n:127.0.0.1:34457_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 2703325 WARN  (OverseerAutoScalingTriggerThread-98888856522326022-127.0.0.1:34457_solr-n_0000000001) [n:127.0.0.1:34457_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 2703325 DEBUG (jetty-closer-5936-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 2703326 INFO  (jetty-closer-5936-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@18dc1a8{/solr,null,UNAVAILABLE}
   [junit4]   2> 2703327 ERROR (SUITE-ExecutePlanActionTest-seed#[DA50A602DC832462]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2703327 INFO  (SUITE-ExecutePlanActionTest-seed#[DA50A602DC832462]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45667 45667
   [junit4]   2> 2713398 INFO  (Thread-7298) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45667 45667
   [junit4]   2> 2713399 WARN  (Thread-7298) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	4	/solr/aliases.json
   [junit4]   2> 	3	/solr/configs/conf
   [junit4]   2> 	2	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	20	/solr/collections/testExecute/state.json
   [junit4]   2> 	19	/solr/collections/testIntegration/state.json
   [junit4]   2> 	4	/solr/clusterstate.json
   [junit4]   2> 	4	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/autoscaling.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	4	/solr/live_nodes
   [junit4]   2> 	4	/solr/collections
   [junit4]   2> 	2	/solr/overseer/queue
   [junit4]   2> 	2	/solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 	2	/solr/autoscaling/events/node_lost_trigger
   [junit4]   2> 	2	/solr/overseer/collection-queue-work
   [junit4]   2> 	2	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.ExecutePlanActionTest_DA50A602DC832462-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=799, maxMBSortInHeap=6.449806299090667, sim=RandomSimilarity(queryNorm=true): {}, locale=pl-PL, timezone=America/Guadeloupe
   [junit4]   2> NOTE: Linux 4.10.0-33-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=238244216,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [TestGraphMLResponseWriter, SolrXmlInZkTest, ZkFailoverTest, TestDynamicLoading, TestShardHandlerFactory, TestFunctionQuery, TestMultiValuedNumericRangeQuery, WordBreakSolrSpellCheckerTest, TestSchemaSimilarityResource, BasicDistributedZk2Test, CollectionReloadTest, ZkNodePropsTest, TestImpersonationWithHadoopAuth, AsyncCallRequestStatusResponseTest, TestRequestStatusCollectionAPI, TestConfigSetsAPI, ConnectionReuseTest, TestUniqueKeyFieldResource, RestartWhileUpdatingTest, ReturnFieldsTest, TestNestedDocsSort, TestPerFieldSimilarityWithDefaultOverride, HdfsDirectoryTest, TestExpandComponent, TestLMDirichletSimilarityFactory, TestOnReconnectListenerSupport, CursorMarkTest, StatsReloadRaceTest, TestJsonRequest, DistributedExpandComponentTest, BJQParserTest, TestXmlQParserPlugin, CustomCollectionTest, TestGroupingSearch, TestCloudInspectUtil, TestUseDocValuesAsStored2, SimpleCollectionCreateDeleteTest, TestRecoveryHdfs, NodeLostTriggerTest, DocExpirationUpdateProcessorFactoryTest, ClusterStateTest, HdfsThreadLeakTest, CollectionsAPIAsyncDistributedZkTest, TestLFUCache, TestConfigsApi, UnloadDistributedZkTest, ReplicaListTransformerTest, SolrCoreCheckLockOnStartupTest, TestCSVResponseWriter, TestValueSourceCache, TestLRUStatsCache, DisMaxRequestHandlerTest, CoreAdminHandlerTest, TestFieldCache, SolrTestCaseJ4Test, LoggingHandlerTest, DistributedSpellCheckComponentTest, BigEndianAscendingWordSerializerTest, TestLegacyFieldReuse, ConfigSetsAPITest, CSVRequestHandlerTest, EchoParamsTest, TestSchemaManager, TestDistributedMissingSort, TestSolrCoreParser, DocValuesNotIndexedTest, UtilsToolTest, TestMultiWordSynonyms, TestStressUserVersions, TestFieldCollectionResource, TestSolrDeletionPolicy2, TestLocalFSCloudBackupRestore, RuleEngineTest, FileBasedSpellCheckerTest, AtomicUpdateProcessorFactoryTest, RequiredFieldsTest, MetricsConfigTest, ClassificationUpdateProcessorIntegrationTest, HdfsWriteToMultipleCollectionsTest, TestManagedSynonymGraphFilterFactory, PropertiesRequestHandlerTest, TestLeaderElectionWithEmptyReplica, TestSystemCollAutoCreate, PreAnalyzedUpdateProcessorTest, DeleteStatusTest, TestCopyFieldCollectionResource, MissingSegmentRecoveryTest, TestFieldCacheSortRandom, TestCloudPseudoReturnFields, JSONWriterTest, TlogReplayBufferedWhileIndexingTest, BadComponentTest, IndexSchemaTest, BlockJoinFacetSimpleTest, TestCharFilters, FullSolrCloudDistribCmdsTest, XmlUpdateRequestHandlerTest, SystemInfoHandlerTest, AutoScalingHandlerTest, FieldMutatingUpdateProcessorTest, TestSolrCoreProperties, TestStreamBody, ChangedSchemaMergeTest, TestTlogReplica, TimeZoneUtilsTest, TestRuleBasedAuthorizationPlugin, HighlighterTest, TestReload, SubstringBytesRefFilterTest, UpdateLogTest, TestCustomSort, TestPayloadCheckQParserPlugin, RecoveryZkTest, TestNamedUpdateProcessors, TestCollationFieldDocValues, DistribJoinFromCollectionTest, TestDistributedGrouping, TestPartialUpdateDeduplication, TestZkChroot, LeaderElectionContextKeyTest, TestCryptoKeys, ZkStateReaderTest, TestRTimerTree, TestReplicationHandler, TestFaceting, TestHashPartitioner, TermVectorComponentDistributedTest, TestRealTimeGet, DistributedTermsComponentTest, TestSolr4Spatial, QueryElevationComponentTest, TestFiltering, SimplePostToolTest, TestCoreDiscovery, SuggesterFSTTest, DocValuesTest, TestSurroundQueryParser, DirectSolrSpellCheckerTest, DocumentAnalysisRequestHandlerTest, PrimitiveFieldTypeTest, DocumentBuilderTest, MoreLikeThisHandlerTest, RegexBoostProcessorTest, SolrPluginUtilsTest, UniqFieldsUpdateProcessorFactoryTest, BinaryUpdateRequestHandlerTest, TestPHPSerializedResponseWriter, TestComponentsName, SearchHandlerTest, SOLR749Test, TestQuerySenderListener, AlternateDirectoryTest, CopyFieldTest, ResponseLogComponentTest, TestStressRecovery, TestSystemIdResolver, TestSuggestSpellingConverter, DateFieldTest, SpellingQueryConverterTest, DOMUtilTest, TestLRUCache, TestUtils, SliceStateTest, UUIDFieldTest, FileUtilsTest, CircularListTest, DistributedMLTComponentTest, TestCursorMarkWithoutUniqueKey, TestHighlightDedupGrouping, TestTolerantSearch, TestLuceneIndexBackCompat, TestEmbeddedSolrServerConstructors, TestEmbeddedSolrServerSchemaAPI, ActionThrottleTest, AliasIntegrationTest, AssignTest, BaseCdcrDistributedZkTest, CdcrBootstrapTest, ChaosMonkeySafeLeaderWithPullReplicasTest, DeleteLastCustomShardedReplicaTest, DeleteNodeTest, DistribCursorPagingTest, DistributedQueueTest, LeaderFailoverAfterPartitionTest, LeaderFailureAfterFreshStartTest, LeaderInitiatedRecoveryOnShardRestartTest, MoveReplicaHDFSFailoverTest, OverseerStatusTest, RecoveryAfterSoftCommitTest, SSLMigrationTest, SaslZkACLProviderTest, TestCloudDeleteByQuery, TestCloudJSONFacetJoinDomain, TestCloudRecovery, TestDownShardTolerantSearch, TestPrepRecovery, TestRebalanceLeaders, TestStressLiveNodes, TestTolerantUpdateProcessorRandomCloud, ExecutePlanActionTest]
   [junit4] Completed [712/744 (2!)] on J2 in 670.86s, 2 tests, 1 failure <<< FAILURES!

[...truncated 43164 lines...]

[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk-9) - Build # 664 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/664/
Java: 64bit/jdk-9 -XX:-UseCompressedOops -XX:+UseG1GC --illegal-access=deny

1 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI

Error Message:
Error from server at https://127.0.0.1:35817/solr/awhollynewcollection_0_shard1_replica_n1: ClusterState says we are the leader (https://127.0.0.1:35817/solr/awhollynewcollection_0_shard1_replica_n1), but locally we don't think so. Request came from null

Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at https://127.0.0.1:35817/solr/awhollynewcollection_0_shard1_replica_n1: ClusterState says we are the leader (https://127.0.0.1:35817/solr/awhollynewcollection_0_shard1_replica_n1), but locally we don't think so. Request came from null
	at __randomizedtesting.SeedInfo.seed([52B015FA02D29492:1AC5614E04E1BB07]:0)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:541)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:998)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:867)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
	at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:459)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:35817/solr/awhollynewcollection_0_shard1_replica_n1: ClusterState says we are the leader (https://127.0.0.1:35817/solr/awhollynewcollection_0_shard1_replica_n1), but locally we don't think so. Request came from null
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:626)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:518)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
	... 1 more




Build Log:
[...truncated 11843 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> 234351 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[52B015FA02D29492]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_52B015FA02D29492-001/init-core-data-001
   [junit4]   2> 234352 WARN  (SUITE-CollectionsAPIDistributedZkTest-seed#[52B015FA02D29492]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
   [junit4]   2> 234352 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[52B015FA02D29492]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 234352 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[52B015FA02D29492]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 234353 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[52B015FA02D29492]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_52B015FA02D29492-001/tempDir-001
   [junit4]   2> 234353 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[52B015FA02D29492]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 234354 INFO  (Thread-760) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 234354 INFO  (Thread-760) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 234356 ERROR (Thread-760) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 234454 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[52B015FA02D29492]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:38007
   [junit4]   2> 234459 INFO  (jetty-launcher-2532-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 234459 INFO  (jetty-launcher-2532-thread-4) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 234459 INFO  (jetty-launcher-2532-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 234460 INFO  (jetty-launcher-2532-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@29eb097b{/solr,null,AVAILABLE}
   [junit4]   2> 234460 INFO  (jetty-launcher-2532-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@532d8b65{/solr,null,AVAILABLE}
   [junit4]   2> 234460 INFO  (jetty-launcher-2532-thread-3) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 234460 INFO  (jetty-launcher-2532-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1a11cbe0{/solr,null,AVAILABLE}
   [junit4]   2> 234460 INFO  (jetty-launcher-2532-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@cdab1d6{SSL,[ssl, http/1.1]}{127.0.0.1:39231}
   [junit4]   2> 234460 INFO  (jetty-launcher-2532-thread-1) [    ] o.e.j.s.Server Started @236141ms
   [junit4]   2> 234461 INFO  (jetty-launcher-2532-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39231}
   [junit4]   2> 234461 ERROR (jetty-launcher-2532-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 234461 INFO  (jetty-launcher-2532-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 234461 INFO  (jetty-launcher-2532-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@72ebd2c4{SSL,[ssl, http/1.1]}{127.0.0.1:40363}
   [junit4]   2> 234461 INFO  (jetty-launcher-2532-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 234461 INFO  (jetty-launcher-2532-thread-4) [    ] o.e.j.s.Server Started @236142ms
   [junit4]   2> 234461 INFO  (jetty-launcher-2532-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 234461 INFO  (jetty-launcher-2532-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40363}
   [junit4]   2> 234461 INFO  (jetty-launcher-2532-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T06:15:12.276287Z
   [junit4]   2> 234461 INFO  (jetty-launcher-2532-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2606ec64{/solr,null,AVAILABLE}
   [junit4]   2> 234461 ERROR (jetty-launcher-2532-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 234461 INFO  (jetty-launcher-2532-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 234461 INFO  (jetty-launcher-2532-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 234461 INFO  (jetty-launcher-2532-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 234461 INFO  (jetty-launcher-2532-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T06:15:12.276564Z
   [junit4]   2> 234461 INFO  (jetty-launcher-2532-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@45a98737{SSL,[ssl, http/1.1]}{127.0.0.1:35817}
   [junit4]   2> 234461 INFO  (jetty-launcher-2532-thread-3) [    ] o.e.j.s.Server Started @236142ms
   [junit4]   2> 234461 INFO  (jetty-launcher-2532-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35817}
   [junit4]   2> 234461 ERROR (jetty-launcher-2532-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 234461 INFO  (jetty-launcher-2532-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 234461 INFO  (jetty-launcher-2532-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 234461 INFO  (jetty-launcher-2532-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 234461 INFO  (jetty-launcher-2532-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T06:15:12.276973Z
   [junit4]   2> 234462 INFO  (jetty-launcher-2532-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@5e2bb578{SSL,[ssl, http/1.1]}{127.0.0.1:43943}
   [junit4]   2> 234462 INFO  (jetty-launcher-2532-thread-2) [    ] o.e.j.s.Server Started @236143ms
   [junit4]   2> 234462 INFO  (jetty-launcher-2532-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43943}
   [junit4]   2> 234462 INFO  (jetty-launcher-2532-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 234462 ERROR (jetty-launcher-2532-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 234462 INFO  (jetty-launcher-2532-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 234462 INFO  (jetty-launcher-2532-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 234462 INFO  (jetty-launcher-2532-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 234462 INFO  (jetty-launcher-2532-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T06:15:12.277680Z
   [junit4]   2> 234464 INFO  (jetty-launcher-2532-thread-1) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 234464 INFO  (jetty-launcher-2532-thread-1) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 234468 INFO  (jetty-launcher-2532-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 234468 INFO  (jetty-launcher-2532-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 234468 INFO  (jetty-launcher-2532-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 234469 INFO  (jetty-launcher-2532-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38007/solr
   [junit4]   2> 234469 INFO  (jetty-launcher-2532-thread-4) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 234469 INFO  (jetty-launcher-2532-thread-4) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 234473 INFO  (jetty-launcher-2532-thread-2) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 234473 INFO  (jetty-launcher-2532-thread-3) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 234473 INFO  (jetty-launcher-2532-thread-3) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 234473 INFO  (jetty-launcher-2532-thread-2) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 234482 INFO  (jetty-launcher-2532-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38007/solr
   [junit4]   2> 234482 INFO  (jetty-launcher-2532-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38007/solr
   [junit4]   2> 234483 INFO  (jetty-launcher-2532-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38007/solr
   [junit4]   2> 234483 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f522ba2290007, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 234537 INFO  (jetty-launcher-2532-thread-2) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 234538 INFO  (jetty-launcher-2532-thread-2) [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:43943_solr
   [junit4]   2> 234539 INFO  (jetty-launcher-2532-thread-2) [    ] o.a.s.c.Overseer Overseer (id=98888064183107596-127.0.0.1:43943_solr-n_0000000000) starting
   [junit4]   2> 234541 INFO  (jetty-launcher-2532-thread-4) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 234541 INFO  (jetty-launcher-2532-thread-4) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40363_solr
   [junit4]   2> 234542 INFO  (jetty-launcher-2532-thread-1) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 234542 INFO  (zkCallback-2554-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 234542 INFO  (zkCallback-2552-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 234543 INFO  (zkCallback-2553-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 234543 INFO  (jetty-launcher-2532-thread-3) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 234542 INFO  (zkCallback-2542-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 234544 INFO  (jetty-launcher-2532-thread-1) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39231_solr
   [junit4]   2> 234544 INFO  (jetty-launcher-2532-thread-3) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35817_solr
   [junit4]   2> 234544 INFO  (zkCallback-2554-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
   [junit4]   2> 234544 INFO  (zkCallback-2552-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
   [junit4]   2> 234546 INFO  (zkCallback-2542-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
   [junit4]   2> 234547 INFO  (zkCallback-2553-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
   [junit4]   2> 234556 INFO  (jetty-launcher-2532-thread-2) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43943_solr
   [junit4]   2> 234557 INFO  (zkCallback-2553-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 234557 INFO  (zkCallback-2542-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 234559 INFO  (zkCallback-2552-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 234559 INFO  (zkCallback-2554-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 234570 INFO  (jetty-launcher-2532-thread-4) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@724848f2
   [junit4]   2> 234573 INFO  (jetty-launcher-2532-thread-3) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@724848f2
   [junit4]   2> 234577 INFO  (jetty-launcher-2532-thread-4) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@724848f2
   [junit4]   2> 234578 INFO  (jetty-launcher-2532-thread-4) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@724848f2
   [junit4]   2> 234578 INFO  (jetty-launcher-2532-thread-3) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@724848f2
   [junit4]   2> 234578 INFO  (jetty-launcher-2532-thread-3) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@724848f2
   [junit4]   2> 234579 INFO  (jetty-launcher-2532-thread-4) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_52B015FA02D29492-001/tempDir-001/node4
   [junit4]   2> 234579 INFO  (jetty-launcher-2532-thread-3) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_52B015FA02D29492-001/tempDir-001/node3
   [junit4]   2> 234595 INFO  (jetty-launcher-2532-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@724848f2
   [junit4]   2> 234599 INFO  (jetty-launcher-2532-thread-2) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@724848f2
   [junit4]   2> 234604 WARN  (jetty-launcher-2532-thread-2) [    ] o.a.s.m.r.j.JmxMetricsReporter Unable to register gauge
   [junit4]   2> javax.management.InstanceNotFoundException: solr:dom1=jvm,name0=system,name=properties
   [junit4]   2> 	at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1083)
   [junit4]   2> 	at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:423)
   [junit4]   2> 	at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:411)
   [junit4]   2> 	at java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
   [junit4]   2> 	at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter$JmxListener.registerMBean(JmxMetricsReporter.java:530)
   [junit4]   2> 	at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter$JmxListener.onGaugeAdded(JmxMetricsReporter.java:563)
   [junit4]   2> 	at com.codahale.metrics.MetricRegistry.notifyListenerOfAddedMetric(MetricRegistry.java:454)
   [junit4]   2> 	at com.codahale.metrics.MetricRegistry.addListener(MetricRegistry.java:297)
   [junit4]   2> 	at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter.start(JmxMetricsReporter.java:725)
   [junit4]   2> 	at org.apache.solr.metrics.reporters.SolrJmxReporter.doInit(SolrJmxReporter.java:109)
   [junit4]   2> 	at org.apache.solr.metrics.SolrMetricReporter.init(SolrMetricReporter.java:70)
   [junit4]   2> 	at org.apache.solr.metrics.SolrMetricManager.loadReporter(SolrMetricManager.java:883)
   [junit4]   2> 	at org.apache.solr.metrics.SolrMetricManager.loadReporters(SolrMetricManager.java:819)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.load(CoreContainer.java:549)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:263)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:183)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1596)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1659)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1316)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1145)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
   [junit4]   2> 	at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
   [junit4]   2> 	at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
   [junit4]   2> 	at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:384)
   [junit4]   2> 	at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:247)
   [junit4]   2> 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 234605 INFO  (jetty-launcher-2532-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@724848f2
   [junit4]   2> 234608 INFO  (jetty-launcher-2532-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@724848f2
   [junit4]   2> 234610 INFO  (jetty-launcher-2532-thread-1) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_52B015FA02D29492-001/tempDir-001/node1
   [junit4]   2> 234613 INFO  (jetty-launcher-2532-thread-2) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@724848f2
   [junit4]   2> 234613 INFO  (jetty-launcher-2532-thread-2) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@724848f2
   [junit4]   2> 234614 INFO  (jetty-launcher-2532-thread-2) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_52B015FA02D29492-001/tempDir-001/node2
   [junit4]   2> 234610 WARN  (jetty-launcher-2532-thread-3) [    ] o.a.s.m.r.j.JmxMetricsReporter Unable to register gauge
   [junit4]   2> javax.management.InstanceNotFoundException: solr:dom1=jvm,name0=os,name=name
   [junit4]   2> 	at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1083)
   [junit4]   2> 	at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:423)
   [junit4]   2> 	at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:411)
   [junit4]   2> 	at java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
   [junit4]   2> 	at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter$JmxListener.registerMBean(JmxMetricsReporter.java:530)
   [junit4]   2> 	at org.apache.solr.metrics.reporters.jmx.JmxMetricsReporter$JmxListener.onGaugeAdded(JmxMetricsReporter.java:565)
   [junit4]   2> 	at com.codahale.metrics.MetricRegistry.notifyListenerOfAddedMetric(MetricRegistry.java:454)
   [junit4]   2> 	at com.codahale.metrics.MetricRegistry.onMetricAdded(MetricRegistry.java:448)
   [junit4]   2> 	at com.codahale.metrics.MetricRegistry.register(MetricRegistry.java:89)
   [junit4]   2> 	at org.apache.solr.metrics.SolrMetricManager.registerAll(SolrMetricManager.java:525)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.setupJvmMetrics(SolrDispatchFilter.java:212)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:186)
   [junit4]   2> 	at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1596)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1659)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1316)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1145)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
   [junit4]   2> 	at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
   [junit4]   2> 	at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
   [junit4]   2> 	at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:384)
   [junit4]   2> 	at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:247)
   [junit4]   2> 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 234679 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[52B015FA02D29492]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 234680 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[52B015FA02D29492]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38007/solr ready
   [junit4]   2> 234690 INFO  (TEST-CollectionsAPIDistributedZkTest.testNoConfigSetExist-seed#[52B015FA02D29492]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testNoConfigSetExist
   [junit4]   2> 234690 INFO  (TEST-CollectionsAPIDistributedZkTest.testNoConfigSetExist-seed#[52B015FA02D29492]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 234704 INFO  (qtp277116775-11164) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf123&name=noconfig&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 234705 INFO  (OverseerThreadFactory-1804-thread-1) [    ] o.a.s.c.CreateCollectionCmd Create collection noconfig
   [junit4]   2> 234706 ERROR (OverseerThreadFactory-1804-thread-1) [    ] o.a.s.c.OverseerCollectionMessageHandler Collection: noconfig operation: create failed:org.apache.solr.common.SolrException: Can not find the specified config set: conf123
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionMessageHandler.validateConfigOrThrowSolrException(OverseerCollectionMessageHandler.java:755)
   [junit4]   2> 	at org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:105)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:229)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:464)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 
   [junit4]   2> 234712 INFO  (qtp277116775-11164) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf123&name=noconfig&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=400 QTime=7
   [junit4]   2> 235716 INFO  (qtp277116775-11169) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 235716 INFO  (qtp277116775-11169) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 235716 INFO  (TEST-CollectionsAPIDistributedZkTest.testNoConfigSetExist-seed#[52B015FA02D29492]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testNoConfigSetExist
   [junit4]   2> 235732 INFO  (TEST-CollectionsAPIDistributedZkTest.testCreateShouldFailOnExistingCore-seed#[52B015FA02D29492]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testCreateShouldFailOnExistingCore
   [junit4]   2> 235732 INFO  (TEST-CollectionsAPIDistributedZkTest.testCreateShouldFailOnExistingCore-seed#[52B015FA02D29492]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 235733 INFO  (qtp277116775-11170) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&name=halfcollectionblocker&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 235735 INFO  (OverseerThreadFactory-1804-thread-2) [    ] o.a.s.c.CreateCollectionCmd Create collection halfcollectionblocker
   [junit4]   2> 235735 INFO  (OverseerCollectionConfigSetProcessor-98888064183107596-127.0.0.1:43943_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 235735 WARN  (OverseerThreadFactory-1804-thread-2) [    ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (halfcollectionblocker) without cores.
   [junit4]   2> 235839 INFO  (qtp277116775-11170) [    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 235839 INFO  (qtp277116775-11170) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf&name=halfcollectionblocker&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&wt=javabin&version=2} status=0 QTime=106
   [junit4]   2> 235840 INFO  (qtp277116775-11171) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:40363_solr&name=halfcollection_shard1_replica_n1&action=ADDREPLICA&collection=halfcollectionblocker&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 235843 INFO  (OverseerCollectionConfigSetProcessor-98888064183107596-127.0.0.1:43943_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 235843 INFO  (OverseerThreadFactory-1804-thread-3) [    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:40363_solr for creating new replica
   [junit4]   2> 235844 INFO  (OverseerStateUpdate-98888064183107596-127.0.0.1:43943_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"addreplica",
   [junit4]   2>   "collection":"halfcollectionblocker",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"halfcollection_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:40363/solr",
   [junit4]   2>   "node_name":"127.0.0.1:40363_solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 236065 INFO  (qtp1787593980-11159) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node21&collection.configName=conf&name=halfcollection_shard1_replica_n1&action=CREATE&collection=halfcollectionblocker&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 236065 INFO  (qtp1787593980-11159) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 236081 INFO  (qtp1787593980-11159) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 236086 INFO  (qtp1787593980-11159) [    ] o.a.s.s.IndexSchema [halfcollection_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 236087 INFO  (qtp1787593980-11159) [    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 236087 INFO  (qtp1787593980-11159) [    ] o.a.s.c.CoreContainer Creating SolrCore 'halfcollection_shard1_replica_n1' using configuration from collection halfcollectionblocker, trusted=true
   [junit4]   2> 236088 INFO  (qtp1787593980-11159) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.halfcollectionblocker.shard1.core_node21' (registry 'solr.core.halfcollectionblocker.shard1.core_node21') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@724848f2
   [junit4]   2> 236088 INFO  (qtp1787593980-11159) [    ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 236088 INFO  (qtp1787593980-11159) [    ] o.a.s.c.SolrCore [[halfcollection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_52B015FA02D29492-001/tempDir-001/node4/halfcollection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_52B015FA02D29492-001/tempDir-001/node4/halfcollection_shard1_replica_n1/data/]
   [junit4]   2> 236118 INFO  (qtp1787593980-11159) [    ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 236118 INFO  (qtp1787593980-11159) [    ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 236124 INFO  (qtp1787593980-11159) [    ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 236124 INFO  (qtp1787593980-11159) [    ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 236125 INFO  (qtp1787593980-11159) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@73781e7a[halfcollection_shard1_replica_n1] main]
   [junit4]   2> 236126 INFO  (qtp1787593980-11159) [    ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 236126 INFO  (qtp1787593980-11159) [    ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 236127 INFO  (qtp1787593980-11159) [    ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 236128 INFO  (searcherExecutor-1813-thread-1) [    ] o.a.s.c.SolrCore [halfcollection_shard1_replica_n1] Registered new searcher Searcher@73781e7a[halfcollection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 236128 INFO  (qtp1787593980-11159) [    ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582209028789895168
   [junit4]   2> 236131 INFO  (qtp1787593980-11159) [    ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 236131 INFO  (qtp1787593980-11159) [    ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 236131 INFO  (qtp1787593980-11159) [    ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:40363/solr/halfcollection_shard1_replica_n1/
   [junit4]   2> 236131 INFO  (qtp1787593980-11159) [    ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 236131 INFO  (qtp1787593980-11159) [    ] o.a.s.c.SyncStrategy https://127.0.0.1:40363/solr/halfcollection_shard1_replica_n1/ has no replicas
   [junit4]   2> 236131 INFO  (qtp1787593980-11159) [    ] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 236132 INFO  (qtp1787593980-11159) [    ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:40363/solr/halfcollection_shard1_replica_n1/ shard1
   [junit4]   2> 236234 INFO  (zkCallback-2553-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/halfcollectionblocker/state.json] for collection [halfcollectionblocker] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 236234 INFO  (zkCallback-2553-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/halfcollectionblocker/state.json] for collection [halfcollectionblocker] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 236283 INFO  (qtp1787593980-11159) [    ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 236285 INFO  (qtp1787593980-11159) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node21&collection.configName=conf&name=halfcollection_shard1_replica_n1&action=CREATE&collection=halfcollectionblocker&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=221
   [junit4]   2> 236288 INFO  (qtp277116775-11171) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:40363_solr&name=halfcollection_shard1_replica_n1&action=ADDREPLICA&collection=halfcollectionblocker&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=447
   [junit4]   2> 236289 INFO  (qtp277116775-11164) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&name=halfcollectionblocker2&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 236291 INFO  (OverseerThreadFactory-1804-thread-4) [    ] o.a.s.c.CreateCollectionCmd Create collection halfcollectionblocker2
   [junit4]   2> 236291 INFO  (OverseerCollectionConfigSetProcessor-98888064183107596-127.0.0.1:43943_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 236292 WARN  (OverseerThreadFactory-1804-thread-4) [    ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (halfcollectionblocker2) without cores.
   [junit4]   2> 236396 INFO  (zkCallback-2553-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/halfcollectionblocker/state.json] for collection [halfcollectionblocker] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 236396 INFO  (zkCallback-2553-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/halfcollectionblocker/state.json] for collection [halfcollectionblocker] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 236497 INFO  (qtp277116775-11164) [    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 236497 INFO  (qtp277116775-11164) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf&name=halfcollectionblocker2&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&wt=javabin&version=2} status=0 QTime=208
   [junit4]   2> 236499 INFO  (qtp277116775-11169) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:35817_solr&name=halfcollection_shard1_replica_n1&action=ADDREPLICA&collection=halfcollectionblocker2&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 236501 INFO  (OverseerCollectionConfigSetProcessor-98888064183107596-127.0.0.1:43943_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 236502 INFO  (OverseerThreadFactory-1804-thread-5) [    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:35817_solr for creating new replica
   [junit4]   2> 236506 INFO  (OverseerStateUpdate-98888064183107596-127.0.0.1:43943_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"addreplica",
   [junit4]   2>   "collection":"halfcollectionblocker2",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"halfcollection_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:35817/solr",
   [junit4]   2>   "node_name":"127.0.0.1:35817_solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 236712 INFO  (qtp277116775-11165) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node21&collection.configName=conf&name=halfcollection_shard1_replica_n1&action=CREATE&collection=halfcollectionblocker2&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 236712 INFO  (qtp277116775-11165) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 236722 INFO  (qtp277116775-11165) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 236730 INFO  (qtp277116775-11165) [    ] o.a.s.s.IndexSchema [halfcollection_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 236732 INFO  (qtp277116775-11165) [    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 236732 INFO  (qtp277116775-11165) [    ] o.a.s.c.CoreContainer Creating SolrCore 'halfcollection_shard1_replica_n1' using configuration from collection halfcollectionblocker2, trusted=true
   [junit4]   2> 236733 INFO  (qtp277116775-11165) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.halfcollectionblocker2.shard1.core_node21' (registry 'solr.core.halfcollectionblocker2.shard1.core_node21') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@724848f2
   [junit4]   2> 236733 INFO  (qtp277116775-11165) [    ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 236733 INFO  (qtp277116775-11165) [    ] o.a.s.c.SolrCore [[halfcollection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_52B015FA02D29492-001/tempDir-001/node3/halfcollection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_52B015FA02D29492-001/tempDir-001/node3/halfcollection_shard1_replica_n1/data/]
   [junit4]   2> 236774 INFO  (qtp277116775-11165) [    ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 236774 INFO  (qtp277116775-11165) [    ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 236775 INFO  (qtp277116775-11165) [    ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 236775 INFO  (qtp277116775-11165) [    ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 236776 INFO  (qtp277116775-11165) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@5722bcfe[halfcollection_shard1_replica_n1] main]
   [junit4]   2> 236777 INFO  (qtp277116775-11165) [    ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 236777 INFO  (qtp277116775-11165) [    ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 236778 INFO  (qtp277116775-11165) [    ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 236778 INFO  (searcherExecutor-1818-thread-1) [    ] o.a.s.c.SolrCore [halfcollection_shard1_replica_n1] Registered new searcher Searcher@5722bcfe[halfcollection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 236778 INFO  (qtp277116775-11165) [    ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582209029471469568
   [junit4]   2> 236781 INFO  (qtp277116775-11165) [    ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 236781 INFO  (qtp277116775-11165) [    ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 236781 INFO  (qtp277116775-11165) [    ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:35817/solr/halfcollection_shard1_replica_n1/
   [junit4]   2> 236781 INFO  (qtp277116775-11165) [    ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 236781 INFO  (qtp277116775-11165) [    ] o.a.s.c.SyncStrategy https://127.0.0.1:35817/solr/halfcollection_shard1_replica_n1/ has no replicas
   [junit4]   2> 236781 INFO  (qtp277116775-11165) [    ] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 236782 INFO  (qtp277116775-11165) [    ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:35817/solr/halfcollection_shard1_replica_n1/ shard1
   [junit4]   2> 236884 INFO  (zkCallback-2552-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/halfcollectionblocker2/state.json] for collection [halfcollectionblocker2] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 236884 INFO  (zkCallback-2552-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/halfcollectionblocker2/state.json] for collection [halfcollectionblocker2] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 236933 INFO  (qtp277116775-11165) [    ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 236934 INFO  (qtp277116775-11165) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node21&collection.configName=conf&name=halfcollection_shard1_replica_n1&action=CREATE&collection=halfcollectionblocker2&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=223
   [junit4]   2> 236937 INFO  (qtp277116775-11169) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:35817_solr&name=halfcollection_shard1_replica_n1&action=ADDREPLICA&collection=halfcollectionblocker2&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=438
   [junit4]   2> 236939 INFO  (qtp277116775-11170) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&name=halfcollection&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=127.0.0.1:40363_solr,127.0.0.1:35817_solr&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 236940 INFO  (OverseerThreadFactory-1804-thread-5) [    ] o.a.s.c.CreateCollectionCmd Create collection halfcollection
   [junit4]   2> 236941 INFO  (OverseerCollectionConfigSetProcessor-98888064183107596-127.0.0.1:43943_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000008 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 237045 INFO  (zkCallback-2552-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/halfcollectionblocker2/state.json] for collection [halfcollectionblocker2] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 237045 INFO  (zkCallback-2552-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/halfcollectionblocker2/state.json] for collection [halfcollectionblocker2] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 237148 INFO  (OverseerStateUpdate-98888064183107596-127.0.0.1:43943_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"halfcollection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"halfcollection_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:40363/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 237149 INFO  (OverseerStateUpdate-98888064183107596-127.0.0.1:43943_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"halfcollection",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"halfcollection_shard2_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:35817/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 237353 INFO  (qtp1787593980-11139) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=halfcollection_shard1_replica_n1&action=CREATE&numShards=2&collection=halfcollection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 237353 INFO  (qtp277116775-11171) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=halfcollection_shard2_replica_n2&action=CREATE&numShards=2&collection=halfcollection&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 237354 WARN  (qtp1787593980-11139) [    ] o.a.s.c.CoreContainer Creating a core with existing name is not allowed
   [junit4]   2> 237354 ERROR (qtp1787593980-11139) [    ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Core with name 'halfcollection_shard1_replica_n1' already exists.
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:926)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 
   [junit4]   2> 237354 INFO  (qtp1787593980-11139) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=halfcollection_shard1_replica_n1&action=CREATE&numShards=2&collection=halfcollection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=500 QTime=1
   [junit4]   2> 237355 ERROR (qtp1787593980-11139) [    ] o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException: Core with name 'halfcollection_shard1_replica_n1' already exists.
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:926)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
   [junit4]   2> 	at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 
   [junit4]   2> 237356 ERROR (OverseerThreadFactory-1804-thread-5) [    ] o.a.s.c.OverseerCollectionMessageHandler Error from shard: https://127.0.0.1:40363/solr
   [junit4]   2> org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:40363/solr: Core with name 'halfcollection_shard1_replica_n1' already exists.
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:626)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
   [junit4]   2> 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]   2> 	at org.apache.solr.handler.component.HttpShardHandler.lambda$submit$0(HttpShardHandler.java:172)
   [junit4]   2> 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]   2> 	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
   [junit4]   2> 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 237458 INFO  (zkCallback-2552-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/halfcollection/state.json] for collection [halfcollection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 237458 INFO  (zkCallback-2552-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/halfcollection/state.json] for collection [halfcollection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 238366 INFO  (qtp277116775-11171) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 238373 INFO  (qtp277116775-11171) [    ] o.a.s.s.IndexSchema [halfcollection_shard2_replica_n2] Schema name=minimal
   [junit4]   2> 238375 INFO  (qtp277116775-11171) [    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 238375 INFO  (qtp277116775-11171) [    ] o.a.s.c.CoreContainer Creating SolrCore 'halfcollection_shard2_replica_n2' using configuration from collection halfcollection, trusted=true
   [junit4]   2> 238376 INFO  (qtp277116775-11171) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.halfcollection.shard2.replica_n2' (registry 'solr.core.halfcollection.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@724848f2
   [junit4]   2> 238376 INFO  (qtp277116775-11171) [    ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 238376 INFO  (qtp277116775-11171) [    ] o.a.s.c.SolrCore [[halfcollection_shard2_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_52B015FA02D29492-001/tempDir-001/node3/halfcollection_shard2_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_52B015FA02D29492-001/tempDir-001/node3/halfcollection_shard2_replica_n2/data/]
   [junit4]   2> 238418 INFO  (qtp277116775-11171) [    ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 238418 INFO  (qtp277116775-11171) [    ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 238419 INFO  (qtp277116775-11171) [    ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 238419 INFO  (qtp277116775-11171) [    ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 238420 INFO  (qtp277116775-11171) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@6cb215b8[halfcollection_shard2_replica_n2] main]
   [junit4]   2> 238421 INFO  (qtp277116775-11171) [    ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 238421 INFO  (qtp277116775-11171) [    ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 238421 INFO  (qtp277116775-11171) [    ] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 238421 INFO  (qtp277116775-11171) [    ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582209031194279936
   [junit4]   2> 238422 INFO  (searcherExecutor-1823-thread-1) [    ] o.a.s.c.SolrCore [halfcollection_shard2_replica_n2] Registered new searcher Searcher@6cb215b8[halfcollection_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 238424 INFO  (qtp277116775-11171) [    ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 238424 INFO  (qtp277116775-11171) [    ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 238424 INFO  (qtp277116775-11171) [    ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:35817/solr/halfcollection_shard2_replica_n2/
   [junit4]   2> 238424 INFO  (qtp277116775-11171) [    ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 238424 INFO  (qtp277116775-11171) [    ] o.a.s.c.SyncStrategy https://127.0.0.1:35817/solr/halfcollection_shard2_replica_n2/ has no replicas
   [junit4]   2> 238424 INFO  (qtp277116775-11171) [    ] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 238425 INFO  (qtp277116775-11171) [    ] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:35817/solr/halfcollection_shard2_replica_n2/ shard2
   [junit4]   2> 238526 INFO  (zkCallback-2552-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/halfcollection/state.json] for collection [halfcollection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 238526 INFO  (zkCallback-2552-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/halfcollection/state.json] for collection [halfcollection] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 238575 INFO  (qtp277116775-11171) [    ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 238577 INFO  (qtp277116775-11171) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=halfcollection_shard2_replica_n2&action=CREATE&numShards=2&collection=halfcollection&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1223
   [junit4]   2> 238577 ERROR (OverseerThreadFactory-1804-thread-5) [    ] o.a.s.c.OverseerCollectionMessageHandler Cleaning up collection [halfcollection].
   [junit4]   2> 238579 INFO  (OverseerThreadFactory-1804-thread-5) [    ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 238580 INFO  (qtp277116775-11165) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.halfcollection.shard2.replica_n2, tag=null
   [junit4]   2> 238580 INFO  (qtp277116775-11165) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1bf1487a: rootName = null, domain = solr.core.halfcollection.shard2.replica_n2, service url = null, agent id = null] for registry solr.core.halfcollection.shard2.replica_n2 / com.codahale.metrics.MetricRegistry@6e61c93c
   [junit4]   2> 238596 INFO  (qtp277116775-11165) [    ] o.a.s.c.SolrCore [halfcollection_shard2_replica_n2]  CLOSING SolrCore org.apache.solr.core.SolrCore@14240e20
   [junit4]   2> 238596 INFO  (qtp277116775-11165) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.halfcollection.shard2.replica_n2, tag=337907232
   [junit4]   2> 238596 INFO  (qtp277116775-11165) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.halfcollection.shard2.leader, tag=337907232
   [junit4]   2> 238601 INFO  (qtp277116775-11165) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=halfcollection_shard2_replica_n2&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=21
   [junit4]   2> 239304 INFO  (OverseerThreadFactory-1804-thread-5) [    ] o.a.s.c.CreateCollectionCmd Cleaned up artifacts for failed create collection for [halfcollection]
   [junit4]   2> 239305 INFO  (qtp277116775-11170) [    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 240943 INFO  (OverseerCollectionConfigSetProcessor-98888064183107596-127.0.0.1:43943_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000010 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 269309 ERROR (qtp277116775-11170) [    ] o.a.s.h.a.CollectionsHandler Timed out waiting for new collection's replicas to become ACTIVE with timeout=30
   [junit4]   2> 269309 INFO  (qtp277116775-11170) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf&name=halfcollection&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=127.0.0.1:40363_solr,127.0.0.1:35817_solr&wt=javabin&version=2} status=0 QTime=32370
   [junit4]   2> 269309 INFO  (TEST-CollectionsAPIDistributedZkTest.testCreateShouldFailOnExistingCore-seed#[52B015FA02D29492]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testCreateShouldFailOnExistingCore
   [junit4]   2> 269351 INFO  (TEST-CollectionsAPIDistributedZkTest.testBadActionNames-seed#[52B015FA02D29492]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testBadActionNames
   [junit4]   2> 269352 INFO  (TEST-CollectionsAPIDistributedZkTest.testBadActionNames-seed#[52B015FA02D29492]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 269353 INFO  (qtp277116775-11164) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=halfcollectionblocker2&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 269354 INFO  (OverseerThreadFactory-1804-thread-5) [    ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 269356 INFO  (qtp277116775-11169) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.halfcollectionblocker2.shard1.core_node21, tag=null
   [junit4]   2> 269357 INFO  (qtp277116775-11169) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7526c33e: rootName = null, domain = solr.core.halfcollectionblocker2.shard1.core_node21, service url = null, agent id = null] for registry solr.core.halfcollectionblocker2.shard1.core_node21 / com.codahale.metrics.MetricRegistry@169c9013
   [junit4]   2> 269364 INFO  (qtp277116775-11169) [    ] o.a.s.c.SolrCore [halfcollection_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@3e6ef6d9
   [junit4]   2> 269364 INFO  (qtp277116775-11169) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.halfcollectionblocker2.shard1.core_node21, tag=1047459545
   [junit4]   2> 269364 INFO  (qtp277116775-11169) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.halfcollectionblocker2.shard1.leader, tag=1047459545
   [junit4]   2> 269367 INFO  (qtp277116775-11169) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=halfcollection_shard1_replica_n1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=10
   [junit4]   2> 270072 INFO  (qtp277116775-11164) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=halfcollectionblocker2&action=DELETE&wt=javabin&version=2} status=0 QTime=718
   [junit4]   2> 270073 INFO  (qtp277116775-11171) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=halfcollectionblocker&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 270075 INFO  (OverseerCollectionConfigSetProcessor-98888064183107596-127.0.0.1:43943_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000012 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 270075 INFO  (OverseerThreadFactory-1804-thread-5) [    ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 270079 INFO  (qtp1787593980-11154) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.halfcollectionblocker.shard1.core_node21, tag=null
   [junit4]   2> 270079 INFO  (qtp1787593980-11154) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5e5def81: rootName = null, domain = solr.core.halfcollectionblocker.shard1.core_node21, service url = null, agent id = null] for registry solr.core.halfcollectionblocker.shard1.core_node21 / com.codahale.metrics.MetricRegistry@2b25a4d4
   [junit4]   2> 270096 INFO  (qtp1787593980-11154) [    ] o.a.s.c.SolrCore [halfcollection_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@51cd25b7
   [junit4]   2> 270096 INFO  (qtp1787593980-11154) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.halfcollectionblocker.shard1.core_node21, tag=1372399031
   [junit4]   2> 270096 INFO  (qtp1787593980-11154) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.halfcollectionblocker.shard1.leader, tag=1372399031
   [junit4]   2> 270101 INFO  (qtp1787593980-11154) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=halfcollection_shard1_replica_n1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=23
   [junit4]   2> 270807 INFO  (qtp277116775-11171) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=halfcollectionblocker&action=DELETE&wt=javabin&version=2} status=0 QTime=734
   [junit4]   2> 270809 ERROR (qtp277116775-11170) [    ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Unknown action: BADACTION
   [junit4]   2> 	at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:217)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 
   [junit4]   2> 270810 INFO  (qtp277116775-11170) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=badactioncollection&action=BADACTION&numShards=2&wt=javabin&version=2} status=400 QTime=0
   [junit4]   2> 270810 INFO  (TEST-CollectionsAPIDistributedZkTest.testBadActionNames-seed#[52B015FA02D29492]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testBadActionNames
   [junit4]   2> 270840 INFO  (TEST-CollectionsAPIDistributedZkTest.deleteCollectionRemovesStaleZkCollectionsNode-seed#[52B015FA02D29492]) [    ] o.a.s.SolrTestCaseJ4 ###Starting deleteCollectionRemovesStaleZkCollectionsNode
   [junit4]   2> 270841 INFO  (TEST-CollectionsAPIDistributedZkTest.deleteCollectionRemovesStaleZkCollectionsNode-seed#[52B015FA02D29492]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 270844 INFO  (qtp277116775-11169) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=out_of_sync_collection&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 270858 INFO  (OverseerCollectionConfigSetProcessor-98888064183107596-127.0.0.1:43943_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000014 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 270859 INFO  (qtp277116775-11169) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=out_of_sync_collection&action=DELETE&wt=javabin&version=2} status=0 QTime=15
   [junit4]   2> 270861 INFO  (qtp277116775-11164) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 270861 INFO  (qtp277116775-11164) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 270861 INFO  (TEST-CollectionsAPIDistributedZkTest.deleteCollectionRemovesStaleZkCollectionsNode-seed#[52B015FA02D29492]) [    ] o.a.s.SolrTestCaseJ4 ###Ending deleteCollectionRemovesStaleZkCollectionsNode
   [junit4]   2> 270890 INFO  (TEST-CollectionsAPIDistributedZkTest.testZeroNumShards-seed#[52B015FA02D29492]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testZeroNumShards
   [junit4]   2> 270891 INFO  (TEST-CollectionsAPIDistributedZkTest.testZeroNumShards-seed#[52B015FA02D29492]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 270891 INFO  (qtp277116775-11171) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=10&collection.configName=conf&name=acollection&action=CREATE&numShards=0&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 270892 INFO  (OverseerThreadFactory-1804-thread-5) [    ] o.a.s.c.CreateCollectionCmd Create collection acollection
   [junit4]   2> 270892 INFO  (OverseerCollectionConfigSetProcessor-98888064183107596-127.0.0.1:43943_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000016 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 270892 ERROR (OverseerThreadFactory-1804-thread-5) [    ] o.a.s.c.OverseerCollectionMessageHandler Collection: acollection operation: create failed:org.apache.solr.common.SolrException: numShards must be > 0
   [junit4]   2> 	at org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:144)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:229)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:464)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 
   [junit4]   2> 270900 INFO  (qtp277116775-11171) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=10&collection.configName=conf&name=acollection&action=CREATE&numShards=0&wt=javabin&version=2} status=400 QTime=9
   [junit4]   2> 270901 INFO  (TEST-CollectionsAPIDistributedZkTest.testZeroNumShards-seed#[52B015FA02D29492]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testZeroNumShards
   [junit4]   2> 270912 INFO  (TEST-CollectionsAPIDistributedZkTest.testSpecificConfigsets-seed#[52B015FA02D29492]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testSpecificConfigsets
   [junit4]   2> 270913 INFO  (TEST-CollectionsAPIDistributedZkTest.testSpecificConfigsets-seed#[52B015FA02D29492]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 270914 INFO  (qtp277116775-11170) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf2&name=withconfigset2&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 270914 INFO  (OverseerThreadFactory-1804-thread-5) [    ] o.a.s.c.CreateCollectionCmd Create collection withconfigset2
   [junit4]   2> 270914 INFO  (OverseerCollectionConfigSetProcessor-98888064183107596-127.0.0.1:43943_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000018 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 271120 INFO  (OverseerStateUpdate-98888064183107596-127.0.0.1:43

[...truncated too long message...]

   2> 335927 INFO  (jetty-closer-2533-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 335927 INFO  (jetty-closer-2533-thread-3) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 335927 INFO  (zkCallback-2542-thread-6) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 335927 INFO  (jetty-closer-2533-thread-3) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3dd343cb: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@f6f4a9a
   [junit4]   2> 335927 INFO  (jetty-closer-2533-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 335927 INFO  (zkCallback-2554-thread-4) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 335927 INFO  (jetty-closer-2533-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@e1d0c25: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@338bd73b
   [junit4]   2> 335927 INFO  (zkCallback-2553-thread-3) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 335927 INFO  (zkCallback-2581-thread-4) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 335928 INFO  (jetty-closer-2533-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@532d8b65{/solr,null,UNAVAILABLE}
   [junit4]   2> 335928 INFO  (jetty-closer-2533-thread-4) [    ] o.a.s.c.Overseer Overseer (id=98888064183107596-127.0.0.1:43943_solr-n_0000000000) closing
   [junit4]   2> 335928 WARN  (OverseerAutoScalingTriggerThread-98888064183107596-127.0.0.1:43943_solr-n_0000000000) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 335929 INFO  (OverseerStateUpdate-98888064183107596-127.0.0.1:43943_solr-n_0000000000) [    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:43943_solr
   [junit4]   2> 335929 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:38007) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f522ba229000c, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 335929 INFO  (jetty-closer-2533-thread-4) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1a11cbe0{/solr,null,UNAVAILABLE}
   [junit4]   2> 335930 INFO  (zkCallback-2542-thread-6) [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:39231_solr
   [junit4]   2> 335930 INFO  (jetty-closer-2533-thread-3) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:39231_solr
   [junit4]   2> 335930 INFO  (jetty-closer-2533-thread-3) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 335930 INFO  (zkCallback-2581-thread-4) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 335930 INFO  (zkCallback-2542-thread-3) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 335931 INFO  (zkCallback-2581-thread-4) [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35817_solr
   [junit4]   2> 335931 INFO  (jetty-closer-2533-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@29eb097b{/solr,null,UNAVAILABLE}
   [junit4]   2> 335931 INFO  (jetty-closer-2533-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 335931 INFO  (jetty-closer-2533-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@26a297e4: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@f6f4a9a
   [junit4]   2> 335932 INFO  (jetty-closer-2533-thread-2) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:35817_solr
   [junit4]   2> 335932 INFO  (jetty-closer-2533-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 335932 INFO  (zkCallback-2581-thread-4) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 335932 INFO  (jetty-closer-2533-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@582e030e{/solr,null,UNAVAILABLE}
   [junit4]   2> 335933 ERROR (SUITE-CollectionsAPIDistributedZkTest-seed#[52B015FA02D29492]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 335933 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[52B015FA02D29492]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38007 38007
   [junit4]   2> 336847 INFO  (Thread-811) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38007 38007
   [junit4]   2> 336848 WARN  (Thread-811) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	10	/solr/configs/conf
   [junit4]   2> 	9	/solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	36	/solr/collections/nodes_used_collection/state.json
   [junit4]   2> 	16	/solr/collections/halfdeletedcollection/state.json
   [junit4]   2> 	15	/solr/collections/acollectionafterbaddelete/state.json
   [junit4]   2> 	9	/solr/clusterstate.json
   [junit4]   2> 	9	/solr/clusterprops.json
   [junit4]   2> 	5	/solr/collections/created_and_deleted/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	184	/solr/collections
   [junit4]   2> 	9	/solr/live_nodes
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_52B015FA02D29492-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {_version_=PostingsFormat(name=Direct), id=BlockTreeOrds(blocksize=128)}, docValues:{_version_=DocValuesFormat(name=Direct)}, maxPointsInLeafNode=217, maxMBSortInHeap=6.481383546943195, sim=RandomSimilarity(queryNorm=false): {}, locale=ga, timezone=Israel
   [junit4]   2> NOTE: Linux 4.10.0-33-generic amd64/Oracle Corporation 9 (64-bit)/cpus=8,threads=1,free=376024560,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [TestLegacyField, TestOmitPositions, TestStressLiveNodes, TestCloudNestedDocsSort, TestClusterStateMutator, TestUseDocValuesAsStored, TestLeaderInitiatedRecoveryThread, DocValuesMultiTest, TestPointFields, HdfsBasicDistributedZk2Test, TestCloudDeleteByQuery, TestDefaultStatsCache, MetricsHandlerTest, SpatialRPTFieldTypeTest, TestMiniSolrCloudClusterSSL, SignatureUpdateProcessorFactoryTest, ImplicitSnitchTest, TestSolrCoreSnapshots, TestSimpleTrackingShardHandler, PingRequestHandlerTest, TestTolerantUpdateProcessorRandomCloud, TestSolr4Spatial, SystemLogListenerTest, TestFaceting, AssignTest, TestMacros, TestQueryWrapperFilter, CollectionsAPIDistributedZkTest]
   [junit4] Completed [87/744 (1!)] on J1 in 102.51s, 19 tests, 1 error <<< FAILURES!

[...truncated 26419 lines...]
-check-forbidden-all:
[forbidden-apis] Reading bundled API signatures: jdk-unsafe-1.8
[forbidden-apis] Reading bundled API signatures: jdk-deprecated-1.8
[forbidden-apis] Reading bundled API signatures: jdk-non-portable
[forbidden-apis] Reading bundled API signatures: jdk-reflection
[forbidden-apis] Reading bundled API signatures: commons-io-unsafe-2.5
[forbidden-apis] Reading API signatures: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/tools/forbiddenApis/base.txt
[forbidden-apis] Reading API signatures: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/tools/forbiddenApis/servlet-api.txt
[forbidden-apis] Reading API signatures: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/tools/forbiddenApis/solr.txt
[forbidden-apis] Loading classes to check...
[forbidden-apis] Scanning classes for violations...
[forbidden-apis] Forbidden method invocation: java.lang.String#format(java.lang.String,java.lang.Object[]) [Uses default locale]
[forbidden-apis]   in org.apache.solr.cloud.LeaderElectionContextKeyTest (LeaderElectionContextKeyTest.java:81)
[forbidden-apis] Scanned 3878 class file(s) for forbidden API invocations (in 1.91s), 1 error(s).

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/build.xml:826: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/build.xml:117: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build.xml:376: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/common-build.xml:534: Check for forbidden API calls failed, see log.

Total time: 64 minutes 21 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_144) - Build # 663 - Failure!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/663/
Java: 32bit/jdk1.8.0_144 -server -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  org.apache.solr.cloud.ShardSplitTest.test

Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:42723

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:42723
	at __randomizedtesting.SeedInfo.seed([1B771AC640AC5D20:9323251CEE5030D8]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:637)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:936)
	at org.apache.solr.cloud.ShardSplitTest.splitByRouteKeyTest(ShardSplitTest.java:805)
	at org.apache.solr.cloud.ShardSplitTest.test(ShardSplitTest.java:102)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:171)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
	at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
	at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:525)
	... 47 more




Build Log:
[...truncated 13413 lines...]
   [junit4] Suite: org.apache.solr.cloud.ShardSplitTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/init-core-data-001
   [junit4]   2> 2078452 WARN  (SUITE-ShardSplitTest-seed#[1B771AC640AC5D20]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=37 numCloses=37
   [junit4]   2> 2078452 INFO  (SUITE-ShardSplitTest-seed#[1B771AC640AC5D20]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 2078453 INFO  (SUITE-ShardSplitTest-seed#[1B771AC640AC5D20]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 2078453 INFO  (SUITE-ShardSplitTest-seed#[1B771AC640AC5D20]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 2078453 INFO  (SUITE-ShardSplitTest-seed#[1B771AC640AC5D20]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 2078456 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2078456 INFO  (Thread-4467) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2078456 INFO  (Thread-4467) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2078461 ERROR (Thread-4467) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2078556 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.ZkTestServer start zk server on port:38015
   [junit4]   2> 2078561 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 2078562 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 2078562 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2078563 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 2078563 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 2078563 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 2078564 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 2078564 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2078564 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2078565 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 2078565 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 2078565 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
   [junit4]   2> 2078626 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2078626 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1392b07{/,null,AVAILABLE}
   [junit4]   2> 2078627 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1fa7e3e{HTTP/1.1,[http/1.1]}{127.0.0.1:32879}
   [junit4]   2> 2078627 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.e.j.s.Server Started @2080942ms
   [junit4]   2> 2078627 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/tempDir-001/control/data, replicaType=NRT, hostContext=/, hostPort=32879, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/control-001/cores}
   [junit4]   2> 2078627 ERROR (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2078628 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 2078628 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2078628 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 2078628 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T03:44:33.469Z
   [junit4]   2> 2078629 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 2078629 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/control-001/solr.xml
   [junit4]   2> 2078641 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 2078641 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 2078642 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1929361, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 2078644 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38015/solr
   [junit4]   2> 2078668 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:32879_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2078669 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:32879_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:32879_
   [junit4]   2> 2078669 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:32879_    ] o.a.s.c.Overseer Overseer (id=98887471811657732-127.0.0.1:32879_-n_0000000000) starting
   [junit4]   2> 2078672 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:32879_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32879_
   [junit4]   2> 2078672 INFO  (zkCallback-3339-thread-1-processing-n:127.0.0.1:32879_) [n:127.0.0.1:32879_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2078816 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:32879_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1929361
   [junit4]   2> 2078823 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:32879_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1929361
   [junit4]   2> 2078823 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:32879_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1929361
   [junit4]   2> 2078824 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:32879_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/control-001/cores
   [junit4]   2> 2078837 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2078837 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38015/solr ready
   [junit4]   2> 2078837 INFO  (qtp2937014-18247) [n:127.0.0.1:32879_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:32879_&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2078839 INFO  (OverseerThreadFactory-8357-thread-1-processing-n:127.0.0.1:32879_) [n:127.0.0.1:32879_    ] o.a.s.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 2078941 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2078942 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 2079044 INFO  (zkCallback-3339-thread-1-processing-n:127.0.0.1:32879_) [n:127.0.0.1:32879_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2079956 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 2079964 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 2080016 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 2080022 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 2080023 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1929361
   [junit4]   2> 2080023 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2080023 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 2080026 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=18, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=79.8720703125, floorSegmentMB=0.7666015625, forceMergeDeletesPctAllowed=12.135287442518432, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 2080039 WARN  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 2080064 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2080064 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2080064 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2080064 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2080065 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=13.984375, floorSegmentMB=0.7705078125, forceMergeDeletesPctAllowed=11.931566917504492, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4430245837062623
   [junit4]   2> 2080066 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1c72bdc[control_collection_shard1_replica_n1] main]
   [junit4]   2> 2080066 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 2080067 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2080067 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2080068 INFO  (searcherExecutor-8360-thread-1-processing-n:127.0.0.1:32879_ x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@1c72bdc[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2080068 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582199550675779584
   [junit4]   2> 2080071 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2080071 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 2080071 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:32879/control_collection_shard1_replica_n1/
   [junit4]   2> 2080071 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 2080071 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:32879/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 2080071 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 2080072 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:32879/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 2080173 INFO  (zkCallback-3339-thread-2-processing-n:127.0.0.1:32879_) [n:127.0.0.1:32879_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2080223 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 2080224 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1282
   [junit4]   2> 2080225 INFO  (qtp2937014-18247) [n:127.0.0.1:32879_    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 2080324 INFO  (zkCallback-3339-thread-2-processing-n:127.0.0.1:32879_) [n:127.0.0.1:32879_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2080840 INFO  (OverseerCollectionConfigSetProcessor-98887471811657732-127.0.0.1:32879_-n_0000000000) [n:127.0.0.1:32879_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 2081225 INFO  (qtp2937014-18247) [n:127.0.0.1:32879_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:32879_&wt=javabin&version=2} status=0 QTime=2387
   [junit4]   2> 2081228 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2081229 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38015/solr ready
   [junit4]   2> 2081229 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 2081229 INFO  (qtp2937014-18247) [n:127.0.0.1:32879_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2081230 INFO  (OverseerThreadFactory-8357-thread-2-processing-n:127.0.0.1:32879_) [n:127.0.0.1:32879_    ] o.a.s.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 2081230 WARN  (OverseerThreadFactory-8357-thread-2-processing-n:127.0.0.1:32879_) [n:127.0.0.1:32879_    ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 2081432 INFO  (qtp2937014-18247) [n:127.0.0.1:32879_    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 2081432 INFO  (qtp2937014-18247) [n:127.0.0.1:32879_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=203
   [junit4]   2> 2081493 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/shard-1-001 of type TLOG
   [junit4]   2> 2081493 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2081500 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1b4a7a2{/,null,AVAILABLE}
   [junit4]   2> 2081501 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@86fa5e{HTTP/1.1,[http/1.1]}{127.0.0.1:40449}
   [junit4]   2> 2081501 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.e.j.s.Server Started @2083816ms
   [junit4]   2> 2081501 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/tempDir-001/jetty1, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=40449, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/shard-1-001/cores}
   [junit4]   2> 2081501 ERROR (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2081501 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 2081502 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2081502 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 2081502 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T03:44:36.343Z
   [junit4]   2> 2081503 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 2081503 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/shard-1-001/solr.xml
   [junit4]   2> 2081506 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 2081506 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 2081506 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1929361, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 2081508 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38015/solr
   [junit4]   2> 2081512 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:40449_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2081513 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:40449_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2081515 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:40449_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40449_
   [junit4]   2> 2081517 INFO  (zkCallback-3347-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2081517 INFO  (zkCallback-3352-thread-1-processing-n:127.0.0.1:40449_) [n:127.0.0.1:40449_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2081517 INFO  (zkCallback-3339-thread-2-processing-n:127.0.0.1:32879_) [n:127.0.0.1:32879_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2081570 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:40449_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1929361
   [junit4]   2> 2081577 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:40449_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1929361
   [junit4]   2> 2081577 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:40449_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1929361
   [junit4]   2> 2081578 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:40449_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/shard-1-001/cores
   [junit4]   2> 2081594 INFO  (qtp2937014-18248) [n:127.0.0.1:32879_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:40449_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2081595 INFO  (OverseerCollectionConfigSetProcessor-98887471811657732-127.0.0.1:32879_-n_0000000000) [n:127.0.0.1:32879_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 2081595 INFO  (OverseerThreadFactory-8357-thread-3-processing-n:127.0.0.1:32879_) [n:127.0.0.1:32879_    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:40449_ for creating new replica
   [junit4]   2> 2081596 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 2081596 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 2081698 INFO  (zkCallback-3352-thread-1-processing-n:127.0.0.1:40449_) [n:127.0.0.1:40449_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2082619 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 2082627 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema [collection1_shard2_replica_t41] Schema name=test
   [junit4]   2> 2082679 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 2082685 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t41' using configuration from collection collection1, trusted=true
   [junit4]   2> 2082685 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t41' (registry 'solr.core.collection1.shard2.replica_t41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1929361
   [junit4]   2> 2082685 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2082685 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [[collection1_shard2_replica_t41] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/shard-1-001/cores/collection1_shard2_replica_t41], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/shard-1-001/cores/collection1_shard2_replica_t41/data/]
   [junit4]   2> 2082688 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=18, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=79.8720703125, floorSegmentMB=0.7666015625, forceMergeDeletesPctAllowed=12.135287442518432, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 2082700 WARN  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 2082725 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2082725 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2082726 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2082726 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2082727 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=13.984375, floorSegmentMB=0.7705078125, forceMergeDeletesPctAllowed=11.931566917504492, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4430245837062623
   [junit4]   2> 2082727 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.SolrIndexSearcher Opening [Searcher@ecfca6[collection1_shard2_replica_t41] main]
   [junit4]   2> 2082728 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 2082728 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2082729 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2082729 INFO  (searcherExecutor-8371-thread-1-processing-n:127.0.0.1:40449_ x:collection1_shard2_replica_t41 s:shard2 c:collection1) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [collection1_shard2_replica_t41] Registered new searcher Searcher@ecfca6[collection1_shard2_replica_t41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2082730 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582199553467088896
   [junit4]   2> 2082732 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2082732 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 2082732 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:40449/collection1_shard2_replica_t41/
   [junit4]   2> 2082732 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 2082732 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy http://127.0.0.1:40449/collection1_shard2_replica_t41/ has no replicas
   [junit4]   2> 2082732 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 2082733 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ZkController collection1_shard2_replica_t41 stopping background replication from leader
   [junit4]   2> 2082733 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:40449/collection1_shard2_replica_t41/ shard2
   [junit4]   2> 2082834 INFO  (zkCallback-3352-thread-1-processing-n:127.0.0.1:40449_) [n:127.0.0.1:40449_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2082884 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 2082885 INFO  (qtp6588694-18294) [n:127.0.0.1:40449_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1288
   [junit4]   2> 2082886 INFO  (qtp2937014-18248) [n:127.0.0.1:32879_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:40449_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=1292
   [junit4]   2> 2082947 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/shard-2-001 of type TLOG
   [junit4]   2> 2082947 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2082948 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@aec093{/,null,AVAILABLE}
   [junit4]   2> 2082948 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@64eaf3{HTTP/1.1,[http/1.1]}{127.0.0.1:37733}
   [junit4]   2> 2082948 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.e.j.s.Server Started @2085264ms
   [junit4]   2> 2082948 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/tempDir-001/jetty2, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=37733, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/shard-2-001/cores}
   [junit4]   2> 2082949 ERROR (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2082949 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 2082949 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2082949 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 2082949 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T03:44:37.790Z
   [junit4]   2> 2082951 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 2082951 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/shard-2-001/solr.xml
   [junit4]   2> 2082961 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 2082961 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 2082961 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1929361, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 2082965 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38015/solr
   [junit4]   2> 2082969 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:37733_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2082970 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:37733_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2082970 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:37733_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37733_
   [junit4]   2> 2082971 INFO  (zkCallback-3352-thread-1-processing-n:127.0.0.1:40449_) [n:127.0.0.1:40449_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2082971 INFO  (zkCallback-3347-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2082971 INFO  (zkCallback-3339-thread-2-processing-n:127.0.0.1:32879_) [n:127.0.0.1:32879_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2082971 INFO  (zkCallback-3358-thread-1-processing-n:127.0.0.1:37733_) [n:127.0.0.1:37733_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2083045 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:37733_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1929361
   [junit4]   2> 2083052 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:37733_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1929361
   [junit4]   2> 2083052 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:37733_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1929361
   [junit4]   2> 2083053 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:37733_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/shard-2-001/cores
   [junit4]   2> 2083071 INFO  (zkCallback-3352-thread-1-processing-n:127.0.0.1:40449_) [n:127.0.0.1:40449_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2083076 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:37733_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2083077 INFO  (OverseerCollectionConfigSetProcessor-98887471811657732-127.0.0.1:32879_-n_0000000000) [n:127.0.0.1:32879_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 2083077 INFO  (OverseerThreadFactory-8357-thread-4-processing-n:127.0.0.1:32879_) [n:127.0.0.1:32879_    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:37733_ for creating new replica
   [junit4]   2> 2083078 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 2083078 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 2083180 INFO  (zkCallback-3358-thread-1-processing-n:127.0.0.1:37733_) [n:127.0.0.1:37733_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2083180 INFO  (zkCallback-3352-thread-1-processing-n:127.0.0.1:40449_) [n:127.0.0.1:40449_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2084094 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 2084101 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema [collection1_shard1_replica_t43] Schema name=test
   [junit4]   2> 2084156 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 2084162 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t43' using configuration from collection collection1, trusted=true
   [junit4]   2> 2084162 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t43' (registry 'solr.core.collection1.shard1.replica_t43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1929361
   [junit4]   2> 2084163 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2084163 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [[collection1_shard1_replica_t43] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/shard-2-001/cores/collection1_shard1_replica_t43], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/shard-2-001/cores/collection1_shard1_replica_t43/data/]
   [junit4]   2> 2084165 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=18, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=79.8720703125, floorSegmentMB=0.7666015625, forceMergeDeletesPctAllowed=12.135287442518432, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 2084176 WARN  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 2084204 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2084204 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2084205 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2084205 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2084206 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=13.984375, floorSegmentMB=0.7705078125, forceMergeDeletesPctAllowed=11.931566917504492, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4430245837062623
   [junit4]   2> 2084206 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.SolrIndexSearcher Opening [Searcher@19fb8fa[collection1_shard1_replica_t43] main]
   [junit4]   2> 2084207 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 2084208 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2084208 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2084209 INFO  (searcherExecutor-8382-thread-1-processing-n:127.0.0.1:37733_ x:collection1_shard1_replica_t43 s:shard1 c:collection1) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [collection1_shard1_replica_t43] Registered new searcher Searcher@19fb8fa[collection1_shard1_replica_t43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2084209 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582199555017932800
   [junit4]   2> 2084212 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2084212 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 2084212 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:37733/collection1_shard1_replica_t43/
   [junit4]   2> 2084212 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 2084212 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy http://127.0.0.1:37733/collection1_shard1_replica_t43/ has no replicas
   [junit4]   2> 2084212 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 2084212 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ZkController collection1_shard1_replica_t43 stopping background replication from leader
   [junit4]   2> 2084213 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:37733/collection1_shard1_replica_t43/ shard1
   [junit4]   2> 2084314 INFO  (zkCallback-3352-thread-1-processing-n:127.0.0.1:40449_) [n:127.0.0.1:40449_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2084314 INFO  (zkCallback-3358-thread-1-processing-n:127.0.0.1:37733_) [n:127.0.0.1:37733_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2084364 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 2084365 INFO  (qtp20942093-18323) [n:127.0.0.1:37733_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1286
   [junit4]   2> 2084366 INFO  (qtp2937014-18243) [n:127.0.0.1:32879_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:37733_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=1290
   [junit4]   2> 2084427 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/shard-3-001 of type TLOG
   [junit4]   2> 2084428 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2084429 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@17d7cd0{/,null,AVAILABLE}
   [junit4]   2> 2084429 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@3eaaba{HTTP/1.1,[http/1.1]}{127.0.0.1:39149}
   [junit4]   2> 2084429 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.e.j.s.Server Started @2086745ms
   [junit4]   2> 2084429 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/tempDir-001/jetty3, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=39149, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/shard-3-001/cores}
   [junit4]   2> 2084430 ERROR (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2084430 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 2084430 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2084430 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 2084430 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T03:44:39.271Z
   [junit4]   2> 2084438 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 2084438 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/shard-3-001/solr.xml
   [junit4]   2> 2084440 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 2084440 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 2084441 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1929361, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 2084443 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38015/solr
   [junit4]   2> 2084447 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:39149_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 2084448 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:39149_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2084448 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:39149_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39149_
   [junit4]   2> 2084449 INFO  (zkCallback-3352-thread-1-processing-n:127.0.0.1:40449_) [n:127.0.0.1:40449_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2084449 INFO  (zkCallback-3347-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2084449 INFO  (zkCallback-3339-thread-2-processing-n:127.0.0.1:32879_) [n:127.0.0.1:32879_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2084449 INFO  (zkCallback-3358-thread-1-processing-n:127.0.0.1:37733_) [n:127.0.0.1:37733_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2084449 INFO  (zkCallback-3364-thread-1-processing-n:127.0.0.1:39149_) [n:127.0.0.1:39149_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2084514 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:39149_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1929361
   [junit4]   2> 2084522 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:39149_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1929361
   [junit4]   2> 2084522 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:39149_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1929361
   [junit4]   2> 2084523 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [n:127.0.0.1:39149_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/shard-3-001/cores
   [junit4]   2> 2084549 INFO  (zkCallback-3358-thread-1-processing-n:127.0.0.1:37733_) [n:127.0.0.1:37733_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2084549 INFO  (zkCallback-3352-thread-1-processing-n:127.0.0.1:40449_) [n:127.0.0.1:40449_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2084552 INFO  (qtp2937014-18244) [n:127.0.0.1:32879_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:39149_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2084553 INFO  (OverseerCollectionConfigSetProcessor-98887471811657732-127.0.0.1:32879_-n_0000000000) [n:127.0.0.1:32879_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 2084553 INFO  (OverseerThreadFactory-8357-thread-5-processing-n:127.0.0.1:32879_) [n:127.0.0.1:32879_    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:39149_ for creating new replica
   [junit4]   2> 2084554 INFO  (qtp13603117-18352) [n:127.0.0.1:39149_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 2084554 INFO  (qtp13603117-18352) [n:127.0.0.1:39149_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 2084656 INFO  (zkCallback-3358-thread-1-processing-n:127.0.0.1:37733_) [n:127.0.0.1:37733_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2084656 INFO  (zkCallback-3352-thread-1-processing-n:127.0.0.1:40449_) [n:127.0.0.1:40449_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2084656 INFO  (zkCallback-3364-thread-1-processing-n:127.0.0.1:39149_) [n:127.0.0.1:39149_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2085569 INFO  (qtp13603117-18352) [n:127.0.0.1:39149_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 2085576 INFO  (qtp13603117-18352) [n:127.0.0.1:39149_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema [collection1_shard2_replica_t45] Schema name=test
   [junit4]   2> 2085633 INFO  (qtp13603117-18352) [n:127.0.0.1:39149_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 2085639 INFO  (qtp13603117-18352) [n:127.0.0.1:39149_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t45' using configuration from collection collection1, trusted=true
   [junit4]   2> 2085640 INFO  (qtp13603117-18352) [n:127.0.0.1:39149_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t45' (registry 'solr.core.collection1.shard2.replica_t45') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1929361
   [junit4]   2> 2085640 INFO  (qtp13603117-18352) [n:127.0.0.1:39149_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2085640 INFO  (qtp13603117-18352) [n:127.0.0.1:39149_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [[collection1_shard2_replica_t45] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/shard-3-001/cores/collection1_shard2_replica_t45], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/shard-3-001/cores/collection1_shard2_replica_t45/data/]
   [junit4]   2> 2085642 INFO  (qtp13603117-18352) [n:127.0.0.1:39149_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=18, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=79.8720703125, floorSegmentMB=0.7666015625, forceMergeDeletesPctAllowed=12.135287442518432, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 2085655 WARN  (qtp13603117-18352) [n:127.0.0.1:39149_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 2085680 INFO  (qtp13603117-18352) [n:127.0.0.1:39149_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2085680 INFO  (qtp13603117-18352) [n:127.0.0.1:39149_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2085681 INFO  (qtp13603117-18352) [n:127.0.0.1:39149_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2085681 INFO  (qtp13603117-18352) [n:127.0.0.1:39149_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2085682 INFO  (qtp13603117-18352) [n:127.0.0.1:39149_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=13.984375, floorSegmentMB=0.7705078125, forceMergeDeletesPctAllowed=11.931566917504492, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4430245837062623
   [junit4]   2> 2085682 INFO  (qtp13603117-18352) [n:127.0.0.1:39149_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.SolrIndexSearcher Opening [Searcher@c28141[collection1_shard2_replica_t45] main]
   [junit4]   2> 2085683 INFO  (qtp13603117-18352) [n:127.0.0.1:39149_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 2085683 INFO  (qtp13603117-18352) [n:127.0.0.1:39149_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2085683 INFO  (qtp13603117-18352) [n:127.0.0.1:39149_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2085684 INFO  (searcherExecutor-8393-thread-1-processing-n:127.0.0.1:39149_ x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:39149_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [collection1_shard2_replica_t45] Registered new searcher Searcher@c28141[collection1_shard2_replica_t45] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2085684 INFO  (qtp13603117-18352) [n:127.0.0.1:39149_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582199556564582400
   [junit4]   2> 2085687 INFO  (qtp13603117-18352) [n:127.0.0.1:39149_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.ZkController Core needs to recover:collection1_shard2_replica_t45
   [junit4]   2> 2085687 INFO  (updateExecutor-3361-thread-1-processing-n:127.0.0.1:39149_ x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:39149_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 2085687 INFO  (qtp13603117-18352) [n:127.0.0.1:39149_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1132
   [junit4]   2> 2085687 INFO  (recoveryExecutor-3362-thread-1-processing-n:127.0.0.1:39149_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39149_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
   [junit4]   2> 2085687 INFO  (recoveryExecutor-3362-thread-1-processing-n:127.0.0.1:39149_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39149_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
   [junit4]   2> 2085687 INFO  (recoveryExecutor-3362-thread-1-processing-n:127.0.0.1:39149_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39149_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.ZkController collection1_shard2_replica_t45 stopping background replication from leader
   [junit4]   2> 2085687 INFO  (recoveryExecutor-3362-thread-1-processing-n:127.0.0.1:39149_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39149_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard2_replica_t45]
   [junit4]   2> 2085687 INFO  (recoveryExecutor-3362-thread-1-processing-n:127.0.0.1:39149_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39149_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
   [junit4]   2> 2085687 INFO  (recoveryExecutor-3362-thread-1-processing-n:127.0.0.1:39149_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39149_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard2_replica_t45] as recovering, leader is [http://127.0.0.1:40449/collection1_shard2_replica_t41/] and I am [http://127.0.0.1:39149/collection1_shard2_replica_t45/]
   [junit4]   2> 2085688 INFO  (qtp2937014-18244) [n:127.0.0.1:32879_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:39149_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=1136
   [junit4]   2> 2085689 INFO  (recoveryExecutor-3362-thread-1-processing-n:127.0.0.1:39149_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39149_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:40449]; [WaitForState: action=PREPRECOVERY&core=collection1_shard2_replica_t41&nodeName=127.0.0.1:39149_&coreNodeName=core_node46&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
   [junit4]   2> 2085689 INFO  (qtp6588694-18296) [n:127.0.0.1:40449_    ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
   [junit4]   2> 2085689 INFO  (qtp6588694-18296) [n:127.0.0.1:40449_    ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_t41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:39149_, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_t45","base_url":"http://127.0.0.1:39149","node_name":"127.0.0.1:39149_","state":"down","type":"TLOG"}
   [junit4]   2> 2085756 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 4 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/shard-4-001 of type TLOG
   [junit4]   2> 2085756 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2085757 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6646f{/,null,AVAILABLE}
   [junit4]   2> 2085757 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@128d7b7{HTTP/1.1,[http/1.1]}{127.0.0.1:33885}
   [junit4]   2> 2085758 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.e.j.s.Server Started @2088073ms
   [junit4]   2> 2085758 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/tempDir-001/jetty4, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=33885, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/shard-4-001/cores}
   [junit4]   2> 2085758 ERROR (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2085758 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 2085758 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2085758 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 2085758 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-10-25T03:44:40.599Z
   [junit4]   2> 2085759 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 2085760 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001/shard-4-001/solr.xml
   [junit4]   2> 2085762 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 2085762 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 2085762 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1929361, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 2085765 INFO  (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[1B771AC640AC5D20]) [    ] o.

[...truncated too long message...]

  > 	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
   [junit4]    > 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
   [junit4]    > 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
   [junit4]    > 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
   [junit4]    > 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
   [junit4]    > 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:525)
   [junit4]    > 	... 47 more
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.ShardSplitTest_1B771AC640AC5D20-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {rnd_b=FSTOrd50, shard_s=PostingsFormat(name=LuceneVarGapFixedInterval), a_t=PostingsFormat(name=LuceneVarGapFixedInterval), id=FSTOrd50}, docValues:{rnd_b=DocValuesFormat(name=Direct), shard_s=DocValuesFormat(name=Memory), _version_=DocValuesFormat(name=Lucene70), n_ti=DocValuesFormat(name=Memory), a_t=DocValuesFormat(name=Memory), a_i=DocValuesFormat(name=Direct), id=DocValuesFormat(name=Direct)}, maxPointsInLeafNode=1793, maxMBSortInHeap=5.88842515863225, sim=RandomSimilarity(queryNorm=false): {}, locale=ar-EG, timezone=America/Cayman
   [junit4]   2> NOTE: Linux 4.10.0-33-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=195564432,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [ScriptEngineTest, PKIAuthenticationIntegrationTest, HttpSolrCallGetCoreTest, AutoscalingHistoryHandlerTest, SimplePostToolTest, MetricsConfigTest, PreAnalyzedFieldManagedSchemaCloudTest, CustomCollectionTest, SubstringBytesRefFilterTest, TestPolicyCloud, HdfsDirectoryFactoryTest, TestSystemIdResolver, AutoScalingHandlerTest, HdfsCollectionsAPIDistributedZkTest, DistanceFunctionTest, AtomicUpdateProcessorFactoryTest, AsyncCallRequestStatusResponseTest, TestSearchPerf, BlockJoinFacetSimpleTest, SparseHLLTest, TestDistributedGrouping, DistanceUnitsTest, TestLMDirichletSimilarityFactory, TestConfigOverlay, TestMultiWordSynonyms, SolrIndexMetricsTest, TestConfigSetsAPI, TestMinMaxOnMultiValuedField, BigEndianAscendingWordSerializerTest, DistributedExpandComponentTest, TestManagedResourceStorage, TestCollationFieldDocValues, OutOfBoxZkACLAndCredentialsProvidersTest, TestCharFilters, TestReqParamsAPI, ConfigSetsAPITest, TestRawResponseWriter, DisMaxRequestHandlerTest, CoreSorterTest, TestFuzzyAnalyzedSuggestions, DistributedSpellCheckComponentTest, TestSolrQueryResponse, TestUseDocValuesAsStored2, SuggesterWFSTTest, CollectionsAPIAsyncDistributedZkTest, NodeLostTriggerTest, TestFieldCollectionResource, TestStressUserVersions, TestPartialUpdateDeduplication, ConnectionReuseTest, TestCollapseQParserPlugin, IndexBasedSpellCheckerTest, SortByFunctionTest, TestRebalanceLeaders, QueryElevationComponentTest, DistributedFacetPivotLongTailTest, TestShortCircuitedRequests, TestDistributedMissingSort, TestSolrCloudWithDelegationTokens, PropertiesRequestHandlerTest, TestUnifiedSolrHighlighter, AliasIntegrationTest, FullHLLTest, TestQueryTypes, TestSolrCoreProperties, TestCloudInspectUtil, TestCoreDiscovery, OverseerModifyCollectionTest, BlockCacheTest, ClusterStateTest, TestLegacyFieldReuse, TestInitParams, SaslZkACLProviderTest, ReturnFieldsTest, PreAnalyzedUpdateProcessorTest, TestSimpleQParserPlugin, TestGraphMLResponseWriter, TestSystemCollAutoCreate, TestFunctionQuery, HdfsThreadLeakTest, TestTrie, TestLMJelinekMercerSimilarityFactory, MissingSegmentRecoveryTest, CSVRequestHandlerTest, HighlighterTest, SpellCheckCollatorWithCollapseTest, TestStressCloudBlindAtomicUpdates, DocExpirationUpdateProcessorFactoryTest, TestFieldCacheSortRandom, TestElisionMultitermQuery, DeleteNodeTest, TestHashPartitioner, TestLegacyFieldCache, TestDistribIDF, TestStreamBody, LoggingHandlerTest, TestClusterProperties, TestFieldCache, TestConfigReload, DirectSolrConnectionTest, TestSolrXml, CdcrUpdateLogTest, TestRuleBasedAuthorizationPlugin, FullSolrCloudDistribCmdsTest, RestartWhileUpdatingTest, StatsComponentTest, DistributedFacetPivotWhiteBoxTest, TestValueSourceCache, TlogReplayBufferedWhileIndexingTest, TestPullReplicaErrorHandling, TestCloudPseudoReturnFields, TestExpandComponent, SolrCoreCheckLockOnStartupTest, UpdateLogTest, TestSchemaSimilarityResource, TestOnReconnectListenerSupport, TestJsonRequest, TestSQLHandlerNonCloud, SolrSlf4jReporterTest, TestLRUCache, LeaderInitiatedRecoveryOnCommitTest, DefaultValueUpdateProcessorTest, TestFieldTypeResource, BasicDistributedZk2Test, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, TestRandomDVFaceting, ShardRoutingCustomTest, TestDistributedSearch, TestFaceting, TestRecovery, TestRealTimeGet, TestStressReorder, TestReload, TestCoreContainer, SimpleFacetsTest, TestSolr4Spatial, SolrCoreTest, SpellCheckComponentTest, TestGroupingSearch, BadIndexSchemaTest, ConvertedLegacyTest, TestSort, TestFiltering, DirectUpdateHandlerTest, TestIndexSearcher, ShowFileRequestHandlerTest, DistributedQueryElevationComponentTest, AnalysisAfterCoreReloadTest, TestExtendedDismaxParser, CoreAdminHandlerTest, SuggesterTSTTest, SuggesterTest, TestStressLucene, TestCSVLoader, PolyFieldTest, NoCacheHeaderTest, WordBreakSolrSpellCheckerTest, SchemaVersionSpecificBehaviorTest, TestUpdate, FieldMutatingUpdateProcessorTest, TestAtomicUpdateErrorCases, TestWordDelimiterFilterFactory, DirectUpdateHandlerOptimizeTest, SolrInfoBeanTest, XsltUpdateRequestHandlerTest, CacheHeaderTest, TestSurroundQueryParser, LukeRequestHandlerTest, TestWriterPerf, DirectSolrSpellCheckerTest, TestReversedWildcardFilterFactory, DocumentAnalysisRequestHandlerTest, PrimitiveFieldTypeTest, FileBasedSpellCheckerTest, XmlUpdateRequestHandlerTest, RequestHandlersTest, DocumentBuilderTest, PathHierarchyTokenizerFactoryTest, TermVectorComponentTest, TestIndexingPerformance, RequiredFieldsTest, FieldAnalysisRequestHandlerTest, TestSolrQueryParser, IndexSchemaTest, TestJmxIntegration, TestCSVResponseWriter, MBeansHandlerTest, UniqFieldsUpdateProcessorFactoryTest, TestLFUCache, HighlighterConfigTest, SOLR749Test, TestQuerySenderListener, UpdateParamsTest, AlternateDirectoryTest, TestSolrIndexConfig, CopyFieldTest, BadComponentTest, TestStressRecovery, PreAnalyzedFieldTest, DateFieldTest, SpellingQueryConverterTest, RAMDirectoryFactoryTest, TestSolrJ, TestUtils, ZkNodePropsTest, SliceStateTest, SystemInfoHandlerTest, UUIDFieldTest, FileUtilsTest, CircularListTest, TestRTGBase, CursorPagingTest, DistributedIntervalFacetingTest, SolrTestCaseJ4Test, TestCrossCoreJoin, TestTolerantSearch, TestLuceneIndexBackCompat, TestEmbeddedSolrServerAdminHandler, TestEmbeddedSolrServerConstructors, TestEmbeddedSolrServerSchemaAPI, ActionThrottleTest, AddReplicaTest, AssignBackwardCompatibilityTest, ChaosMonkeySafeLeaderWithPullReplicasTest, CleanupOldIndexTest, CloudExitableDirectoryReaderTest, CollectionReloadTest, DeleteInactiveReplicaTest, DeleteStatusTest, DistribDocExpirationUpdateProcessorTest, DistributedVersionInfoTest, LeaderElectionContextKeyTest, LeaderInitiatedRecoveryOnShardRestartTest, MoveReplicaHDFSFailoverTest, MoveReplicaHDFSTest, MoveReplicaTest, NodeMutatorTest, OverseerStatusTest, OverseerTaskQueueTest, RemoteQueryErrorTest, ReplaceNodeTest, ShardSplitTest]
   [junit4] Completed [538/744 (1!)] on J2 in 822.77s, 5 tests, 1 error <<< FAILURES!

[...truncated 24882 lines...]
-check-forbidden-all:
[forbidden-apis] Reading bundled API signatures: jdk-unsafe-1.8
[forbidden-apis] Reading bundled API signatures: jdk-deprecated-1.8
[forbidden-apis] Reading bundled API signatures: jdk-non-portable
[forbidden-apis] Reading bundled API signatures: jdk-reflection
[forbidden-apis] Reading bundled API signatures: commons-io-unsafe-2.5
[forbidden-apis] Reading API signatures: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/tools/forbiddenApis/base.txt
[forbidden-apis] Reading API signatures: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/tools/forbiddenApis/servlet-api.txt
[forbidden-apis] Reading API signatures: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/lucene/tools/forbiddenApis/solr.txt
[forbidden-apis] Loading classes to check...
[forbidden-apis] Scanning classes for violations...
[forbidden-apis] Forbidden method invocation: java.lang.String#format(java.lang.String,java.lang.Object[]) [Uses default locale]
[forbidden-apis]   in org.apache.solr.cloud.LeaderElectionContextKeyTest (LeaderElectionContextKeyTest.java:81)
[forbidden-apis] Scanned 3878 class file(s) for forbidden API invocations (in 2.31s), 1 error(s).

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/build.xml:826: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/build.xml:117: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build.xml:376: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/common-build.xml:534: Check for forbidden API calls failed, see log.

Total time: 91 minutes 47 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any