You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2017/11/04 04:28:34 UTC

[JENKINS] Lucene-Solr-Tests-7.x - Build # 217 - Failure

Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/217/

All tests passed

Build Log:
[...truncated 602 lines...]
   [junit4] JVM J1: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J1-20171104_034814_7084394682251702877109.sysout
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] #
   [junit4] # There is insufficient memory for the Java Runtime Environment to continue.
   [junit4] # Native memory allocation (mmap) failed to map 524288 bytes for committing reserved memory.
   [junit4] # An error report file with more information is saved as:
   [junit4] # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/J1/hs_err_pid5316.log
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J1-20171104_034814_7087679337457712129163.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x00000000efa00000, 524288, 0) failed; error='Cannot allocate memory' (errno=12)
   [junit4] <<< JVM J1: EOF ----

[...truncated 978 lines...]
   [junit4] ERROR: JVM J1 ended with an exception, command line: /usr/local/asfpackages/java/jdk1.8.0_144/jre/bin/java -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/heapdumps -ea -esa -Dtests.prefix=tests -Dtests.seed=F65971480BB36080 -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=7.2.0 -Dtests.cleanthreads=perMethod -Djava.util.logging.config.file=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/tools/junit4/logging.properties -Dtests.nightly=false -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=2 -DtempDir=./temp -Djava.io.tmpdir=./temp -Djunit4.tempDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp -Dcommon.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene -Dclover.db.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/clover/db -Djava.security.policy=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/tools/junit4/tests.policy -Dtests.LUCENE_VERSION=7.2.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Dtests.src.home=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x -Djava.security.egd=file:/dev/./urandom -Djunit4.childvm.cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/J1 -Djunit4.childvm.id=1 -Djunit4.childvm.count=3 -Dtests.leaveTemporary=false -Dtests.filterstacks=true -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Dfile.encoding=US-ASCII -classpath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/codecs/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/test-framework/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/test-framework/lib/junit-4.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/test-framework/lib/randomizedtesting-runner-2.5.3.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/classes/test:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.4.0.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-log4j.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit4.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jai.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-javamail.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bsf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-net.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-antlr.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jsch.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-oro.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-logging.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-netrexx.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-testutil.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jdepend.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bcel.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-xalan2.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-resolver.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jmf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-regexp.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-swing.jar:/usr/local/asfpackages/java/jdk1.8.0_144/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.5.3.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J1-20171104_034814_7085490199420045987538.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J1-20171104_034814_7086800746267995893202.suites -stdin
   [junit4] ERROR: JVM J1 ended with an exception: Forked process returned with error code: 1. Very likely a JVM crash.  See process stdout at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J1-20171104_034814_7084394682251702877109.sysout See process stderr at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J1-20171104_034814_7087679337457712129163.syserr
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1519)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:126)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:982)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:979)
   [junit4] 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4] 	at java.lang.Thread.run(Thread.java:748)

BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:826: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:770: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build.xml:50: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/common-build.xml:1505: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/common-build.xml:1032: At least one slave process threw an exception, first: Forked process returned with error code: 1. Very likely a JVM crash.  See process stdout at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J1-20171104_034814_7084394682251702877109.sysout See process stderr at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J1-20171104_034814_7087679337457712129163.syserr

Total time: 42 minutes 4 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[Fast Archiver] No artifacts from Lucene-Solr-Tests-7.x #216 to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene-Solr-Tests-7.x - Build # 228 - Still Unstable

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/228/

5 tests failed.
FAILED:  org.apache.solr.cloud.CleanupOldIndexTest.test

Error Message:


Stack Trace:
java.util.concurrent.TimeoutException
	at __randomizedtesting.SeedInfo.seed([6466D98E0BF79769:EC32E654A50BFA91]:0)
	at org.apache.solr.common.cloud.ZkStateReader.waitForState(ZkStateReader.java:1325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.waitForState(CloudSolrClient.java:440)
	at org.apache.solr.cloud.CleanupOldIndexTest.test(CleanupOldIndexTest.java:114)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest.test

Error Message:
Could not load collection from ZK: customcollreplicadeletion

Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: customcollreplicadeletion
	at __randomizedtesting.SeedInfo.seed([6466D98E0BF79769:EC32E654A50BFA91]:0)
	at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1172)
	at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:692)
	at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:130)
	at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:110)
	at org.apache.solr.cloud.SolrCloudTestCase.getCollectionState(SolrCloudTestCase.java:247)
	at org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest.test(DeleteLastCustomShardedReplicaTest.java:43)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/customcollreplicadeletion/state.json
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
	at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:332)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:332)
	at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1184)
	at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
	... 44 more


FAILED:  org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeMarkersRegistration

Error Message:
Path /autoscaling/nodeAdded/127.0.0.1:41821_solr wasn't created

Stack Trace:
java.lang.AssertionError: Path /autoscaling/nodeAdded/127.0.0.1:41821_solr wasn't created
	at __randomizedtesting.SeedInfo.seed([6466D98E0BF79769:7CDC518205C25A86]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeMarkersRegistration(TriggerIntegrationTest.java:914)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigReplication

Error Message:
Index: 0, Size: 0

Stack Trace:
java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
	at __randomizedtesting.SeedInfo.seed([6466D98E0BF79769:702E82DB28F02A77]:0)
	at java.util.ArrayList.rangeCheck(ArrayList.java:657)
	at java.util.ArrayList.get(ArrayList.java:433)
	at org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigReplication(TestReplicationHandler.java:561)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.ShardSplitTest.testSplitAfterFailedSplit

Error Message:
expected:<1> but was:<2>

Stack Trace:
java.lang.AssertionError: expected:<1> but was:<2>
	at __randomizedtesting.SeedInfo.seed([6466D98E0BF79769:9D2B4A213782DAE3]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.cloud.ShardSplitTest.testSplitAfterFailedSplit(ShardSplitTest.java:279)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 11723 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
   [junit4]   2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6466D98E0BF79769-001/init-core-data-001
   [junit4]   2> 566409 WARN  (SUITE-TriggerIntegrationTest-seed#[6466D98E0BF79769]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=6 numCloses=6
   [junit4]   2> 566409 INFO  (SUITE-TriggerIntegrationTest-seed#[6466D98E0BF79769]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 566410 INFO  (SUITE-TriggerIntegrationTest-seed#[6466D98E0BF79769]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 566410 INFO  (SUITE-TriggerIntegrationTest-seed#[6466D98E0BF79769]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 566410 INFO  (SUITE-TriggerIntegrationTest-seed#[6466D98E0BF79769]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6466D98E0BF79769-001/tempDir-001
   [junit4]   2> 566410 INFO  (SUITE-TriggerIntegrationTest-seed#[6466D98E0BF79769]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 566437 INFO  (Thread-813) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 566437 INFO  (Thread-813) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 566462 ERROR (Thread-813) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 566525 INFO  (SUITE-TriggerIntegrationTest-seed#[6466D98E0BF79769]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:46206
   [junit4]   2> 566614 INFO  (jetty-launcher-268-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 566615 INFO  (jetty-launcher-268-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 566616 INFO  (jetty-launcher-268-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6d285829{/solr,null,AVAILABLE}
   [junit4]   2> 566617 INFO  (jetty-launcher-268-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@5e669453{HTTP/1.1,[http/1.1]}{127.0.0.1:41147}
   [junit4]   2> 566617 INFO  (jetty-launcher-268-thread-2) [    ] o.e.j.s.Server Started @581971ms
   [junit4]   2> 566617 INFO  (jetty-launcher-268-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41147}
   [junit4]   2> 566617 ERROR (jetty-launcher-268-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 566617 INFO  (jetty-launcher-268-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 566617 INFO  (jetty-launcher-268-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 566617 INFO  (jetty-launcher-268-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 566617 INFO  (jetty-launcher-268-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-07T01:33:51.500Z
   [junit4]   2> 566618 INFO  (jetty-launcher-268-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4be495bf{/solr,null,AVAILABLE}
   [junit4]   2> 566618 INFO  (jetty-launcher-268-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1329a9be{HTTP/1.1,[http/1.1]}{127.0.0.1:45056}
   [junit4]   2> 566618 INFO  (jetty-launcher-268-thread-1) [    ] o.e.j.s.Server Started @581973ms
   [junit4]   2> 566618 INFO  (jetty-launcher-268-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45056}
   [junit4]   2> 566618 ERROR (jetty-launcher-268-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 566618 INFO  (jetty-launcher-268-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 566618 INFO  (jetty-launcher-268-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 566619 INFO  (jetty-launcher-268-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 566619 INFO  (jetty-launcher-268-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-07T01:33:51.502Z
   [junit4]   2> 566651 INFO  (jetty-launcher-268-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 566651 INFO  (jetty-launcher-268-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 566671 INFO  (jetty-launcher-268-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46206/solr
   [junit4]   2> 566687 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f941cb9610001, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 566689 INFO  (jetty-launcher-268-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46206/solr
   [junit4]   2> 566825 INFO  (jetty-launcher-268-thread-1) [n:127.0.0.1:45056_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 566826 INFO  (jetty-launcher-268-thread-1) [n:127.0.0.1:45056_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45056_solr
   [junit4]   2> 566827 INFO  (jetty-launcher-268-thread-1) [n:127.0.0.1:45056_solr    ] o.a.s.c.Overseer Overseer (id=98960567915577349-127.0.0.1:45056_solr-n_0000000000) starting
   [junit4]   2> 566917 INFO  (jetty-launcher-268-thread-1) [n:127.0.0.1:45056_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45056_solr
   [junit4]   2> 566917 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
   [junit4]   2> 566918 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 566918 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: []
   [junit4]   2> 566918 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 566919 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 566919 INFO  (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 567006 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 567007 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 567008 DEBUG (ScheduledTrigger-606-thread-1) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:45056_solr]
   [junit4]   2> 567130 INFO  (jetty-launcher-268-thread-2) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 567131 INFO  (jetty-launcher-268-thread-2) [n:127.0.0.1:41147_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 567146 INFO  (jetty-launcher-268-thread-2) [n:127.0.0.1:41147_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41147_solr
   [junit4]   2> 567161 INFO  (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 567202 INFO  (zkCallback-280-thread-1-processing-n:127.0.0.1:41147_solr) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 567295 INFO  (jetty-launcher-268-thread-1) [n:127.0.0.1:45056_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45056.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@c4b3929
   [junit4]   2> 567347 INFO  (jetty-launcher-268-thread-1) [n:127.0.0.1:45056_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45056.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@c4b3929
   [junit4]   2> 567348 INFO  (jetty-launcher-268-thread-1) [n:127.0.0.1:45056_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45056.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@c4b3929
   [junit4]   2> 567381 INFO  (jetty-launcher-268-thread-1) [n:127.0.0.1:45056_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6466D98E0BF79769-001/tempDir-001/node1/.
   [junit4]   2> 567510 INFO  (jetty-launcher-268-thread-2) [n:127.0.0.1:41147_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41147.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@c4b3929
   [junit4]   2> 567551 INFO  (jetty-launcher-268-thread-2) [n:127.0.0.1:41147_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41147.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@c4b3929
   [junit4]   2> 567569 INFO  (jetty-launcher-268-thread-2) [n:127.0.0.1:41147_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41147.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@c4b3929
   [junit4]   2> 567584 INFO  (jetty-launcher-268-thread-2) [n:127.0.0.1:41147_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6466D98E0BF79769-001/tempDir-001/node2/.
   [junit4]   2> 568003 INFO  (SUITE-TriggerIntegrationTest-seed#[6466D98E0BF79769]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 568040 INFO  (SUITE-TriggerIntegrationTest-seed#[6466D98E0BF79769]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46206/solr ready
   [junit4]   2> 568121 DEBUG (ScheduledTrigger-606-thread-1) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:41147_solr, 127.0.0.1:45056_solr]
   [junit4]   2> 568181 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testNodeAddedTrigger
   [junit4]   2> 568211 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 2
   [junit4]   2> 568215 DEBUG (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
   [junit4]   2> 568215 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 568268 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 568268 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 568269 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 568529 INFO  (qtp25604371-2155) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 568530 INFO  (qtp25604371-2155) [n:127.0.0.1:45056_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46206/solr ready
   [junit4]   2> 568673 INFO  (qtp25604371-2151) [n:127.0.0.1:45056_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=38
   [junit4]   2> 568688 INFO  (qtp2037470-2154) [n:127.0.0.1:41147_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
   [junit4]   2> 568699 DEBUG (qtp25604371-2155) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 568727 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f941cb9610009, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 568727 INFO  (qtp25604371-2155) [n:127.0.0.1:45056_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=342
   [junit4]   2> 568728 DEBUG (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
   [junit4]   2> 568730 DEBUG (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:41147_solr, 127.0.0.1:45056_solr]
   [junit4]   2> 568730 DEBUG (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated with properties: {event=nodeAdded, waitFor=3, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true}
   [junit4]   2> 568731 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 568745 INFO  (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
   [junit4]   2> 568746 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 568801 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1bc4fd93{/solr,null,AVAILABLE}
   [junit4]   2> 568747 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 568837 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:41147_solr, 127.0.0.1:45056_solr]
   [junit4]   2> 568853 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 568874 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@58ad1001{HTTP/1.1,[http/1.1]}{127.0.0.1:34491}
   [junit4]   2> 568874 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.e.j.s.Server Started @584229ms
   [junit4]   2> 568874 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34491}
   [junit4]   2> 568874 ERROR (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 568876 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 568876 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 568876 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 568876 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-07T01:33:53.759Z
   [junit4]   2> 568890 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 568893 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 568947 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46206/solr
   [junit4]   2> 568986 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [n:127.0.0.1:34491_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 568987 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [n:127.0.0.1:34491_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 569023 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [n:127.0.0.1:34491_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34491_solr
   [junit4]   2> 569040 INFO  (zkCallback-295-thread-1-processing-n:127.0.0.1:34491_solr) [n:127.0.0.1:34491_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 569040 INFO  (zkCallback-280-thread-1-processing-n:127.0.0.1:41147_solr) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 569053 INFO  (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 569074 INFO  (zkCallback-287-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 569343 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [n:127.0.0.1:34491_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34491.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@c4b3929
   [junit4]   2> 569380 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [n:127.0.0.1:34491_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34491.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@c4b3929
   [junit4]   2> 569380 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [n:127.0.0.1:34491_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34491.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@c4b3929
   [junit4]   2> 569381 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [n:127.0.0.1:34491_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6466D98E0BF79769-001/tempDir-001/node3/.
   [junit4]   2> 569891 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 569891 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:41147_solr, 127.0.0.1:45056_solr, 127.0.0.1:34491_solr]
   [junit4]   2> 569891 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:34491_solr at time 1510018434774000000
   [junit4]   2> 570892 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 570892 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:41147_solr, 127.0.0.1:45056_solr, 127.0.0.1:34491_solr]
   [junit4]   2> 571892 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 571892 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:41147_solr, 127.0.0.1:45056_solr, 127.0.0.1:34491_solr]
   [junit4]   2> 572898 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 572898 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:41147_solr, 127.0.0.1:45056_solr, 127.0.0.1:34491_solr]
   [junit4]   2> 572898 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger firing registered processor for nodes: [127.0.0.1:34491_solr] added at times [1510018434774000000], now=1510018437781000000
   [junit4]   2> 572899 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"14f4a9c418fee180T733qudz06w4autesi7g8e4im5",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":1510018434774000000,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1510018434774000000],
   [junit4]   2>     "nodeNames":["127.0.0.1:34491_solr"]}}
   [junit4]   2> 572901 INFO  (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
   [junit4]   2> 572957 DEBUG (AutoscalingActionExecutor-607-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"14f4a9c418fee180T733qudz06w4autesi7g8e4im5",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":1510018434774000000,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1510018434774000000],
   [junit4]   2>     "_enqueue_time_":1510018437783000000,
   [junit4]   2>     "nodeNames":["127.0.0.1:34491_solr"]}}
   [junit4]   2> 573056 INFO  (qtp2037470-2150) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 573085 INFO  (qtp2037470-2150) [n:127.0.0.1:41147_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46206/solr ready
   [junit4]   2> 573110 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
   [junit4]   2> 573130 INFO  (qtp1816015907-2215) [n:127.0.0.1:34491_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
   [junit4]   2> 573131 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
   [junit4]   2> 573132 DEBUG (qtp2037470-2150) [n:127.0.0.1:41147_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 573150 INFO  (qtp2037470-2150) [n:127.0.0.1:41147_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=178
   [junit4]   2> 573151 DEBUG (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
   [junit4]   2> 573151 DEBUG (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:41147_solr, 127.0.0.1:45056_solr, 127.0.0.1:34491_solr]
   [junit4]   2> 573151 DEBUG (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated with properties: {event=nodeAdded, waitFor=3, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true}
   [junit4]   2> 573162 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
   [junit4]   2> 573162 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 573162 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
   [junit4]   2> 573973 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 573973 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:41147_solr, 127.0.0.1:45056_solr, 127.0.0.1:34491_solr]
   [junit4]   2> 574988 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 574988 DEBUG (ScheduledTrigger-606-thread-2) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:41147_solr, 127.0.0.1:45056_solr, 127.0.0.1:34491_solr]
   [junit4]   2> 575155 INFO  (TEST-TriggerIntegrationTest.testNodeAddedTrigger-seed#[6466D98E0BF79769]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testNodeAddedTrigger
   [junit4]   2> 575298 INFO  (TEST-TriggerIntegrationTest.testSearchRate-seed#[6466D98E0BF79769]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testSearchRate
   [junit4]   2> 575310 DEBUG (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
   [junit4]   2> 575317 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
   [junit4]   2> 575317 INFO  (TEST-TriggerIntegrationTest.testSearchRate-seed#[6466D98E0BF79769]) [    ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 5
   [junit4]   2> 575334 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 575334 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 575334 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
   [junit4]   2> 575336 INFO  (qtp1816015907-2211) [n:127.0.0.1:34491_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&name=collection1&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 575411 INFO  (OverseerThreadFactory-608-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 575547 INFO  (OverseerStateUpdate-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"collection1_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:41147/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 575581 INFO  (OverseerStateUpdate-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"collection1_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:45056/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 575845 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=collection1_shard1_replica_n1&action=CREATE&numShards=1&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 575846 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 575866 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=collection1_shard1_replica_n2&action=CREATE&numShards=1&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 575866 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 576025 INFO  (zkCallback-280-thread-1-processing-n:127.0.0.1:41147_solr) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 576025 INFO  (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 576040 INFO  (zkCallback-280-thread-2-processing-n:127.0.0.1:41147_solr) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 576081 INFO  (zkCallback-279-thread-2-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 576921 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 576972 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.s.IndexSchema [collection1_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 576987 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 576987 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n1' using configuration from collection collection1, trusted=true
   [junit4]   2> 576988 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41147.solr.core.collection1.shard1.replica_n1' (registry 'solr.core.collection1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@c4b3929
   [junit4]   2> 576988 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 576988 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.SolrCore [[collection1_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6466D98E0BF79769-001/tempDir-001/node2/collection1_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6466D98E0BF79769-001/tempDir-001/node2/./collection1_shard1_replica_n1/data/]
   [junit4]   2> 577009 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 577117 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.s.IndexSchema [collection1_shard1_replica_n2] Schema name=minimal
   [junit4]   2> 577120 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 577120 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n2' using configuration from collection collection1, trusted=true
   [junit4]   2> 577171 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45056.solr.core.collection1.shard1.replica_n2' (registry 'solr.core.collection1.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@c4b3929
   [junit4]   2> 577189 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 577190 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.SolrCore [[collection1_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6466D98E0BF79769-001/tempDir-001/node1/collection1_shard1_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_6466D98E0BF79769-001/tempDir-001/node1/./collection1_shard1_replica_n2/data/]
   [junit4]   2> 577786 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 577786 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 577787 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 577787 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 577871 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2ab65fb3[collection1_shard1_replica_n1] main]
   [junit4]   2> 577872 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 577872 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 577873 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 577873 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583369098631315456
   [junit4]   2> 577916 INFO  (searcherExecutor-619-thread-1-processing-n:127.0.0.1:41147_solr x:collection1_shard1_replica_n1 s:shard1 c:collection1 r:core_node3) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.SolrCore [collection1_shard1_replica_n1] Registered new searcher Searcher@2ab65fb3[collection1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 577919 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 577919 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 577946 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 577951 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 577951 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 577969 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@52efb49e[collection1_shard1_replica_n2] main]
   [junit4]   2> 578021 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 578054 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 578054 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 578055 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583369098822156288
   [junit4]   2> 578063 INFO  (searcherExecutor-620-thread-1-processing-n:127.0.0.1:45056_solr x:collection1_shard1_replica_n2 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.SolrCore [collection1_shard1_replica_n2] Registered new searcher Searcher@52efb49e[collection1_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 578151 INFO  (zkCallback-280-thread-2-processing-n:127.0.0.1:41147_solr) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 578152 INFO  (zkCallback-280-thread-1-processing-n:127.0.0.1:41147_solr) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 578152 INFO  (zkCallback-279-thread-2-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 578152 INFO  (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 578457 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 578457 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 578457 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:41147/solr/collection1_shard1_replica_n1/
   [junit4]   2> 578457 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n1 url=http://127.0.0.1:41147/solr START replicas=[http://127.0.0.1:45056/solr/collection1_shard1_replica_n2/] nUpdates=100
   [junit4]   2> 578479 INFO  (qtp25604371-2166) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.S.Request [collection1_shard1_replica_n2]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=13
   [junit4]   2> 578758 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n1 url=http://127.0.0.1:41147/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 578758 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 578758 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 578758 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 578761 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:41147/solr/collection1_shard1_replica_n1/ shard1
   [junit4]   2> 578862 INFO  (zkCallback-279-thread-3-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 578862 INFO  (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 578867 INFO  (zkCallback-280-thread-1-processing-n:127.0.0.1:41147_solr) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 578867 INFO  (zkCallback-280-thread-2-processing-n:127.0.0.1:41147_solr) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 578911 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 578913 INFO  (qtp2037470-2158) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=collection1_shard1_replica_n1&action=CREATE&numShards=1&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=3067
   [junit4]   2> 579018 INFO  (zkCallback-280-thread-1-processing-n:127.0.0.1:41147_solr) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 579018 INFO  (zkCallback-279-thread-3-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 579018 INFO  (zkCallback-280-thread-2-processing-n:127.0.0.1:41147_solr) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 579018 INFO  (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 579059 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=collection1_shard1_replica_n2&action=CREATE&numShards=1&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=3193
   [junit4]   2> 579141 INFO  (qtp1816015907-2211) [n:127.0.0.1:34491_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 579206 INFO  (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 579206 INFO  (zkCallback-279-thread-3-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 579217 INFO  (zkCallback-280-thread-2-processing-n:127.0.0.1:41147_solr) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 579217 INFO  (zkCallback-280-thread-1-processing-n:127.0.0.1:41147_solr) [n:127.0.0.1:41147_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 579650 INFO  (OverseerCollectionConfigSetProcessor-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 580173 INFO  (qtp1816015907-2211) [n:127.0.0.1:34491_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&name=collection1&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=4837
   [junit4]   2> 580225 INFO  (qtp25604371-2157) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 580279 INFO  (qtp25604371-2157) [n:127.0.0.1:45056_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46206/solr ready
   [junit4]   2> 580371 INFO  (qtp25604371-2149) [n:127.0.0.1:45056_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=52
   [junit4]   2> 580462 INFO  (qtp1816015907-2216) [n:127.0.0.1:34491_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
   [junit4]   2> 580480 INFO  (qtp2037470-2154) [n:127.0.0.1:41147_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=1
   [junit4]   2> 580499 DEBUG (qtp25604371-2157) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 580535 INFO  (qtp25604371-2157) [n:127.0.0.1:45056_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=353
   [junit4]   2> 580560 DEBUG (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6
   [junit4]   2> 580600 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6
   [junit4]   2> 580715 INFO  (qtp25604371-2151) [n:127.0.0.1:45056_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 580716 INFO  (qtp25604371-2151) [n:127.0.0.1:45056_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46206/solr ready
   [junit4]   2> 580779 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 580790 INFO  (qtp25604371-2155) [n:127.0.0.1:45056_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=72
   [junit4]   2> 580795 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 580853 INFO  (qtp1816015907-2213) [n:127.0.0.1:34491_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
   [junit4]   2> 580865 INFO  (qtp2037470-2154) [n:127.0.0.1:41147_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
   [junit4]   2> 580881 DEBUG (qtp25604371-2151) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 580884 INFO  (qtp25604371-2163) [n:127.0.0.1:45056_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate} status=0 QTime=18
   [junit4]   2> 580897 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6
   [junit4]   2> 580954 INFO  (qtp2037470-2154) [n:127.0.0.1:41147_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate} status=0 QTime=0
   [junit4]   2> 580962 INFO  (qtp25604371-2151) [n:127.0.0.1:45056_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=393
   [junit4]   2> 580975 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.S.Request [collection1_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581048 DEBUG (ScheduledTrigger-606-thread-3) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.SearchRateTrigger name=127.0.0.1:41147_solr, lastTime=1510018445838000000, elapsed=0
   [junit4]   2> 581048 DEBUG (ScheduledTrigger-606-thread-3) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.SearchRateTrigger name=127.0.0.1:45056_solr, lastTime=1510018445838000000, elapsed=0
   [junit4]   2> 581072 DEBUG (zkCallback-279-thread-1-processing-n:127.0.0.1:45056_solr) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 7
   [junit4]   2> 581084 INFO  (qtp2037470-2161) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=107
   [junit4]   2> 581085 INFO  (qtp2037470-2150) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581085 INFO  (qtp2037470-2150) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581086 INFO  (qtp2037470-2150) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581087 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.S.Request [collection1_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581087 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.S.Request [collection1_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581096 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 7
   [junit4]   2> 581196 INFO  (qtp25604371-2159) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.S.Request [collection1_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581217 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 581236 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 581254 DEBUG (OverseerAutoScalingTriggerThread-98960567915577349-127.0.0.1:45056_solr-n_0000000000) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion 7
   [junit4]   2> 581285 DEBUG (ScheduledTrigger-606-thread-3) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.SearchRateTrigger name=collection1.collection1_shard1_replica_n2, lastTime=1510018445838000000, elapsed=0
   [junit4]   2> 581285 DEBUG (ScheduledTrigger-606-thread-3) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.SearchRateTrigger name=collection1.collection1_shard1_replica_n1, lastTime=1510018445838000000, elapsed=0
   [junit4]   2> 581285 DEBUG (ScheduledTrigger-606-thread-3) [n:127.0.0.1:45056_solr    ] o.a.s.c.a.SearchRateTrigger name=collection1.shard1, lastTime=1510018445838000000, elapsed=0
   [junit4]   2> 581304 INFO  (qtp2037470-2150) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=70
   [junit4]   2> 581305 INFO  (qtp25604371-2155) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.S.Request [collection1_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581306 INFO  (qtp25604371-2155) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.S.Request [collection1_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581306 INFO  (qtp2037470-2150) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581319 INFO  (qtp2037470-2160) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581320 INFO  (qtp25604371-2155) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.S.Request [collection1_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581321 INFO  (qtp25604371-2155) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.S.Request [collection1_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581321 INFO  (qtp2037470-2160) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581322 INFO  (qtp25604371-2155) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.S.Request [collection1_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581322 INFO  (qtp2037470-2160) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581356 INFO  (qtp2037470-2160) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=32
   [junit4]   2> 581358 INFO  (qtp2037470-2160) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581358 INFO  (qtp2037470-2160) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581359 INFO  (qtp25604371-2155) [n:127.0.0.1:45056_solr c:collection1 s:shard1 r:core_node4 x:collection1_shard1_replica_n2] o.a.s.c.S.Request [collection1_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 581376 INFO  (qtp2037470-2160) [n:127.0.0.1:41147_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&versi

[...truncated too long message...]

r registry=solr.collection.collection1.shard1.leader, tag=1484212806
   [junit4]   2> 5047168 INFO  (coreCloseExecutor-6289-thread-3) [n:127.0.0.1:39409_o_mu%2Fs c:routeFieldColl s:shard4 r:core_node16 x:routeFieldColl_shard4_replica_n9] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.routeFieldColl.shard4.leader, tag=1831975278
   [junit4]   2> 5047168 INFO  (coreCloseExecutor-6289-thread-4) [n:127.0.0.1:39409_o_mu%2Fs c:splitByRouteKeyTest s:shard3 r:core_node11 x:splitByRouteKeyTest_shard3_replica_n8] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.splitByRouteKeyTest.shard3.leader, tag=1745759969
   [junit4]   2> 5047204 INFO  (TEST-ShardSplitTest.test-seed#[6466D98E0BF79769]) [    ] o.a.s.c.Overseer Overseer (id=98960850096029714-127.0.0.1:39409_o_mu%2Fs-n_0000000004) closing
   [junit4]   2> 5047204 INFO  (OverseerStateUpdate-98960850096029714-127.0.0.1:39409_o_mu%2Fs-n_0000000004) [n:127.0.0.1:39409_o_mu%2Fs    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:39409_o_mu%2Fs
   [junit4]   2> 5047242 WARN  (OverseerAutoScalingTriggerThread-98960850096029714-127.0.0.1:39409_o_mu%2Fs-n_0000000004) [n:127.0.0.1:39409_o_mu%2Fs    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 5047516 WARN  (zkCallback-2356-thread-3-processing-n:127.0.0.1:39409_o_mu%2Fs) [n:127.0.0.1:39409_o_mu%2Fs c:routeFieldColl s:shard2 r:core_node11 x:routeFieldColl_shard2_replica_n3] o.a.s.c.SyncStrategy Closed, skipping sync up.
   [junit4]   2> 5047516 INFO  (zkCallback-2356-thread-3-processing-n:127.0.0.1:39409_o_mu%2Fs) [n:127.0.0.1:39409_o_mu%2Fs c:routeFieldColl s:shard2 r:core_node11 x:routeFieldColl_shard2_replica_n3] o.a.s.c.SolrCore [routeFieldColl_shard2_replica_n3]  CLOSING SolrCore org.apache.solr.core.SolrCore@5f717e63
   [junit4]   2> 5047516 INFO  (zkCallback-2356-thread-3-processing-n:127.0.0.1:39409_o_mu%2Fs) [n:127.0.0.1:39409_o_mu%2Fs c:routeFieldColl s:shard2 r:core_node11 x:routeFieldColl_shard2_replica_n3] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.routeFieldColl.shard2.replica_n3, tag=1601273443
   [junit4]   2> 5047517 INFO  (zkCallback-2356-thread-3-processing-n:127.0.0.1:39409_o_mu%2Fs) [n:127.0.0.1:39409_o_mu%2Fs c:routeFieldColl s:shard2 r:core_node11 x:routeFieldColl_shard2_replica_n3] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2729f778: rootName = null, domain = solr.core.routeFieldColl.shard2.replica_n3, service url = null, agent id = null] for registry solr.core.routeFieldColl.shard2.replica_n3 / com.codahale.metrics.MetricRegistry@6f756884
   [junit4]   2> 5047569 INFO  (zkCallback-2356-thread-3-processing-n:127.0.0.1:39409_o_mu%2Fs) [n:127.0.0.1:39409_o_mu%2Fs c:routeFieldColl s:shard2 r:core_node11 x:routeFieldColl_shard2_replica_n3] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.routeFieldColl.shard2.leader, tag=1601273443
   [junit4]   2> 5047659 INFO  (TEST-ShardSplitTest.test-seed#[6466D98E0BF79769]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@40e0dcf7{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 5047659 INFO  (TEST-ShardSplitTest.test-seed#[6466D98E0BF79769]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@c0aae6a{/o_mu/s,null,UNAVAILABLE}
   [junit4]   2> 5047693 INFO  (TEST-ShardSplitTest.test-seed#[6466D98E0BF79769]) [    ] o.a.s.c.ChaosMonkey monkey: stop jetty! 38762
   [junit4]   2> 5047693 ERROR (TEST-ShardSplitTest.test-seed#[6466D98E0BF79769]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 5047695 INFO  (TEST-ShardSplitTest.test-seed#[6466D98E0BF79769]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:40639 40639
   [junit4]   2> 5047817 INFO  (Thread-4150) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:40639 40639
   [junit4]   2> 5047819 WARN  (Thread-4150) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	10	/solr/collections/routeFieldColl/state.json
   [junit4]   2> 	10	/solr/aliases.json
   [junit4]   2> 	10	/solr/collections/splitByRouteKeyTest/state.json
   [junit4]   2> 	5	/solr/security.json
   [junit4]   2> 	5	/solr/configs/conf1
   [junit4]   2> 	4	/solr/collections/collection1/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	10	/solr/clusterprops.json
   [junit4]   2> 	10	/solr/clusterstate.json
   [junit4]   2> 	5	/solr/autoscaling.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	10	/solr/live_nodes
   [junit4]   2> 	10	/solr/collections
   [junit4]   2> 	5	/solr/overseer/queue
   [junit4]   2> 	5	/solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 	5	/solr/overseer/collection-queue-work
   [junit4]   2> 	5	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6466D98E0BF79769-001
   [junit4]   2> Nov 07, 2017 2:48:32 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {rnd_b=Lucene50(blocksize=128), shard_s=FSTOrd50, a_t=FSTOrd50, id=Lucene50(blocksize=128)}, docValues:{rnd_b=DocValuesFormat(name=Lucene70), shard_s=DocValuesFormat(name=Direct), _version_=DocValuesFormat(name=Direct), n_ti=DocValuesFormat(name=Direct), a_t=DocValuesFormat(name=Direct), a_i=DocValuesFormat(name=Lucene70), id=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=495, maxMBSortInHeap=6.831173433073789, sim=RandomSimilarity(queryNorm=true): {}, locale=en-US, timezone=Europe/Kiev
   [junit4]   2> NOTE: Linux 4.4.0-83-generic amd64/Oracle Corporation 1.8.0_152 (64-bit)/cpus=4,threads=1,free=249381456,total=522190848
   [junit4]   2> NOTE: All tests run in this JVM: [TestCloudNestedDocsSort, ConjunctionSolrSpellCheckerTest, WrapperMergePolicyFactoryTest, ClassificationUpdateProcessorFactoryTest, TestMultiValuedNumericRangeQuery, TestFieldTypeCollectionResource, TestSurroundQueryParser, TestReplicaProperties, DeleteShardTest, SimpleMLTQParserTest, BufferStoreTest, DistributedFacetPivotLongTailTest, ChaosMonkeySafeLeaderWithPullReplicasTest, MoveReplicaHDFSFailoverTest, TestLeaderElectionZkExpiry, TestSSLRandomization, TriggerIntegrationTest, TestStressLucene, TestBinaryResponseWriter, TestMaxTokenLenTokenizer, TestManagedSynonymFilterFactory, TestConfigReload, TestHighFrequencyDictionaryFactory, ReplicaListTransformerTest, ShardRoutingCustomTest, TestSolrCloudWithKerberosAlt, OutputWriterTest, SolrGraphiteReporterTest, MultiThreadedOCPTest, TestCursorMarkWithoutUniqueKey, AssignTest, HdfsCollectionsAPIDistributedZkTest, DebugComponentTest, TestQuerySenderNoQuery, MergeStrategyTest, TestWriterPerf, TestLazyCores, HdfsDirectoryFactoryTest, ShowFileRequestHandlerTest, HttpPartitionTest, TestNumericTerms64, HdfsBasicDistributedZkTest, PeerSyncWithIndexFingerprintCachingTest, TestSizeLimitedDistributedMap, DOMUtilTest, DistributedTermsComponentTest, SuggesterTSTTest, TestEmbeddedSolrServerAdminHandler, TestCollectionAPI, PingRequestHandlerTest, TestXmlQParser, SuggesterFSTTest, TestConfigOverlay, TestInitQParser, DeleteLastCustomShardedReplicaTest, TestDocSet, TestRandomFlRTGCloud, HdfsWriteToMultipleCollectionsTest, TestFieldCacheWithThreads, HdfsRecoveryZkTest, CircularListTest, NotRequiredUniqueKeyTest, TestJsonFacets, RollingRestartTest, BlockJoinFacetRandomTest, TestConfigsApi, TestDynamicFieldResource, TestJettySolrRunner, TestPKIAuthenticationPlugin, TestCloudSchemaless, SolrRequestParserTest, TestExpandComponent, ManagedSchemaRoundRobinCloudTest, CdcrRequestHandlerTest, TestFaceting, TestConfigSetsAPIExclusivity, PathHierarchyTokenizerFactoryTest, ParsingFieldUpdateProcessorsTest, PolyFieldTest, RequestHandlersTest, TestPseudoReturnFields, DirectUpdateHandlerTest, ZkCLITest, SpatialRPTFieldTypeTest, TestReqParamsAPI, MBeansHandlerTest, TestScoreJoinQPScore, TestSQLHandlerNonCloud, LukeRequestHandlerTest, BasicAuthStandaloneTest, RegexBytesRefFilterTest, DistributedSuggestComponentTest, PrimUtilsTest, TestSolr4Spatial, TestDynamicLoading, AutoAddReplicasIntegrationTest, CloudExitableDirectoryReaderTest, TestRetrieveFieldsOptimizer, SynonymTokenizerTest, SuggestComponentContextFilterQueryTest, TestNumericTokenStream, TestRangeQuery, ConvertedLegacyTest, TestBM25SimilarityFactory, CreateCollectionCleanupTest, TestAuthenticationFramework, SolrMetricReporterTest, TestConfigSets, ShardRoutingTest, SolrIndexSplitterTest, TestAnalyzedSuggestions, TestExactStatsCache, TestMissingGroups, TestManagedSchema, PeerSyncReplicationTest, HighlighterConfigTest, TestStandardQParsers, TestTrackingShardHandlerFactory, OverseerRolesTest, AddReplicaTest, OpenExchangeRatesOrgProviderTest, TestHashPartitioner, TestJoin, SolrCmdDistributorTest, PeerSyncTest, TestFiltering, SpellCheckCollatorTest, TestCSVLoader, TestAtomicUpdateErrorCases, TestRemoteStreaming, XsltUpdateRequestHandlerTest, DocumentAnalysisRequestHandlerTest, TermVectorComponentTest, RequiredFieldsTest, FastVectorHighlighterTest, TestJmxIntegration, UniqFieldsUpdateProcessorFactoryTest, UpdateParamsTest, ResponseLogComponentTest, TestStressRecovery, DeleteStatusTest, DistribDocExpirationUpdateProcessorTest, DistributedVersionInfoTest, LeaderInitiatedRecoveryOnCommitTest, OverseerStatusTest, RestartWhileUpdatingTest, ShardSplitTest]
   [junit4] Completed [541/748 (5!)] on J1 in 469.42s, 5 tests, 1 failure <<< FAILURES!

[...truncated 47987 lines...]

[JENKINS] Lucene-Solr-Tests-7.x - Build # 227 - Still unstable

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/227/

16 tests failed.
FAILED:  org.apache.solr.handler.dataimport.TestContentStreamDataSource.testCommitWithin

Error Message:
expected:<0> but was:<2>

Stack Trace:
java.lang.AssertionError: expected:<0> but was:<2>
	at __randomizedtesting.SeedInfo.seed([E652F1EA981F2225:5C809E921B31CC30]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.handler.dataimport.TestContentStreamDataSource.testCommitWithin(TestContentStreamDataSource.java:98)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.DistribCursorPagingTest.test

Error Message:
Error from server at http://127.0.0.1:55433/ydn/b/collection1_shard1_replica_n43: Cannot talk to ZooKeeper - Updates are disabled.

Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at http://127.0.0.1:55433/ydn/b/collection1_shard1_replica_n43: Cannot talk to ZooKeeper - Updates are disabled.
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:D15E3283933AE4E6]:0)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:541)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1008)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:937)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:937)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:937)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:937)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:937)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:200)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.indexDoc(AbstractFullDistribZkTestBase.java:839)
	at org.apache.solr.cloud.DistribCursorPagingTest.doRandomSortsOnLargeIndex(DistribCursorPagingTest.java:581)
	at org.apache.solr.cloud.DistribCursorPagingTest.test(DistribCursorPagingTest.java:93)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:55433/ydn/b/collection1_shard1_replica_n43: Cannot talk to ZooKeeper - Updates are disabled.
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:518)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	... 1 more


FAILED:  org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test

Error Message:
KeeperErrorCode = Session expired for /clusterstate.json

Stack Trace:
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:D15E3283933AE4E6]:0)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
	at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:332)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:332)
	at org.apache.solr.common.cloud.ZkStateReader.refreshLegacyClusterState(ZkStateReader.java:586)
	at org.apache.solr.common.cloud.ZkStateReader.forceUpdateCollection(ZkStateReader.java:352)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.updateMappingsFromZk(AbstractFullDistribZkTestBase.java:674)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.updateMappingsFromZk(AbstractFullDistribZkTestBase.java:669)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(AbstractFullDistribZkTestBase.java:464)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:334)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:991)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.MultiThreadedOCPTest.test

Error Message:
Error from server at http://127.0.0.1:42803/qx/lh: KeeperErrorCode = Session expired for /overseer/collection-map-completed/mn-1001

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:42803/qx/lh: KeeperErrorCode = Session expired for /overseer/collection-map-completed/mn-1001
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:D15E3283933AE4E6]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:200)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.getStatusResponse(AbstractFullDistribZkTestBase.java:2241)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.getRequestState(AbstractFullDistribZkTestBase.java:2234)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.getRequestState(AbstractFullDistribZkTestBase.java:2230)
	at org.apache.solr.cloud.MultiThreadedOCPTest.testTaskExclusivity(MultiThreadedOCPTest.java:178)
	at org.apache.solr.cloud.MultiThreadedOCPTest.test(MultiThreadedOCPTest.java:64)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.OverseerTaskQueueTest.testPeekElements

Error Message:
expected:<1> but was:<0>

Stack Trace:
java.lang.AssertionError: expected:<1> but was:<0>
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:A424B778EDFFDD03]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.cloud.DistributedQueueTest.testPeekElements(DistributedQueueTest.java:261)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.PeerSyncReplicationTest.test

Error Message:
KeeperErrorCode = Session expired for /clusterstate.json

Stack Trace:
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:D15E3283933AE4E6]:0)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
	at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:332)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:332)
	at org.apache.solr.common.cloud.ZkStateReader.refreshLegacyClusterState(ZkStateReader.java:586)
	at org.apache.solr.common.cloud.ZkStateReader.forceUpdateCollection(ZkStateReader.java:352)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.updateMappingsFromZk(AbstractFullDistribZkTestBase.java:674)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.updateMappingsFromZk(AbstractFullDistribZkTestBase.java:669)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(AbstractFullDistribZkTestBase.java:464)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:334)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:991)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testCreateDelete {seed=[590A0D593DC6891E:F64C40E9FFF4BA02]}

Error Message:
Error from server at https://127.0.0.1:35030/solr: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000012

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:35030/solr: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000012
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:F64C40E9FFF4BA02]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:200)
	at org.apache.solr.cloud.TestTlogReplica.testCreateDelete(TestTlogReplica.java:211)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.UnloadDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=1742, name=testExecutor-768-thread-5, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1742, name=testExecutor-768-thread-5, state=RUNNABLE, group=TGRP-UnloadDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:41183/rd/r: Another replica with the same core name already exists for this collection
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:200)
	at org.apache.solr.cloud.BasicDistributedZkTest.lambda$createCollectionInOneInstance$0(BasicDistributedZkTest.java:593)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.autoscaling.SystemLogListenerTest.test

Error Message:
Trigger was not fired 

Stack Trace:
java.lang.AssertionError: Trigger was not fired 
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:D15E3283933AE4E6]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.autoscaling.SystemLogListenerTest.test(SystemLogListenerTest.java:151)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.TestSQLHandler.doTest

Error Message:
--> https://127.0.0.1:58366/collection1_shard2_replica_n41:Failed to execute sqlQuery 'select id from collection1 where id = 1 order by id asc' against JDBC connection 'jdbc:calcitesolr:'. Error while executing SQL "select id from collection1 where id = 1 order by id asc": java.io.IOException: org.apache.solr.common.SolrException: Could not load collection from ZK: collection1

Stack Trace:
java.io.IOException: --> https://127.0.0.1:58366/collection1_shard2_replica_n41:Failed to execute sqlQuery 'select id from collection1 where id = 1 order by id asc' against JDBC connection 'jdbc:calcitesolr:'.
Error while executing SQL "select id from collection1 where id = 1 order by id asc": java.io.IOException: org.apache.solr.common.SolrException: Could not load collection from ZK: collection1
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:FE4EB5FD507D9AA7]:0)
	at org.apache.solr.client.solrj.io.stream.SolrStream.read(SolrStream.java:222)
	at org.apache.solr.handler.TestSQLHandler.getTuples(TestSQLHandler.java:2522)
	at org.apache.solr.handler.TestSQLHandler.testWhere(TestSQLHandler.java:368)
	at org.apache.solr.handler.TestSQLHandler.doTest(TestSQLHandler.java:83)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  junit.framework.TestSuite.org.apache.solr.handler.TestSQLHandler

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.handler.TestSQLHandler:     1) Thread[id=29274, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestSQLHandler]         at java.lang.Thread.sleep(Native Method)         at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.handler.TestSQLHandler: 
   1) Thread[id=29274, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestSQLHandler]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.lang.Thread.run(Thread.java:748)
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E]:0)


FAILED:  org.apache.solr.cloud.ShardSplitTest.testSplitAfterFailedSplit

Error Message:
expected:<1> but was:<2>

Stack Trace:
java.lang.AssertionError: expected:<1> but was:<2>
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:A0479EF601B3C494]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.cloud.ShardSplitTest.testSplitAfterFailedSplit(ShardSplitTest.java:279)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates

Error Message:


Stack Trace:
java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:DFCBF5B462975FFE]:0)
	at org.apache.solr.cloud.TestTlogReplica.getSolrCore(TestTlogReplica.java:863)
	at org.apache.solr.cloud.TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates(TestTlogReplica.java:661)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testBasicLeaderElection

Error Message:


Stack Trace:
java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:CF82CB11D55CCEE4]:0)
	at org.apache.solr.cloud.TestTlogReplica.getSolrRunner(TestTlogReplica.java:898)
	at org.apache.solr.cloud.TestTlogReplica.testBasicLeaderElection(TestTlogReplica.java:644)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:


Stack Trace:
java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:98FA74F5109643B9]:0)
	at org.apache.solr.cloud.TestTlogReplica.getSolrRunner(TestTlogReplica.java:898)
	at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:533)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testOnlyLeaderIndexes

Error Message:


Stack Trace:
java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:450B70D44863F78D]:0)
	at org.apache.solr.cloud.TestTlogReplica.getSolrCore(TestTlogReplica.java:863)
	at org.apache.solr.cloud.TestTlogReplica.testOnlyLeaderIndexes(TestTlogReplica.java:466)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 11603 lines...]
   [junit4] Suite: org.apache.solr.cloud.OverseerTaskQueueTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.OverseerTaskQueueTest_590A0D593DC6891E-001/init-core-data-001
   [junit4]   2> 360480 WARN  (SUITE-OverseerTaskQueueTest-seed#[590A0D593DC6891E]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=194 numCloses=194
   [junit4]   2> 360480 INFO  (SUITE-OverseerTaskQueueTest-seed#[590A0D593DC6891E]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 360481 INFO  (SUITE-OverseerTaskQueueTest-seed#[590A0D593DC6891E]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 364036 INFO  (SUITE-OverseerTaskQueueTest-seed#[590A0D593DC6891E]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 364062 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueueBlocking-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testDistributedQueueBlocking
   [junit4]   2> 364176 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueueBlocking-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 364216 INFO  (Thread-521) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 364216 INFO  (Thread-521) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 364822 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueueBlocking-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer start zk server on port:60690
   [junit4]   2> 366381 ERROR (Thread-521) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 370027 WARN  (zkCallback-104-thread-2) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@16848ba name: ZooKeeperConnection Watcher:127.0.0.1:60690/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
   [junit4]   2> 370028 WARN  (zkCallback-104-thread-2) [    ] o.a.s.c.c.ConnectionManager zkClient has disconnected
   [junit4]   2> 371607 WARN  (TEST-OverseerTaskQueueTest.testDistributedQueueBlocking-seed#[590A0D593DC6891E]-SendThread(127.0.0.1:60690)) [    ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x15f9247a52d0000 has expired
   [junit4]   2> 371623 WARN  (zkCallback-104-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@16848ba name: ZooKeeperConnection Watcher:127.0.0.1:60690/solr got event WatchedEvent state:Expired type:None path:null path: null type: None
   [junit4]   2> 371624 WARN  (zkCallback-104-thread-1) [    ] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
   [junit4]   2> 371624 WARN  (zkCallback-104-thread-1) [    ] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one...
   [junit4]   2> 371730 INFO  (zkCallback-104-thread-1) [    ] o.a.s.c.c.ConnectionManager Connection with ZooKeeper reestablished.
   [junit4]   2> 371730 INFO  (zkCallback-104-thread-1) [    ] o.a.s.c.c.DefaultConnectionStrategy Reconnected to ZooKeeper
   [junit4]   2> 371730 INFO  (zkCallback-104-thread-1) [    ] o.a.s.c.c.ConnectionManager Connected:true
   [junit4]   2> 373105 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueueBlocking-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testDistributedQueueBlocking
   [junit4]   2> 373106 ERROR (TEST-OverseerTaskQueueTest.testDistributedQueueBlocking-seed#[590A0D593DC6891E]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 373118 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueueBlocking-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:60690 60690
   [junit4]   2> 373719 INFO  (Thread-521) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:60690 60690
   [junit4]   2> 373720 WARN  (Thread-521) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	2	/solr/distqueue/test
   [junit4]   2> 
   [junit4]   2> 373723 INFO  (TEST-OverseerTaskQueueTest.testLeakChildWatcher-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testLeakChildWatcher
   [junit4]   2> 373724 INFO  (TEST-OverseerTaskQueueTest.testLeakChildWatcher-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 373748 INFO  (Thread-522) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 373748 INFO  (Thread-522) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 373796 ERROR (Thread-522) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 374030 INFO  (TEST-OverseerTaskQueueTest.testLeakChildWatcher-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer start zk server on port:44574
   [junit4]   2> 374554 INFO  (TEST-OverseerTaskQueueTest.testLeakChildWatcher-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testLeakChildWatcher
   [junit4]   2> 374555 ERROR (TEST-OverseerTaskQueueTest.testLeakChildWatcher-seed#[590A0D593DC6891E]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 374555 INFO  (TEST-OverseerTaskQueueTest.testLeakChildWatcher-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:44574 44574
   [junit4]   2> 374747 INFO  (Thread-522) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:44574 44574
   [junit4]   2> 374760 INFO  (TEST-OverseerTaskQueueTest.testLocallyOffer-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testLocallyOffer
   [junit4]   2> 374761 INFO  (TEST-OverseerTaskQueueTest.testLocallyOffer-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 374787 INFO  (Thread-523) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 374787 INFO  (Thread-523) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 374997 INFO  (TEST-OverseerTaskQueueTest.testLocallyOffer-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer start zk server on port:53781
   [junit4]   2> 375049 ERROR (Thread-523) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 377467 INFO  (TEST-OverseerTaskQueueTest.testLocallyOffer-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testLocallyOffer
   [junit4]   2> 377468 ERROR (TEST-OverseerTaskQueueTest.testLocallyOffer-seed#[590A0D593DC6891E]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 377469 INFO  (TEST-OverseerTaskQueueTest.testLocallyOffer-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:53781 53781
   [junit4]   2> 377592 INFO  (Thread-523) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:53781 53781
   [junit4]   2> 377600 INFO  (TEST-OverseerTaskQueueTest.testPeekElements-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testPeekElements
   [junit4]   2> 377600 INFO  (TEST-OverseerTaskQueueTest.testPeekElements-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 377635 INFO  (Thread-524) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 377635 INFO  (Thread-524) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 377698 ERROR (Thread-524) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 377771 INFO  (TEST-OverseerTaskQueueTest.testPeekElements-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer start zk server on port:41123
   [junit4]   2> 380908 INFO  (TEST-OverseerTaskQueueTest.testPeekElements-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testPeekElements
   [junit4]   2> 381207 ERROR (TEST-OverseerTaskQueueTest.testPeekElements-seed#[590A0D593DC6891E]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 381297 INFO  (TEST-OverseerTaskQueueTest.testPeekElements-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41123 41123
   [junit4]   2> 381508 INFO  (Thread-524) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41123 41123
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=OverseerTaskQueueTest -Dtests.method=testPeekElements -Dtests.seed=590A0D593DC6891E -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=de -Dtests.timezone=JST -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 3.94s J0 | OverseerTaskQueueTest.testPeekElements <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: expected:<1> but was:<0>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([590A0D593DC6891E:A424B778EDFFDD03]:0)
   [junit4]    > 	at org.apache.solr.cloud.DistributedQueueTest.testPeekElements(DistributedQueueTest.java:261)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 381550 INFO  (TEST-OverseerTaskQueueTest.testContainsTaskWithRequestId-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testContainsTaskWithRequestId
   [junit4]   2> 381551 INFO  (TEST-OverseerTaskQueueTest.testContainsTaskWithRequestId-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 381597 INFO  (Thread-525) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 381597 INFO  (Thread-525) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 381697 INFO  (TEST-OverseerTaskQueueTest.testContainsTaskWithRequestId-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer start zk server on port:46467
   [junit4]   2> 381700 ERROR (Thread-525) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 382186 INFO  (TEST-OverseerTaskQueueTest.testContainsTaskWithRequestId-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testContainsTaskWithRequestId
   [junit4]   2> 382191 ERROR (TEST-OverseerTaskQueueTest.testContainsTaskWithRequestId-seed#[590A0D593DC6891E]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 382192 INFO  (TEST-OverseerTaskQueueTest.testContainsTaskWithRequestId-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46467 46467
   [junit4]   2> 382296 INFO  (Thread-525) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46467 46467
   [junit4]   2> 382331 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueue-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testDistributedQueue
   [junit4]   2> 382332 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueue-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 382363 INFO  (Thread-526) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 382363 INFO  (Thread-526) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 382448 ERROR (Thread-526) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 382463 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueue-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer start zk server on port:36735
   [junit4]   2> 384715 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueue-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testDistributedQueue
   [junit4]   2> 384732 ERROR (TEST-OverseerTaskQueueTest.testDistributedQueue-seed#[590A0D593DC6891E]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 384732 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueue-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36735 36735
   [junit4]   2> 384912 INFO  (Thread-526) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36735 36735
   [junit4]   2> 384920 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueueCache-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testDistributedQueueCache
   [junit4]   2> 384920 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueueCache-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 385063 INFO  (Thread-529) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 385064 INFO  (Thread-529) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 385167 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueueCache-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer start zk server on port:60893
   [junit4]   2> 385728 ERROR (Thread-529) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 387288 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueueCache-seed#[590A0D593DC6891E]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testDistributedQueueCache
   [junit4]   2> 387299 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f9247f5b70000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 387300 ERROR (TEST-OverseerTaskQueueTest.testDistributedQueueCache-seed#[590A0D593DC6891E]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 387301 INFO  (TEST-OverseerTaskQueueTest.testDistributedQueueCache-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:60893 60893
   [junit4]   2> 387602 INFO  (Thread-529) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:60893 60893
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.OverseerTaskQueueTest_590A0D593DC6891E-001
   [junit4]   2> Nov 06, 2017 5:01:52 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=882, maxMBSortInHeap=6.723385164063693, sim=RandomSimilarity(queryNorm=true): {}, locale=de, timezone=JST
   [junit4]   2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=76574448,total=284688384
   [junit4]   2> NOTE: All tests run in this JVM: [TestReplicationHandler, OverseerTaskQueueTest]
   [junit4] Completed [8/747 (1!)] on J0 in 28.12s, 7 tests, 1 failure <<< FAILURES!

[...truncated 109 lines...]
   [junit4] Suite: org.apache.solr.cloud.UnloadDistributedZkTest
   [junit4]   2> 911194 INFO  (SUITE-UnloadDistributedZkTest-seed#[590A0D593DC6891E]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.UnloadDistributedZkTest_590A0D593DC6891E-001/init-core-data-001
   [junit4]   2> 911195 WARN  (SUITE-UnloadDistributedZkTest-seed#[590A0D593DC6891E]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
   [junit4]   2> 911195 INFO  (SUITE-UnloadDistributedZkTest-seed#[590A0D593DC6891E]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 911217 INFO  (SUITE-UnloadDistributedZkTest-seed#[590A0D593DC6891E]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 911217 INFO  (SUITE-UnloadDistributedZkTest-seed#[590A0D593DC6891E]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /rd/r
   [junit4]   2> 911230 INFO  (TEST-UnloadDistributedZkTest.test-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 911233 INFO  (Thread-264) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 911233 INFO  (Thread-264) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 911284 ERROR (Thread-264) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 911334 INFO  (TEST-UnloadDistributedZkTest.test-seed#[590A0D593DC6891E]) [    ] o.a.s.c.ZkTestServer start zk server on port:53346
   [junit4]   2> 911493 INFO  (TEST-UnloadDistributedZkTest.test-seed#[590A0D593DC6891E]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 911506 INFO  (TEST-UnloadDistributedZkTest.test-seed#[590A0D593DC6891E]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 911507 INFO  (TEST-UnloadDistributedZkTest.test-seed#[590A0D593DC6891E]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 911508 INFO  (TEST-UnloadDistributedZkTest.test-seed#[590A0D593DC6891E]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 911516 INFO  (TEST-UnloadDistributedZkTest.test-seed#[590A0D593DC6891E]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 911517 INFO  (TEST-UnloadDistributedZkTest.test-seed#[590A0D593DC6891E]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 911517 INFO  (TEST-UnloadDistributedZkTest.test-seed#[590A0D593DC6891E]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 911527 INFO  (TEST-UnloadDistributedZkTest.test-seed#[590A0D593DC6891E]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-f

[...truncated too long message...]

junit4]   2> 171776 T65 oass.SolrDispatchFilter.logWelcomeBanner / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 171776 T65 oass.SolrDispatchFilter.logWelcomeBanner \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 171777 T65 oass.SolrDispatchFilter.logWelcomeBanner |___/\___/_|_|    Start time: 2017-11-06T20:37:15.887Z
   [junit4]   2> 171777 T65 oasc.SolrXmlConfig.fromFile Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/contrib/solr-dataimporthandler/test/J2/temp/solr.handler.dataimport.TestContentStreamDataSource_E652F1EA981F2225-001/inst-002/solr.xml
   [junit4]   2> 171808 T65 oasc.SolrXmlConfig.getMetricReporterPluginInfos MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@387f1699, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 172506 T65 oasmr.SolrJmxReporter.doInit JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@387f1699
   [junit4]   2> 172679 T65 oasmr.SolrJmxReporter.doInit JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@387f1699
   [junit4]   2> 172679 T65 oasmr.SolrJmxReporter.doInit JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@387f1699
   [junit4]   2> 172757 T65 oasc.CorePropertiesLocator.discover Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/contrib/solr-dataimporthandler/test/J2/temp/solr.handler.dataimport.TestContentStreamDataSource_E652F1EA981F2225-001/inst-002
   [junit4]   2> 172765 T65 oasc.CorePropertiesLocator.discover Cores are: [collection1]
   [junit4]   2> 172824 T100 oasc.TransientSolrCoreCacheDefault.doInit Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 173275 T100 x:x:collection1 oasc.SolrConfig.<init> Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 173450 T100 x:x:collection1 oass.IndexSchema.readSchema [collection1] Schema name=dih_test
   [junit4]   2> 173592 T100 x:x:collection1 oass.IndexSchema.readSchema Loaded schema dih_test/4.0 with uniqueid field id
   [junit4]   2> 173592 T100 x:x:collection1 oasc.CoreContainer.createFromDescriptor Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/contrib/solr-dataimporthandler/test/J2/temp/solr.handler.dataimport.TestContentStreamDataSource_E652F1EA981F2225-001/inst-002/collection1, trusted=true
   [junit4]   2> 173592 T100 x:x:collection1 oasmr.SolrJmxReporter.doInit JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@387f1699
   [junit4]   2> 173593 T100 x:x:collection1 oasc.SolrCore.initRecoveryStrategyBuilder solr.RecoveryStrategy.Builder
   [junit4]   2> 173593 T100 x:x:collection1 oasc.SolrCore.<init> [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/contrib/solr-dataimporthandler/test/J2/temp/solr.handler.dataimport.TestContentStreamDataSource_E652F1EA981F2225-001/inst-002/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/contrib/solr-dataimporthandler/test/J2/temp/solr.handler.dataimport.TestContentStreamDataSource_E652F1EA981F2225-001/inst-002/collection1/data/]
   [junit4]   2> 174287 T100 x:x:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 174288 T100 x:x:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 174376 T100 x:x:collection1 oass.SolrIndexSearcher.<init> Opening [Searcher@2c05f8f2[collection1] main]
   [junit4]   2> 174376 T100 x:x:collection1 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/contrib/solr-dataimporthandler/test/J2/temp/solr.handler.dataimport.TestContentStreamDataSource_E652F1EA981F2225-001/inst-002/collection1/conf
   [junit4]   2> 174377 T100 x:x:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000ms.
   [junit4]   2> 174379 T104 x:x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2c05f8f2[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> ASYNC  NEW_CORE C7 name=collection1 org.apache.solr.core.SolrCore@6303b63e
   [junit4]   2> 175016 T92 x:x:collection1 C7 oashd.DataImporter.maybeReloadConfiguration Loading DIH Configuration: data-config.xml
   [junit4]   2> 175018 T92 x:x:collection1 C7 oashd.DataImporter.loadDataConfig Data Configuration loaded successfully
   [junit4]   2> 175018 T92 x:x:collection1 C7 oashd.DataImporter.doFullImport Starting Full Import
   [junit4]   2> 175019 T92 x:x:collection1 C7 oashd.SimplePropertiesWriter.readIndexerProperties WARN Unable to read: dataimport.properties
   [junit4]   2> 175048 T92 x:x:collection1 C7 oashd.DocBuilder.finish Import completed successfully
   [junit4]   2> 175048 T92 x:x:collection1 C7 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 175048 T92 x:x:collection1 C7 oasu.SolrIndexWriter.setCommitData Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@7dd17df0 commitCommandVersion:0
   [junit4]   2> 175117 T92 x:x:collection1 C7 oass.SolrIndexSearcher.<init> Opening [Searcher@353e4d76[collection1] main]
   [junit4]   2> 175136 T92 x:x:collection1 C7 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 175142 T104 x:x:collection1 C7 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@353e4d76[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.2.0):c2)))}
   [junit4]   2> 175171 T92 x:x:collection1 C7 oashd.SimplePropertiesWriter.readIndexerProperties WARN Unable to read: dataimport.properties
   [junit4]   2> 175172 T92 x:x:collection1 C7 oashd.SimplePropertiesWriter.persist Wrote last indexed time to dataimport.properties
   [junit4]   2> 175172 T92 x:x:collection1 C7 oashd.DocBuilder.execute Time taken = 0:0:0.152
   [junit4]   2> 175172 T92 x:x:collection1 C7 oasup.LogUpdateProcessorFactory$LogUpdateProcessor.finish [collection1]  webapp=/solr path=/dataimport params={clean=false&wt=javabin&version=2&command=full-import}{add=[1, 2],commit=} 0 155
   [junit4]   2> 175186 T93 x:x:collection1 C7 oasc.SolrCore.execute [collection1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=2 status=0 QTime=1
   [junit4]   2> 175208 T65 oejs.AbstractConnector.doStop Stopped ServerConnector@14eee448{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 175208 T65 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1795271940
   [junit4]   2> 175231 T65 oasm.SolrMetricManager.closeReporters Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 175232 T65 oasmr.SolrJmxReporter.close Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@34b449ab: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@2e750bf1
   [junit4]   2> 175250 T65 oasm.SolrMetricManager.closeReporters Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 175250 T65 oasmr.SolrJmxReporter.close Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6a6b72ed: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@5a79115b
   [junit4]   2> 175257 T65 oasm.SolrMetricManager.closeReporters Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 175257 T65 oasmr.SolrJmxReporter.close Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2a7b1b0: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@4d1d089e
   [junit4]   2> 175291 T108 x:x:collection1 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@6303b63e
   [junit4]   2> 175291 T108 x:x:collection1 oasm.SolrMetricManager.closeReporters Closing metric reporters for registry=solr.core.collection1, tag=1661187646
   [junit4]   2> 175292 T108 x:x:collection1 oasmr.SolrJmxReporter.close Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@24f96e0: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@51e9ce82
   [junit4]   2> 175488 T65 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@63001271{/solr,null,UNAVAILABLE}
   [junit4]   2> 175511 T65 oas.SolrTestCaseJ4.tearDown ###Ending testSimple
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/contrib/solr-dataimporthandler/test/J2/temp/solr.handler.dataimport.TestContentStreamDataSource_E652F1EA981F2225-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70), sim=RandomSimilarity(queryNorm=false): {}, locale=es-CR, timezone=America/St_Lucia
   [junit4]   2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=106455536,total=273678336
   [junit4]   2> NOTE: All tests run in this JVM: [TestFieldReader, TestDateFormatTransformer, TestVariableResolver, TestRegexTransformer, TestPlainTextEntityProcessor, TestXPathEntityProcessor, TestSimplePropertiesWriter, TestURLDataSource, TestWriterImpl, TestSqlEntityProcessorDelta, TestContentStreamDataSource]
   [junit4] Completed [25/38 (1!)] on J2 in 25.97s, 2 tests, 1 failure <<< FAILURES!

[...truncated 41751 lines...]

[JENKINS] Lucene-Solr-Tests-7.x - Build # 226 - Failure

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/226/

No tests ran.

Build Log:
[...truncated 11777 lines...]
   [junit4] Suite: org.apache.solr.cloud.ShardSplitTest
   [junit4]   2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/init-core-data-001
   [junit4]   2> 266515 WARN  (SUITE-ShardSplitTest-seed#[2D27D509B36ECE00]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=61 numCloses=61
   [junit4]   2> 266516 INFO  (SUITE-ShardSplitTest-seed#[2D27D509B36ECE00]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 266517 INFO  (SUITE-ShardSplitTest-seed#[2D27D509B36ECE00]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 266517 INFO  (SUITE-ShardSplitTest-seed#[2D27D509B36ECE00]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 266530 INFO  (SUITE-ShardSplitTest-seed#[2D27D509B36ECE00]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /j/n
   [junit4]   2> 266550 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 266550 INFO  (Thread-139) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 266550 INFO  (Thread-139) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 266552 ERROR (Thread-139) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 266659 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.ZkTestServer start zk server on port:34914
   [junit4]   2> 266883 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 266916 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 266917 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 266918 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 266919 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 266952 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 266954 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 266955 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 266956 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 266970 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 266989 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 267043 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
   [junit4]   2> 267043 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f8fab080d0001, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 267810 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 267898 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@74710238{/j/n,null,AVAILABLE}
   [junit4]   2> 267917 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@731fdda4{HTTP/1.1,[http/1.1]}{127.0.0.1:40999}
   [junit4]   2> 267937 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.Server Started @286428ms
   [junit4]   2> 267937 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/tempDir-001/control/data, replicaType=NRT, hostContext=/j/n, hostPort=40999, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/control-001/cores}
   [junit4]   2> 267937 ERROR (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 267937 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 267937 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 267937 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 267937 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-06T04:51:12.887Z
   [junit4]   2> 268084 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 268084 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/control-001/solr.xml
   [junit4]   2> 268195 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 268195 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 268197 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 268305 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34914/solr
   [junit4]   2> 269141 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 269142 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:40999_j%2Fn
   [junit4]   2> 269142 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.Overseer Overseer (id=98955681562689540-127.0.0.1:40999_j%2Fn-n_0000000000) starting
   [junit4]   2> 269217 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40999_j%2Fn
   [junit4]   2> 269315 INFO  (OverseerStateUpdate-98955681562689540-127.0.0.1:40999_j%2Fn-n_0000000000) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 270334 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 270424 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 270514 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 270516 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/control-001/cores
   [junit4]   2> 270963 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 270963 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34914/solr ready
   [junit4]   2> 271090 INFO  (qtp611766918-530) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:40999_j%252Fn&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 271182 INFO  (OverseerThreadFactory-269-thread-1-processing-n:127.0.0.1:40999_j%2Fn) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 271391 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 271391 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 271579 INFO  (zkCallback-82-thread-1-processing-n:127.0.0.1:40999_j%2Fn) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 272728 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 272835 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 273771 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 273953 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 273953 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 274011 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 274011 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 274047 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=7.8662109375, floorSegmentMB=0.2275390625, forceMergeDeletesPctAllowed=21.88348059763291, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 274117 WARN  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 274482 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 274482 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 274483 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 274483 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 274484 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=38, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6670582967866131]
   [junit4]   2> 274485 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@689b8ef6[control_collection_shard1_replica_n1] main]
   [junit4]   2> 274502 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 274503 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 274503 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 274505 INFO  (searcherExecutor-272-thread-1-processing-n:127.0.0.1:40999_j%2Fn x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@689b8ef6[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 274505 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583290913343406080
   [junit4]   2> 274539 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 274539 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 274539 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:40999/j/n/control_collection_shard1_replica_n1/
   [junit4]   2> 274540 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 274540 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:40999/j/n/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 274540 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 274575 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:40999/j/n/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 274613 INFO  (zkCallback-82-thread-2-processing-n:127.0.0.1:40999_j%2Fn) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 274628 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 274629 INFO  (qtp611766918-528) [n:127.0.0.1:40999_j%2Fn c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=3238
   [junit4]   2> 274649 INFO  (qtp611766918-530) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 274760 INFO  (zkCallback-82-thread-3-processing-n:127.0.0.1:40999_j%2Fn) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 275360 INFO  (OverseerCollectionConfigSetProcessor-98955681562689540-127.0.0.1:40999_j%2Fn-n_0000000000) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 275653 INFO  (qtp611766918-530) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:40999_j%252Fn&wt=javabin&version=2} status=0 QTime=4563
   [junit4]   2> 275800 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 275801 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34914/solr ready
   [junit4]   2> 275801 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 275803 INFO  (qtp611766918-531) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 275857 INFO  (OverseerThreadFactory-269-thread-2-processing-n:127.0.0.1:40999_j%2Fn) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 275857 WARN  (OverseerThreadFactory-269-thread-2-processing-n:127.0.0.1:40999_j%2Fn) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 276078 INFO  (qtp611766918-531) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 276079 INFO  (qtp611766918-531) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=276
   [junit4]   2> 276093 INFO  (OverseerCollectionConfigSetProcessor-98955681562689540-127.0.0.1:40999_j%2Fn-n_0000000000) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 276987 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-1-001 of type TLOG
   [junit4]   2> 276988 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 276989 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@142bd175{/j/n,null,AVAILABLE}
   [junit4]   2> 276989 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@410a7614{HTTP/1.1,[http/1.1]}{127.0.0.1:40610}
   [junit4]   2> 276989 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.Server Started @295481ms
   [junit4]   2> 276989 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/tempDir-001/jetty1, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/j/n, hostPort=40610, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-1-001/cores}
   [junit4]   2> 276989 ERROR (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 276990 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 276990 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 276990 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 276990 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-06T04:51:21.940Z
   [junit4]   2> 277080 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 277080 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-1-001/solr.xml
   [junit4]   2> 277084 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 277084 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 277102 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 277119 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34914/solr
   [junit4]   2> 277609 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 277643 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 277645 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40610_j%2Fn
   [junit4]   2> 277645 INFO  (zkCallback-90-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 277696 INFO  (zkCallback-95-thread-1-processing-n:127.0.0.1:40610_j%2Fn) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 277703 INFO  (zkCallback-82-thread-1-processing-n:127.0.0.1:40999_j%2Fn) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 278082 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 278140 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 278140 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 278155 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-1-001/cores
   [junit4]   2> 278448 INFO  (qtp397310241-578) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:40610_j%252Fn&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 278560 INFO  (OverseerThreadFactory-269-thread-3-processing-n:127.0.0.1:40999_j%2Fn) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:40610_j%2Fn for creating new replica
   [junit4]   2> 278614 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 278632 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 278813 INFO  (zkCallback-95-thread-1-processing-n:127.0.0.1:40610_j%2Fn) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 279844 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 279955 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema [collection1_shard2_replica_t41] Schema name=test
   [junit4]   2> 280792 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 280908 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t41' using configuration from collection collection1, trusted=true
   [junit4]   2> 280962 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t41' (registry 'solr.core.collection1.shard2.replica_t41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 280962 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 280962 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [[collection1_shard2_replica_t41] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-1-001/cores/collection1_shard2_replica_t41], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-1-001/cores/collection1_shard2_replica_t41/data/]
   [junit4]   2> 280965 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=7.8662109375, floorSegmentMB=0.2275390625, forceMergeDeletesPctAllowed=21.88348059763291, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 281106 WARN  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 281636 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 281636 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 281637 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 281637 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 281691 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=38, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6670582967866131]
   [junit4]   2> 281706 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.SolrIndexSearcher Opening [Searcher@6ed760e1[collection1_shard2_replica_t41] main]
   [junit4]   2> 281708 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 281708 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 281709 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 281710 INFO  (searcherExecutor-283-thread-1-processing-n:127.0.0.1:40610_j%2Fn x:collection1_shard2_replica_t41 s:shard2 c:collection1) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [collection1_shard2_replica_t41] Registered new searcher Searcher@6ed760e1[collection1_shard2_replica_t41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 281763 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583290920953970688
   [junit4]   2> 281780 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 281780 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 281781 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:40610/j/n/collection1_shard2_replica_t41/
   [junit4]   2> 281781 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 281782 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy http://127.0.0.1:40610/j/n/collection1_shard2_replica_t41/ has no replicas
   [junit4]   2> 281782 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 281782 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ZkController collection1_shard2_replica_t41 stopping background replication from leader
   [junit4]   2> 281817 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:40610/j/n/collection1_shard2_replica_t41/ shard2
   [junit4]   2> 281893 INFO  (zkCallback-95-thread-1-processing-n:127.0.0.1:40610_j%2Fn) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 281925 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 281927 INFO  (qtp397310241-576) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=3312
   [junit4]   2> 281967 INFO  (qtp397310241-578) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:40610_j%252Fn&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=3518
   [junit4]   2> 282076 INFO  (zkCallback-95-thread-1-processing-n:127.0.0.1:40610_j%2Fn) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 282589 INFO  (OverseerCollectionConfigSetProcessor-98955681562689540-127.0.0.1:40999_j%2Fn-n_0000000000) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 283770 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-2-001 of type TLOG
   [junit4]   2> 283771 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 283857 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@25354843{/j/n,null,AVAILABLE}
   [junit4]   2> 283858 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@6015987a{HTTP/1.1,[http/1.1]}{127.0.0.1:40217}
   [junit4]   2> 283858 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.Server Started @302349ms
   [junit4]   2> 283858 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/tempDir-001/jetty2, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/j/n, hostPort=40217, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-2-001/cores}
   [junit4]   2> 283858 ERROR (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 284227 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 284263 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 284263 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 284263 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-06T04:51:29.213Z
   [junit4]   2> 284459 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 284459 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-2-001/solr.xml
   [junit4]   2> 284462 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 284462 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 284483 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 284626 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34914/solr
   [junit4]   2> 284917 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 284952 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 285012 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40217_j%2Fn
   [junit4]   2> 285013 INFO  (zkCallback-95-thread-1-processing-n:127.0.0.1:40610_j%2Fn) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 285048 INFO  (zkCallback-90-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 285013 INFO  (zkCallback-82-thread-1-processing-n:127.0.0.1:40999_j%2Fn) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 285276 INFO  (zkCallback-101-thread-1-processing-n:127.0.0.1:40217_j%2Fn) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 285554 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 285921 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 285921 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 285923 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-2-001/cores
   [junit4]   2> 286413 INFO  (qtp260274602-607) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:40217_j%252Fn&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 286578 INFO  (OverseerThreadFactory-269-thread-4-processing-n:127.0.0.1:40999_j%2Fn) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:40217_j%2Fn for creating new replica
   [junit4]   2> 286702 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 286702 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 286740 INFO  (zkCallback-95-thread-1-processing-n:127.0.0.1:40610_j%2Fn) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 286741 INFO  (zkCallback-101-thread-1-processing-n:127.0.0.1:40217_j%2Fn) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 287875 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 288043 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema [collection1_shard1_replica_t43] Schema name=test
   [junit4]   2> 288989 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 289090 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t43' using configuration from collection collection1, trusted=true
   [junit4]   2> 289090 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t43' (registry 'solr.core.collection1.shard1.replica_t43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 289090 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 289090 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [[collection1_shard1_replica_t43] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-2-001/cores/collection1_shard1_replica_t43], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-2-001/cores/collection1_shard1_replica_t43/data/]
   [junit4]   2> 289146 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=7.8662109375, floorSegmentMB=0.2275390625, forceMergeDeletesPctAllowed=21.88348059763291, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 289264 WARN  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 289648 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 289648 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 289649 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 289649 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 289650 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=38, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6670582967866131]
   [junit4]   2> 289684 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.SolrIndexSearcher Opening [Searcher@596f7a34[collection1_shard1_replica_t43] main]
   [junit4]   2> 289699 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 289700 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 289700 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 289700 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583290929276518400
   [junit4]   2> 289883 INFO  (searcherExecutor-294-thread-1-processing-n:127.0.0.1:40217_j%2Fn x:collection1_shard1_replica_t43 s:shard1 c:collection1) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [collection1_shard1_replica_t43] Registered new searcher Searcher@596f7a34[collection1_shard1_replica_t43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 289920 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 289920 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 289920 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:40217/j/n/collection1_shard1_replica_t43/
   [junit4]   2> 289920 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 289920 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy http://127.0.0.1:40217/j/n/collection1_shard1_replica_t43/ has no replicas
   [junit4]   2> 289920 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 289920 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ZkController collection1_shard1_replica_t43 stopping background replication from leader
   [junit4]   2> 289922 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:40217/j/n/collection1_shard1_replica_t43/ shard1
   [junit4]   2> 289939 INFO  (zkCallback-95-thread-1-processing-n:127.0.0.1:40610_j%2Fn) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 289963 INFO  (zkCallback-101-thread-1-processing-n:127.0.0.1:40217_j%2Fn) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 289976 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 290001 INFO  (qtp260274602-605) [n:127.0.0.1:40217_j%2Fn c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=3299
   [junit4]   2> 290106 INFO  (qtp260274602-607) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:40217_j%252Fn&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=3694
   [junit4]   2> 290123 INFO  (zkCallback-95-thread-1-processing-n:127.0.0.1:40610_j%2Fn) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 290129 INFO  (zkCallback-101-thread-1-processing-n:127.0.0.1:40217_j%2Fn) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 290497 INFO  (OverseerCollectionConfigSetProcessor-98955681562689540-127.0.0.1:40999_j%2Fn-n_0000000000) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 291353 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-3-001 of type TLOG
   [junit4]   2> 291354 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 291501 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@399184bb{/j/n,null,AVAILABLE}
   [junit4]   2> 291534 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@3a749460{HTTP/1.1,[http/1.1]}{127.0.0.1:39030}
   [junit4]   2> 291534 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.e.j.s.Server Started @310026ms
   [junit4]   2> 291534 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/tempDir-001/jetty3, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/j/n, hostPort=39030, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-3-001/cores}
   [junit4]   2> 291535 ERROR (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 291535 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 291535 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 291535 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 291536 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-06T04:51:36.485Z
   [junit4]   2> 291828 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 291828 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-3-001/solr.xml
   [junit4]   2> 291917 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 291917 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 291919 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 292047 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34914/solr
   [junit4]   2> 292340 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 292358 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 292359 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39030_j%2Fn
   [junit4]   2> 292376 INFO  (zkCallback-82-thread-1-processing-n:127.0.0.1:40999_j%2Fn) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 292466 INFO  (zkCallback-90-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 292486 INFO  (zkCallback-107-thread-1-processing-n:127.0.0.1:39030_j%2Fn) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 292450 INFO  (zkCallback-95-thread-1-processing-n:127.0.0.1:40610_j%2Fn) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 292450 INFO  (zkCallback-101-thread-1-processing-n:127.0.0.1:40217_j%2Fn) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 293038 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 293090 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 293110 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 293111 INFO  (TEST-ShardSplitTest.testSplitShardWithRule-seed#[2D27D509B36ECE00]) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-3-001/cores
   [junit4]   2> 293602 INFO  (qtp1728082934-636) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:39030_j%252Fn&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 293712 INFO  (OverseerThreadFactory-269-thread-5-processing-n:127.0.0.1:40999_j%2Fn) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:39030_j%2Fn for creating new replica
   [junit4]   2> 293717 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 293717 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 293735 INFO  (zkCallback-101-thread-1-processing-n:127.0.0.1:40217_j%2Fn) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 293735 INFO  (zkCallback-95-thread-1-processing-n:127.0.0.1:40610_j%2Fn) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 293735 INFO  (zkCallback-107-thread-1-processing-n:127.0.0.1:39030_j%2Fn) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 294848 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 294937 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema [collection1_shard2_replica_t45] Schema name=test
   [junit4]   2> 295576 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 295738 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t45' using configuration from collection collection1, trusted=true
   [junit4]   2> 295739 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t45' (registry 'solr.core.collection1.shard2.replica_t45') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e72149
   [junit4]   2> 295739 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 295739 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [[collection1_shard2_replica_t45] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-3-001/cores/collection1_shard2_replica_t45], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_2D27D509B36ECE00-001/shard-3-001/cores/collection1_shard2_replica_t45/data/]
   [junit4]   2> 295796 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=7.8662109375, floorSegmentMB=0.2275390625, forceMergeDeletesPctAllowed=21.88348059763291, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 295852 WARN  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 296201 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 296201 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 296275 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 296275 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 296276 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=38, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6670582967866131]
   [junit4]   2> 296326 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.SolrIndexSearcher Opening [Searcher@4089d148[collection1_shard2_replica_t45] main]
   [junit4]   2> 296328 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 296328 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 296329 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 296347 INFO  (searcherExecutor-305-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [collection1_shard2_replica_t45] Registered new searcher Searcher@4089d148[collection1_shard2_replica_t45] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 296347 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583290936246403072
   [junit4]   2> 296366 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.ZkController Core needs to recover:collection1_shard2_replica_t45
   [junit4]   2> 296367 INFO  (qtp1728082934-634) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=2649
   [junit4]   2> 296384 INFO  (updateExecutor-104-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 296420 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
   [junit4]   2> 296440 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
   [junit4]   2> 296440 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.ZkController collection1_shard2_replica_t45 stopping background replication from leader
   [junit4]   2> 296440 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard2_replica_t45]
   [junit4]   2> 296440 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
   [junit4]   2> 296440 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard2_replica_t45] as recovering, leader is [http://127.0.0.1:40610/j/n/collection1_shard2_replica_t41/] and I am [http://127.0.0.1:39030/j/n/collection1_shard2_replica_t45/]
   [junit4]   2> 296459 INFO  (zkCallback-101-thread-1-processing-n:127.0.0.1:40217_j%2Fn) [n:127.0.0.1:40217_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 296459 INFO  (zkCallback-107-thread-1-processing-n:127.0.0.1:39030_j%2Fn) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 296459 INFO  (zkCallback-95-thread-1-processing-n:127.0.0.1:40610_j%2Fn) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 296474 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:40610/j/n]; [WaitForState: action=PREPRECOVERY&core=collection1_shard2_replica_t41&nodeName=127.0.0.1:39030_j%252Fn&coreNodeName=core_node46&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
   [junit4]   2> 296475 INFO  (qtp397310241-580) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
   [junit4]   2> 296476 INFO  (qtp397310241-580) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_t41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:39030_j%2Fn, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_t45","base_url":"http://127.0.0.1:39030/j/n","node_name":"127.0.0.1:39030_j%2Fn","state":"recovering","type":"TLOG"}
   [junit4]   2> 296476 INFO  (qtp397310241-580) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true for: 0 seconds.
   [junit4]   2> 296476 INFO  (qtp397310241-580) [n:127.0.0.1:40610_j%2Fn    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:39030_j%252Fn&onlyIfLeaderActive=true&core=collection1_shard2_replica_t41&coreNodeName=core_node46&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 296494 INFO  (qtp1728082934-636) [n:127.0.0.1:39030_j%2Fn    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:39030_j%252Fn&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=2892
   [junit4]   2> 296496 INFO  (OverseerCollectionConfigSetProcessor-98955681562689540-127.0.0.1:40999_j%2Fn-n_0000000000) [n:127.0.0.1:40999_j%2Fn    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000008 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 297022 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Starting Replication Recovery.
   [junit4]   2> 297022 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Attempting to replicate from [http://127.0.0.1:40610/j/n/collection1_shard2_replica_t41/].
   [junit4]   2> 297169 INFO  (qtp397310241-581) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_t41] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1583290937108332544,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 297170 INFO  (qtp397310241-581) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_t41] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 297172 INFO  (qtp397310241-581) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_t41] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 297172 INFO  (qtp397310241-581) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_t41] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_t41]  webapp=/j/n path=/update params={waitSearcher=true&openSearcher=false&commit=true&softCommit=false&commit_end_point=true&wt=javabin&version=2}{commit=} 0 147
   [junit4]   2> 297338 INFO  (qtp397310241-575) [n:127.0.0.1:40610_j%2Fn c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_t41] o.a.s.c.S.Request [collection1_shard2_replica_t41]  webapp=/j/n path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 297351 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 297351 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 297351 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.h.IndexFetcher Slave's generation: 1
   [junit4]   2> 297351 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.h.IndexFetcher Slave's version: 0
   [junit4]   2> 297352 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
   [junit4]   2> 297409 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 297409 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@3bc3422f commitCommandVersion:0
   [junit4]   2> 297608 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.s.SolrIndexSearcher Opening [Searcher@5b4e375f[collection1_shard2_replica_t45] main]
   [junit4]   2> 297609 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 297611 INFO  (searcherExecutor-305-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [collection1_shard2_replica_t45] Registered new searcher Searcher@5b4e375f[collection1_shard2_replica_t45] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 297627 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Replication Recovery was successful.
   [junit4]   2> 297627 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Registering as Active after recovery.
   [junit4]   2> 297681 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.ZkController collection1_shard2_replica_t45 starting background replication from leader
   [junit4]   2> 297681 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
   [junit4]   2> 297705 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
   [junit4]   2> 297705 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:39030_j%2Fn x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:39030_j%2Fn c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 297706 INFO  (recoveryExecutor-105-thread-1-processing-n:127.0.0.1:

[...truncated too long message...]

ava
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/PHPSerializedResponseWriter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/PythonResponseWriter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/QueryResponseWriter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/QueryResponseWriterUtil.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/RawResponseWriter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/ResultContext.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/RetrieveFieldsOptimizer.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/RubyResponseWriter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/SchemaXmlResponseWriter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/SchemaXmlWriter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/SmileResponseWriter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/SolrQueryResponse.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/TextResponseWriter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/WriteableValue.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/XMLResponseWriter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/XMLWriter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/XSLTResponseWriter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/package-info.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/BaseEditorialTransformer.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/ChildDocTransformerFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/DocIdAugmenterFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/DocTransformer.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/DocTransformers.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/ElevatedMarkerFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/ExcludedMarkerFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/ExplainAugmenterFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/GeoTransformerFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/RawValueTransformerFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/RenameFieldTransformer.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/ScoreAugmenter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/ShardAugmenterFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/SubQueryAugmenterFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/TransformerFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/ValueAugmenterFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/ValueSourceAugmenter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/WriteableGeoJSON.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/response/transform/package-info.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/BaseSolrResource.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/DELETEable.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/GETable.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/ManagedResource.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/ManagedResourceObserver.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/ManagedResourceStorage.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/POSTable.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/PUTable.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/RestManager.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/SolrSchemaRestApi.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/package-info.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/schema/FieldTypeXmlAdapter.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/schema/analysis/BaseManagedTokenFilterFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/schema/analysis/ManagedStopFilterFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/schema/analysis/ManagedSynonymFilterFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/schema/analysis/ManagedSynonymGraphFilterFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/schema/analysis/ManagedWordSetResource.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/schema/analysis/package-info.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/rest/schema/package-info.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/schema/AbstractEnumField.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/schema/AbstractSpatialFieldType.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/schema/AbstractSpatialPrefixTreeFieldType.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/schema/AbstractSubTypeFieldType.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/schema/BBoxField.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/schema/BinaryField.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/schema/BoolField.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/schema/ClassicIndexSchemaFactory.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/schema/CollationField.java
      [rat]   AL    /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/java/org/apache/solr/schema/CoordinateFieldType.java

[JENKINS] Lucene-Solr-Tests-7.x - Build # 225 - Still Unstable

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/225/

16 tests failed.
FAILED:  org.apache.solr.cloud.AliasIntegrationTest.test

Error Message:
Collection not found: testalias2

Stack Trace:
org.apache.solr.common.SolrException: Collection not found: testalias2
	at __randomizedtesting.SeedInfo.seed([FBF6B42A284BB356:73A28BF086B7DEAE]:0)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:842)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
	at org.apache.solr.cloud.AliasIntegrationTest.searchSeveralWays(AliasIntegrationTest.java:134)
	at org.apache.solr.cloud.AliasIntegrationTest.searchSeveralWays(AliasIntegrationTest.java:128)
	at org.apache.solr.cloud.AliasIntegrationTest.test(AliasIntegrationTest.java:93)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.AssignBackwardCompatibilityTest.test

Error Message:
No value present

Stack Trace:
java.util.NoSuchElementException: No value present
	at __randomizedtesting.SeedInfo.seed([FBF6B42A284BB356:73A28BF086B7DEAE]:0)
	at java.util.Optional.get(Optional.java:135)
	at org.apache.solr.cloud.AssignBackwardCompatibilityTest.test(AssignBackwardCompatibilityTest.java:96)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.ShardSplitTest.testSplitAfterFailedSplit

Error Message:
expected:<1> but was:<2>

Stack Trace:
java.lang.AssertionError: expected:<1> but was:<2>
	at __randomizedtesting.SeedInfo.seed([FBF6B42A284BB356:2BB2785143EFEDC]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.cloud.ShardSplitTest.testSplitAfterFailedSplit(ShardSplitTest.java:279)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.SyncSliceTest.test

Error Message:
Could not load collection from ZK: collection1

Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: collection1
	at __randomizedtesting.SeedInfo.seed([FBF6B42A284BB356:73A28BF086B7DEAE]:0)
	at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1172)
	at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:692)
	at org.apache.solr.common.cloud.ZkStateReader.forceUpdateCollection(ZkStateReader.java:365)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.updateMappingsFromZk(AbstractFullDistribZkTestBase.java:674)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1311)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1302)
	at org.apache.solr.cloud.SyncSliceTest.test(SyncSliceTest.java:209)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
	at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:332)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:332)
	at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1184)
	at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
	... 47 more


FAILED:  org.apache.solr.cloud.TestSSLRandomization.testRandomizedSslAndClientAuth

Error Message:
Error from server at http://127.0.0.1:43343/solr: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000002

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:43343/solr: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000002
	at __randomizedtesting.SeedInfo.seed([FBF6B42A284BB356:70A2054D8AD4F22A]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1096)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:200)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.checkCreateCollection(TestMiniSolrCloudClusterSSL.java:200)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.checkClusterWithCollectionCreations(TestMiniSolrCloudClusterSSL.java:188)
	at org.apache.solr.cloud.TestSSLRandomization.testRandomizedSslAndClientAuth(TestSSLRandomization.java:50)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testCreateDelete {seed=[FBF6B42A284BB356:E0E64566DEBB4B66]}

Error Message:


Stack Trace:
java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([FBF6B42A284BB356:E0E64566DEBB4B66]:0)
	at org.apache.solr.cloud.TestTlogReplica.testCreateDelete(TestTlogReplica.java:200)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates

Error Message:


Stack Trace:
java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([FBF6B42A284BB356:7D374CC7771A65B6]:0)
	at org.apache.solr.cloud.TestTlogReplica.getSolrCore(TestTlogReplica.java:866)
	at org.apache.solr.cloud.TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates(TestTlogReplica.java:661)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testOnlyLeaderIndexes

Error Message:


Stack Trace:
java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([FBF6B42A284BB356:E7F7C9A75DEECDC5]:0)
	at org.apache.solr.cloud.TestTlogReplica.getSolrCore(TestTlogReplica.java:866)
	at org.apache.solr.cloud.TestTlogReplica.testOnlyLeaderIndexes(TestTlogReplica.java:466)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testRecovery

Error Message:


Stack Trace:
java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([FBF6B42A284BB356:3A06CD86051B79F1]:0)
	at org.apache.solr.cloud.TestTlogReplica.getSolrRunner(TestTlogReplica.java:901)
	at org.apache.solr.cloud.TestTlogReplica.testRecovery(TestTlogReplica.java:533)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testKillTlogReplica

Error Message:
Replica not removed null Live Nodes: [127.0.0.1:57381_solr] Last available state: DocCollection(tlog_replica_test_kill_tlog_replica//collections/tlog_replica_test_kill_tlog_replica/state.json/7)={   "pullReplicas":"0",   "replicationFactor":"0",   "shards":{"shard1":{       "range":"80000000-7fffffff",       "state":"active",       "replicas":{         "core_node3":{           "core":"tlog_replica_test_kill_tlog_replica_shard1_replica_t1",           "base_url":"http://127.0.0.1:34291/solr",           "node_name":"127.0.0.1:34291_solr",           "state":"down",           "type":"TLOG"},         "core_node4":{           "core":"tlog_replica_test_kill_tlog_replica_shard1_replica_t2",           "base_url":"http://127.0.0.1:34291/solr",           "node_name":"127.0.0.1:34291_solr",           "state":"down",           "type":"TLOG",           "leader":"true"}}}},   "router":{"name":"compositeId"},   "maxShardsPerNode":"100",   "autoAddReplicas":"false",   "nrtReplicas":"0",   "tlogReplicas":"2"}

Stack Trace:
java.lang.AssertionError: Replica not removed
null
Live Nodes: [127.0.0.1:57381_solr]
Last available state: DocCollection(tlog_replica_test_kill_tlog_replica//collections/tlog_replica_test_kill_tlog_replica/state.json/7)={
  "pullReplicas":"0",
  "replicationFactor":"0",
  "shards":{"shard1":{
      "range":"80000000-7fffffff",
      "state":"active",
      "replicas":{
        "core_node3":{
          "core":"tlog_replica_test_kill_tlog_replica_shard1_replica_t1",
          "base_url":"http://127.0.0.1:34291/solr",
          "node_name":"127.0.0.1:34291_solr",
          "state":"down",
          "type":"TLOG"},
        "core_node4":{
          "core":"tlog_replica_test_kill_tlog_replica_shard1_replica_t2",
          "base_url":"http://127.0.0.1:34291/solr",
          "node_name":"127.0.0.1:34291_solr",
          "state":"down",
          "type":"TLOG",
          "leader":"true"}}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"100",
  "autoAddReplicas":"false",
  "nrtReplicas":"0",
  "tlogReplicas":"2"}
	at __randomizedtesting.SeedInfo.seed([FBF6B42A284BB356:24C470EFD9E83C5B]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:269)
	at org.apache.solr.cloud.TestTlogReplica.testKillTlogReplica(TestTlogReplica.java:441)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.TestTlogReplica.testBasicLeaderElection

Error Message:


Stack Trace:
java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([FBF6B42A284BB356:6D7E7262C0D1F4AC]:0)
	at org.apache.solr.cloud.TestTlogReplica.getSolrRunner(TestTlogReplica.java:901)
	at org.apache.solr.cloud.TestTlogReplica.testBasicLeaderElection(TestTlogReplica.java:644)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.autoscaling.AutoScalingHandlerTest.testReadApi

Error Message:
expected:<1> but was:<0>

Stack Trace:
java.lang.AssertionError: expected:<1> but was:<0>
	at __randomizedtesting.SeedInfo.seed([FBF6B42A284BB356:ACDF4F9FF3B9514D]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.cloud.autoscaling.AutoScalingHandlerTest.testReadApi(AutoScalingHandlerTest.java:711)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.core.TestLazyCores.testCreateTransientFromAdmin

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
	at __randomizedtesting.SeedInfo.seed([FBF6B42A284BB356]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestLazyCores

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
	at __randomizedtesting.SeedInfo.seed([FBF6B42A284BB356]:0)


FAILED:  org.apache.solr.handler.TestReplicationHandler.testEmptyCommits

Error Message:
expected:<1509899658238> but was:<1509899657967>

Stack Trace:
java.lang.AssertionError: expected:<1509899658238> but was:<1509899657967>
	at __randomizedtesting.SeedInfo.seed([FBF6B42A284BB356:DC962C9D6360B723]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:147)
	at org.apache.solr.handler.TestReplicationHandler.assertVersions(TestReplicationHandler.java:1075)
	at org.apache.solr.handler.TestReplicationHandler.testEmptyCommits(TestReplicationHandler.java:413)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.update.processor.TestNamedUpdateProcessors.test

Error Message:
{   "responseHeader":{     "status":500,     "QTime":31781},   "errorMessages":["2 out of 5 the property overlay to be of version 0 within 30 seconds! Failed cores: [https://127.0.0.1:56723/rfwzr/eh/collection1_shard2_replica_n41/, https://127.0.0.1:44849/rfwzr/eh/collection1_shard1_replica_n43/]\n"],   "WARNING":"This response format is experimental.  It is likely to change in the future.",   "error":{     "metadata":[       "error-class","org.apache.solr.common.SolrException",       "root-error-class","org.apache.solr.common.SolrException"],     "msg":"2 out of 5 the property overlay to be of version 0 within 30 seconds! Failed cores: [https://127.0.0.1:56723/rfwzr/eh/collection1_shard2_replica_n41/, https://127.0.0.1:44849/rfwzr/eh/collection1_shard1_replica_n43/]",     "trace":"org.apache.solr.common.SolrException: 2 out of 5 the property overlay to be of version 0 within 30 seconds! Failed cores: [https://127.0.0.1:56723/rfwzr/eh/collection1_shard2_replica_n41/, https://127.0.0.1:44849/rfwzr/eh/collection1_shard1_replica_n43/]\n\tat org.apache.solr.handler.SolrConfigHandler.waitForAllReplicasState(SolrConfigHandler.java:772)\n\tat org.apache.solr.handler.SolrConfigHandler.access$400(SolrConfigHandler.java:102)\n\tat org.apache.solr.handler.SolrConfigHandler$Command.handleCommands(SolrConfigHandler.java:503)\n\tat org.apache.solr.handler.SolrConfigHandler$Command.handlePOST(SolrConfigHandler.java:346)\n\tat org.apache.solr.handler.SolrConfigHandler$Command.access$100(SolrConfigHandler.java:159)\n\tat org.apache.solr.handler.SolrConfigHandler.handleRequestBody(SolrConfigHandler.java:137)\n\tat org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)\n\tat org.apache.solr.core.SolrCore.execute(SolrCore.java:2484)\n\tat org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:710)\n\tat org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:516)\n\tat org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)\n\tat org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)\n\tat org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)\n\tat org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)\n\tat org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)\n\tat org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)\n\tat org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)\n\tat org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)\n\tat org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)\n\tat org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)\n\tat org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)\n\tat org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)\n\tat org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)\n\tat org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)\n\tat org.eclipse.jetty.server.Server.handle(Server.java:534)\n\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)\n\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)\n\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)\n\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)\n\tat org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)\n\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)\n\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)\n\tat org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)\n\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)\n\tat org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)\n\tat java.lang.Thread.run(Thread.java:748)\n",     "code":500}} 

Stack Trace:
java.lang.AssertionError: {
  "responseHeader":{
    "status":500,
    "QTime":31781},
  "errorMessages":["2 out of 5 the property overlay to be of version 0 within 30 seconds! Failed cores: [https://127.0.0.1:56723/rfwzr/eh/collection1_shard2_replica_n41/, https://127.0.0.1:44849/rfwzr/eh/collection1_shard1_replica_n43/]\n"],
  "WARNING":"This response format is experimental.  It is likely to change in the future.",
  "error":{
    "metadata":[
      "error-class","org.apache.solr.common.SolrException",
      "root-error-class","org.apache.solr.common.SolrException"],
    "msg":"2 out of 5 the property overlay to be of version 0 within 30 seconds! Failed cores: [https://127.0.0.1:56723/rfwzr/eh/collection1_shard2_replica_n41/, https://127.0.0.1:44849/rfwzr/eh/collection1_shard1_replica_n43/]",
    "trace":"org.apache.solr.common.SolrException: 2 out of 5 the property overlay to be of version 0 within 30 seconds! Failed cores: [https://127.0.0.1:56723/rfwzr/eh/collection1_shard2_replica_n41/, https://127.0.0.1:44849/rfwzr/eh/collection1_shard1_replica_n43/]\n\tat org.apache.solr.handler.SolrConfigHandler.waitForAllReplicasState(SolrConfigHandler.java:772)\n\tat org.apache.solr.handler.SolrConfigHandler.access$400(SolrConfigHandler.java:102)\n\tat org.apache.solr.handler.SolrConfigHandler$Command.handleCommands(SolrConfigHandler.java:503)\n\tat org.apache.solr.handler.SolrConfigHandler$Command.handlePOST(SolrConfigHandler.java:346)\n\tat org.apache.solr.handler.SolrConfigHandler$Command.access$100(SolrConfigHandler.java:159)\n\tat org.apache.solr.handler.SolrConfigHandler.handleRequestBody(SolrConfigHandler.java:137)\n\tat org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)\n\tat org.apache.solr.core.SolrCore.execute(SolrCore.java:2484)\n\tat org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:710)\n\tat org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:516)\n\tat org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)\n\tat org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)\n\tat org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)\n\tat org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)\n\tat org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)\n\tat org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)\n\tat org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)\n\tat org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)\n\tat org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)\n\tat org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)\n\tat org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)\n\tat org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)\n\tat org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)\n\tat org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)\n\tat org.eclipse.jetty.server.Server.handle(Server.java:534)\n\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)\n\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)\n\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)\n\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)\n\tat org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)\n\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)\n\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)\n\tat org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)\n\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)\n\tat org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)\n\tat java.lang.Thread.run(Thread.java:748)\n",
    "code":500}}

	at __randomizedtesting.SeedInfo.seed([FBF6B42A284BB356:73A28BF086B7DEAE]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNull(Assert.java:551)
	at org.apache.solr.core.TestSolrConfigHandler.runConfigCommand(TestSolrConfigHandler.java:185)
	at org.apache.solr.update.processor.TestNamedUpdateProcessors.test(TestNamedUpdateProcessors.java:85)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 11712 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.AutoScalingHandlerTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_FBF6B42A284BB356-001/init-core-data-001
   [junit4]   2> 704472 WARN  (SUITE-AutoScalingHandlerTest-seed#[FBF6B42A284BB356]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=10 numCloses=10
   [junit4]   2> 704472 INFO  (SUITE-AutoScalingHandlerTest-seed#[FBF6B42A284BB356]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 704515 INFO  (SUITE-AutoScalingHandlerTest-seed#[FBF6B42A284BB356]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 704515 INFO  (SUITE-AutoScalingHandlerTest-seed#[FBF6B42A284BB356]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 704516 INFO  (SUITE-AutoScalingHandlerTest-seed#[FBF6B42A284BB356]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_FBF6B42A284BB356-001/tempDir-001
   [junit4]   2> 704516 INFO  (SUITE-AutoScalingHandlerTest-seed#[FBF6B42A284BB356]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 704521 INFO  (Thread-230) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 704521 INFO  (Thread-230) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 704582 ERROR (Thread-230) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 704624 INFO  (SUITE-AutoScalingHandlerTest-seed#[FBF6B42A284BB356]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:59895
   [junit4]   2> 704781 INFO  (jetty-launcher-230-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 704806 INFO  (jetty-launcher-230-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 705021 INFO  (jetty-launcher-230-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7c5c5a21{/solr,null,AVAILABLE}
   [junit4]   2> 705040 INFO  (jetty-launcher-230-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@19cc2e5a{SSL,[ssl, http/1.1]}{127.0.0.1:๓๖๓๔๑}
   [junit4]   2> 705040 INFO  (jetty-launcher-230-thread-1) [    ] o.e.j.s.Server Started @๗๒๙๖๔๗ms
   [junit4]   2> 705040 INFO  (jetty-launcher-230-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36341}
   [junit4]   2> 705041 ERROR (jetty-launcher-230-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 705041 INFO  (jetty-launcher-230-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 705041 INFO  (jetty-launcher-230-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 705041 INFO  (jetty-launcher-230-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 705041 INFO  (jetty-launcher-230-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-05T15:51:53.026Z
   [junit4]   2> 705430 INFO  (jetty-launcher-230-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7f9b44c3{/solr,null,AVAILABLE}
   [junit4]   2> 705430 INFO  (jetty-launcher-230-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@35fc50b9{SSL,[ssl, http/1.1]}{127.0.0.1:๕๕๑๘๕}
   [junit4]   2> 705430 INFO  (jetty-launcher-230-thread-2) [    ] o.e.j.s.Server Started @๗๓๐๐๓๗ms
   [junit4]   2> 705430 INFO  (jetty-launcher-230-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=55185}
   [junit4]   2> 705431 ERROR (jetty-launcher-230-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 705431 INFO  (jetty-launcher-230-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 705431 INFO  (jetty-launcher-230-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 705431 INFO  (jetty-launcher-230-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 705431 INFO  (jetty-launcher-230-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-05T15:51:53.416Z
   [junit4]   2> 705563 INFO  (jetty-launcher-230-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 705590 INFO  (jetty-launcher-230-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59895/solr
   [junit4]   2> 705694 INFO  (jetty-launcher-230-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 705710 INFO  (jetty-launcher-230-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59895/solr
   [junit4]   2> 706229 INFO  (jetty-launcher-230-thread-2) [n:127.0.0.1:55185_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 706234 INFO  (jetty-launcher-230-thread-2) [n:127.0.0.1:55185_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:55185_solr
   [junit4]   2> 706269 INFO  (jetty-launcher-230-thread-2) [n:127.0.0.1:55185_solr    ] o.a.s.c.Overseer Overseer (id=98952617165258758-127.0.0.1:55185_solr-n_0000000000) starting
   [junit4]   2> 707650 INFO  (jetty-launcher-230-thread-1) [n:127.0.0.1:36341_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 707734 INFO  (jetty-launcher-230-thread-1) [n:127.0.0.1:36341_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36341_solr
   [junit4]   2> 707761 INFO  (zkCallback-243-thread-1-processing-n:127.0.0.1:55185_solr) [n:127.0.0.1:55185_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 707762 INFO  (zkCallback-238-thread-1-processing-n:127.0.0.1:36341_solr) [n:127.0.0.1:36341_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 707795 INFO  (jetty-launcher-230-thread-2) [n:127.0.0.1:55185_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55185_solr
   [junit4]   2> 707797 INFO  (zkCallback-243-thread-1-processing-n:127.0.0.1:55185_solr) [n:127.0.0.1:55185_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 707797 INFO  (zkCallback-238-thread-1-processing-n:127.0.0.1:36341_solr) [n:127.0.0.1:36341_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 713126 INFO  (jetty-launcher-230-thread-2) [n:127.0.0.1:55185_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_55185.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2af0870b
   [junit4]   2> 713138 INFO  (jetty-launcher-230-thread-1) [n:127.0.0.1:36341_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36341.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2af0870b
   [junit4]   2> 713199 INFO  (jetty-launcher-230-thread-2) [n:127.0.0.1:55185_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_55185.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2af0870b
   [junit4]   2> 713199 INFO  (jetty-launcher-230-thread-2) [n:127.0.0.1:55185_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_55185.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2af0870b
   [junit4]   2> 713206 INFO  (jetty-launcher-230-thread-1) [n:127.0.0.1:36341_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36341.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2af0870b
   [junit4]   2> 713251 INFO  (jetty-launcher-230-thread-1) [n:127.0.0.1:36341_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36341.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2af0870b
   [junit4]   2> 713252 INFO  (jetty-launcher-230-thread-1) [n:127.0.0.1:36341_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_FBF6B42A284BB356-001/tempDir-001/node1/.
   [junit4]   2> 713221 INFO  (jetty-launcher-230-thread-2) [n:127.0.0.1:55185_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_FBF6B42A284BB356-001/tempDir-001/node2/.
   [junit4]   2> 715266 INFO  (SUITE-AutoScalingHandlerTest-seed#[FBF6B42A284BB356]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 715267 INFO  (SUITE-AutoScalingHandlerTest-seed#[FBF6B42A284BB356]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:59895/solr ready
   [junit4]   2> 715315 INFO  (TEST-AutoScalingHandlerTest.testSuspendTrigger-seed#[FBF6B42A284BB356]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testSuspendTrigger
   [junit4]   2> 715865 INFO  (qtp2118200843-1230) [n:127.0.0.1:55185_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=46
   [junit4]   2> 715917 INFO  (qtp2118200843-1231) [n:127.0.0.1:55185_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=19
   [junit4]   2> 716718 INFO  (qtp2118200843-1231) [n:127.0.0.1:55185_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 716719 INFO  (qtp2118200843-1231) [n:127.0.0.1:55185_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:59895/solr ready
   [junit4]   2> 716974 INFO  (qtp2118200843-1227) [n:127.0.0.1:55185_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=16
   [junit4]   2> 717731 INFO  (qtp1750460693-1214) [n:127.0.0.1:36341_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
   [junit4]   2> 717888 INFO  (qtp2118200843-1231) [n:127.0.0.1:55185_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=1929
   [junit4]   2> 718350 INFO  (qtp2118200843-1231) [n:127.0.0.1:55185_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 718358 INFO  (qtp2118200843-1231) [n:127.0.0.1:55185_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:59895/solr ready
   [junit4]   2> 718369 INFO  (qtp2118200843-1225) [n:127.0.0.1:55185_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
   [junit4]   2> 718394 INFO  (qtp1750460693-1217) [n:127.0.0.1:36341_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
   [junit4]   2> 718442 INFO  (qtp2118200843-1231) [n:127.0.0.1:55185_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=551
   [junit4]   2> 718757 INFO  (qtp2118200843-1232) [n:127.0.0.1:55185_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 718758 INFO  (qtp2118200843-1232) [n:127.0.0.1:55185_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:59895/solr ready
   [junit4]   2> 718760 INFO  (qtp2118200843-1225) [n:127.0.0.1:55185_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
   [junit4]   2> 719058 INFO  (qtp1750460693-1219) [n:127.0.0.1:36341_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
   [junit4]   2> 719163 INFO  (qtp2118200843-1232) [n:127.0.0.1:55185_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=715
   [junit4]   2> 719314 INFO  (qtp2118200843-1229) [n:127.0.0.1:55185_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 719315 INFO  (qtp2118200843-1229) [n:127.0.0.1:55185_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:59895/solr ready
   [junit4]   2> 719395 INFO  (qtp2118200843-1225) [n:127.0.0.1:55185_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
   [junit4]   2> 719398 INFO  (qtp1750460693-1219) [n:127.0.0.1:36341_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
   [junit4]   2> 719406 INFO  (qtp2118200843-1229) [n:127.0.0.1:55185_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=223
   [junit4]   2> 719573 INFO  (qtp2118200843-1227) [n:127.0.0.1:55185_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 719713 INFO  (qtp2118200843-1227) [n:127.0.0.1:55185_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:59895/solr ready
   [junit4]   2> 719722 INFO  (qtp2118200843-1225) [n:127.0.0.1:55185_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
   [junit4]   2> 719723 INFO  (qtp1750460693-1219) [n:127.0.0.1:36341_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
   [junit4]   2> 719793 INFO  (qtp2118200843-1227) [n:127.0.0.1:55185_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=386
   [junit4]   2> 719997 INFO  (qtp2118200843-1231) [n:127.0.0.1:55185_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 719998 INFO  (qtp2118200843-1231) [n:12

[...truncated too long message...]

Reporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@769693af: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@1c406d27
   [junit4]   2> 14502646 WARN  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[FBF6B42A284BB356]) [    x:collection3] o.a.s.m.SolrMetricManager Interrupted while trying to obtain lock to modify reporters registry: solr.jetty
   [junit4]   2> 14502646 INFO  (coreCloseExecutor-6195-thread-1-processing-x:collection3) [    x:collection5] o.a.s.c.SolrCore [collection5]  CLOSING SolrCore org.apache.solr.core.SolrCore@1659c8e0
   [junit4]   2> 14502646 INFO  (coreCloseExecutor-6195-thread-1-processing-x:collection3) [    x:collection5] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection5, tag=374982880
   [junit4]   2> 14502646 INFO  (coreCloseExecutor-6195-thread-1-processing-x:collection3) [    x:collection5] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6258ae02: rootName = null, domain = solr.core.collection5, service url = null, agent id = null] for registry solr.core.collection5 / com.codahale.metrics.MetricRegistry@2e3927ad
   [junit4]   2> 14502649 INFO  (coreCloseExecutor-6195-thread-2-processing-x:collection3) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@73062a4d
   [junit4]   2> 14502661 INFO  (coreCloseExecutor-6195-thread-3-processing-x:collection3) [    x:collection2] o.a.s.c.SolrCore [collection2]  CLOSING SolrCore org.apache.solr.core.SolrCore@48713f55
   [junit4]   2> 14502685 INFO  (coreCloseExecutor-6195-thread-2-processing-x:collection3) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=1929783885
   [junit4]   2> 14502685 INFO  (coreCloseExecutor-6195-thread-2-processing-x:collection3) [    x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@361049fa: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@5b56403b
   [junit4]   2> 14502693 INFO  (coreCloseExecutor-6195-thread-3-processing-x:collection3) [    x:collection2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection2, tag=1215381333
   [junit4]   2> 14502693 INFO  (coreCloseExecutor-6195-thread-3-processing-x:collection3) [    x:collection2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3839093f: rootName = null, domain = solr.core.collection2, service url = null, agent id = null] for registry solr.core.collection2 / com.codahale.metrics.MetricRegistry@5a9c9b8b
   [junit4]   2> 14502809 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[FBF6B42A284BB356]) [    x:collection3] o.a.s.SolrTestCaseJ4 ###Ending testCreateTransientFromAdmin
   [junit4]   2> 14502809 INFO  (SUITE-TestLazyCores-seed#[FBF6B42A284BB356]-worker) [    x:collection3] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 14502809 INFO  (SUITE-TestLazyCores-seed#[FBF6B42A284BB356]-worker) [    x:collection3] o.a.s.c.CoreContainer Shutting down CoreContainer instance=381386170
   [junit4]   2> 14502809 INFO  (SUITE-TestLazyCores-seed#[FBF6B42A284BB356]-worker) [    x:collection3] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 14502809 INFO  (SUITE-TestLazyCores-seed#[FBF6B42A284BB356]-worker) [    x:collection3] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1d030405: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@3ac75016
   [junit4]   2> 14502813 INFO  (SUITE-TestLazyCores-seed#[FBF6B42A284BB356]-worker) [    x:collection3] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 14502813 INFO  (SUITE-TestLazyCores-seed#[FBF6B42A284BB356]-worker) [    x:collection3] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 14502813 INFO  (SUITE-TestLazyCores-seed#[FBF6B42A284BB356]-worker) [    x:collection3] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@506de4b9: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@2591fd59
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FBF6B42A284BB356-001
   [junit4]   2> Nov 05, 2017 7:41:53 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> SEVERE: There are still zombie threads that couldn't be terminated:
   [junit4]   2>    1) Thread[id=15231, name=searcherExecutor-6141-thread-1, state=WAITING, group=TGRP-TestLazyCores]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70), sim=RandomSimilarity(queryNorm=false): {}, locale=hi, timezone=Atlantic/Faroe
   [junit4]   2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=2,free=186761480,total=531628032
   [junit4]   2> NOTE: All tests run in this JVM: [TestTrackingShardHandlerFactory, RegexBytesRefFilterTest, TestBlendedInfixSuggestions, BooleanFieldTest, UpdateParamsTest, DistributedFacetPivotWhiteBoxTest, TestPostingsSolrHighlighter, TestDelegationWithHadoopAuth, ManagedSchemaRoundRobinCloudTest, ParsingFieldUpdateProcessorsTest, SolrGraphiteReporterTest, TestLuceneIndexBackCompat, MoveReplicaTest, AutoScalingHandlerTest, NodeLostTriggerTest, ConjunctionSolrSpellCheckerTest, DateMathParserTest, ResourceLoaderTest, CloneFieldUpdateProcessorFactoryTest, TestScoreJoinQPScore, BufferStoreTest, TestAddFieldRealTimeGet, IndexSchemaRuntimeFieldTest, TestDynamicLoading, QueryParsingTest, MissingSegmentRecoveryTest, TestBinaryResponseWriter, TestSuggestSpellingConverter, TestLeaderElectionWithEmptyReplica, TestSolr4Spatial2, TestSolrCLIRunExample, TestPhraseSuggestions, RAMDirectoryFactoryTest, FastVectorHighlighterTest, TestLocalFSCloudBackupRestore, BasicZkTest, TestConfigReload, HdfsRecoveryZkTest, DirectUpdateHandlerOptimizeTest, TestRandomDVFaceting, TestXmlQParser, TestOverriddenPrefixQueryForCustomFieldType, AssignBackwardCompatibilityTest, TestDistributedSearch, SliceStateTest, TestInitQParser, TestSweetSpotSimilarityFactory, TestRetrieveFieldsOptimizer, SearchHandlerTest, TestStressCloudBlindAtomicUpdates, TestConfigsApi, TestReplicationHandler, BasicAuthStandaloneTest, TestInPlaceUpdatesStandalone, TestIBSimilarityFactory, TestFieldTypeCollectionResource, TestShardHandlerFactory, DistributedQueryElevationComponentTest, SimpleMLTQParserTest, TestUtils, TestComponentsName, TestExactStatsCache, ZkFailoverTest, TestManagedResource, TestSolrDeletionPolicy1, SpellCheckCollatorTest, FileUtilsTest, TestSolrXml, UUIDUpdateProcessorFallbackTest, TestHighlightDedupGrouping, TestSort, TestRequestStatusCollectionAPI, TestConfigOverlay, PeerSyncTest, NoCacheHeaderTest, AnalysisAfterCoreReloadTest, DistributedMLTComponentTest, DistributedSuggestComponentTest, BitVectorTest, HdfsBasicDistributedZkTest, DistributedFacetPivotLongTailTest, TestPolicyCloud, TestPullReplicaErrorHandling, BlockJoinFacetRandomTest, ZkStateReaderTest, DistribCursorPagingTest, StatelessScriptUpdateProcessorFactoryTest, TestQueryUtils, SolrInfoBeanTest, TermsComponentTest, TestReqParamsAPI, TestUseDocValuesAsStored, TestFieldCacheWithThreads, SimpleFacetsTest, TestExceedMaxTermLength, MultiTermTest, TestSQLHandlerNonCloud, PeerSyncWithIndexFingerprintCachingTest, TestPKIAuthenticationPlugin, LeaderElectionIntegrationTest, JsonLoaderTest, SpatialRPTFieldTypeTest, MergeStrategyTest, TestStandardQParsers, TestReversedWildcardFilterFactory, TestDFRSimilarityFactory, HdfsThreadLeakTest, SolrSlf4jReporterTest, DateRangeFieldTest, DateFieldTest, TestCSVLoader, HdfsAutoAddReplicasIntegrationTest, TestDefaultStatsCache, TestCloudNestedDocsSort, TestDocTermOrds, DeleteInactiveReplicaTest, CollectionStateFormat2Test, StatsReloadRaceTest, TestCodecSupport, SoftAutoCommitTest, SyncSliceTest, TestPointFields, LeaderElectionTest, ZkSolrClientTest, ShardRoutingCustomTest, TestRecovery, TestJoin, SpellCheckComponentTest, ConvertedLegacyTest, TestFunctionQuery, BasicFunctionalityTest, TestLazyCores]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestLazyCores -Dtests.seed=FBF6B42A284BB356 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=hi -Dtests.timezone=Atlantic/Faroe -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J0 | TestLazyCores (suite) <<<
   [junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([FBF6B42A284BB356]:0)
   [junit4] Completed [747/747 (10!)] on J0 in 7223.27s, 6 tests, 2 errors <<< FAILURES!

[...truncated 47234 lines...]

[JENKINS] Lucene-Solr-Tests-7.x - Build # 224 - Still unstable

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/224/

2 tests failed.
FAILED:  org.apache.solr.cloud.CdcrVersionReplicationTest.testCdcrDocVersions

Error Message:
Could not load collection from ZK: source_collection

Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: source_collection
	at __randomizedtesting.SeedInfo.seed([AF3A5DBD319994D0:57AC561FC3FF7BCC]:0)
	at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1172)
	at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:692)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.getDocCollection(CloudSolrClient.java:1198)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:840)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:957)
	at org.apache.solr.cloud.CdcrVersionReplicationTest.doQuery(CdcrVersionReplicationTest.java:270)
	at org.apache.solr.cloud.CdcrVersionReplicationTest.doTestCdcrDocVersions(CdcrVersionReplicationTest.java:170)
	at org.apache.solr.cloud.CdcrVersionReplicationTest.testCdcrDocVersions(CdcrVersionReplicationTest.java:74)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/source_collection/state.json
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
	at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:332)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:332)
	at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1184)
	at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
	... 51 more


FAILED:  org.apache.solr.cloud.TestTolerantUpdateProcessorCloud.testVariousAddsViaShard1LeaderClient

Error Message:
Could not load collection from ZK: test_col

Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: test_col
	at __randomizedtesting.SeedInfo.seed([AF3A5DBD319994D0:1C4F649E3C8718DB]:0)
	at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1172)
	at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:692)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.getDocCollection(CloudSolrClient.java:1198)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:840)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:957)
	at org.apache.solr.cloud.TestTolerantUpdateProcessorCloud.assertQueryDocIds(TestTolerantUpdateProcessorCloud.java:1015)
	at org.apache.solr.cloud.TestTolerantUpdateProcessorCloud.testVariousAdds(TestTolerantUpdateProcessorCloud.java:682)
	at org.apache.solr.cloud.TestTolerantUpdateProcessorCloud.testVariousAddsViaShard1LeaderClient(TestTolerantUpdateProcessorCloud.java:394)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/test_col/state.json
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
	at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:332)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:332)
	at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1184)
	at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
	... 49 more




Build Log:
[...truncated 11949 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestTolerantUpdateProcessorCloud
   [junit4]   2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorCloud_AF3A5DBD319994D0-001/init-core-data-001
   [junit4]   2> 784799 WARN  (SUITE-TestTolerantUpdateProcessorCloud-seed#[AF3A5DBD319994D0]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=6 numCloses=6
   [junit4]   2> 784799 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[AF3A5DBD319994D0]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 784800 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[AF3A5DBD319994D0]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 784800 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[AF3A5DBD319994D0]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 784801 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[AF3A5DBD319994D0]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 5 servers in /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorCloud_AF3A5DBD319994D0-001/tempDir-001
   [junit4]   2> 784801 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[AF3A5DBD319994D0]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 784831 INFO  (Thread-2389) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 784831 INFO  (Thread-2389) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 784847 ERROR (Thread-2389) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 784924 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[AF3A5DBD319994D0]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:38281
   [junit4]   2> 785031 INFO  (jetty-launcher-302-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 785032 INFO  (jetty-launcher-302-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 785051 INFO  (jetty-launcher-302-thread-3) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 785052 INFO  (jetty-launcher-302-thread-4) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 785092 INFO  (jetty-launcher-302-thread-5) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 785124 INFO  (jetty-launcher-302-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1a59b177{/solr,null,AVAILABLE}
   [junit4]   2> 785127 INFO  (jetty-launcher-302-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@8284757{HTTP/1.1,[http/1.1]}{127.0.0.1:37586}
   [junit4]   2> 785127 INFO  (jetty-launcher-302-thread-1) [    ] o.e.j.s.Server Started @803266ms
   [junit4]   2> 785127 INFO  (jetty-launcher-302-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37586}
   [junit4]   2> 785127 ERROR (jetty-launcher-302-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 785127 INFO  (jetty-launcher-302-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 785127 INFO  (jetty-launcher-302-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 785127 INFO  (jetty-launcher-302-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 785127 INFO  (jetty-launcher-302-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-05T01:20:31.902Z
   [junit4]   2> 785181 INFO  (jetty-launcher-302-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@39ac543f{/solr,null,AVAILABLE}
   [junit4]   2> 785182 INFO  (jetty-launcher-302-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@147a7b9f{HTTP/1.1,[http/1.1]}{127.0.0.1:41112}
   [junit4]   2> 785182 INFO  (jetty-launcher-302-thread-4) [    ] o.e.j.s.Server Started @803320ms
   [junit4]   2> 785182 INFO  (jetty-launcher-302-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41112}
   [junit4]   2> 785182 ERROR (jetty-launcher-302-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 785182 INFO  (jetty-launcher-302-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 785182 INFO  (jetty-launcher-302-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 785182 INFO  (jetty-launcher-302-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 785182 INFO  (jetty-launcher-302-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-05T01:20:31.957Z
   [junit4]   2> 785270 INFO  (jetty-launcher-302-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7aae5b5e{/solr,null,AVAILABLE}
   [junit4]   2> 785271 INFO  (jetty-launcher-302-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@49c3a965{HTTP/1.1,[http/1.1]}{127.0.0.1:35491}
   [junit4]   2> 785271 INFO  (jetty-launcher-302-thread-3) [    ] o.e.j.s.Server Started @803409ms
   [junit4]   2> 785271 INFO  (jetty-launcher-302-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35491}
   [junit4]   2> 785271 ERROR (jetty-launcher-302-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 785271 INFO  (jetty-launcher-302-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 785271 INFO  (jetty-launcher-302-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 785271 INFO  (jetty-launcher-302-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 785271 INFO  (jetty-launcher-302-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-05T01:20:32.046Z
   [junit4]   2> 785380 INFO  (jetty-launcher-302-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2d9e5205{/solr,null,AVAILABLE}
   [junit4]   2> 785381 INFO  (jetty-launcher-302-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1e741c12{HTTP/1.1,[http/1.1]}{127.0.0.1:36714}
   [junit4]   2> 785381 INFO  (jetty-launcher-302-thread-2) [    ] o.e.j.s.Server Started @803519ms
   [junit4]   2> 785381 INFO  (jetty-launcher-302-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36714}
   [junit4]   2> 785381 ERROR (jetty-launcher-302-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 785381 INFO  (jetty-launcher-302-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 785381 INFO  (jetty-launcher-302-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 785381 INFO  (jetty-launcher-302-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 785381 INFO  (jetty-launcher-302-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-05T01:20:32.156Z
   [junit4]   2> 785543 INFO  (jetty-launcher-302-thread-5) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@75709bfa{/solr,null,AVAILABLE}
   [junit4]   2> 785543 INFO  (jetty-launcher-302-thread-5) [    ] o.e.j.s.AbstractConnector Started ServerConnector@4c6717cd{HTTP/1.1,[http/1.1]}{127.0.0.1:38364}
   [junit4]   2> 785543 INFO  (jetty-launcher-302-thread-5) [    ] o.e.j.s.Server Started @803682ms
   [junit4]   2> 785543 INFO  (jetty-launcher-302-thread-5) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38364}
   [junit4]   2> 785544 ERROR (jetty-launcher-302-thread-5) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 785544 INFO  (jetty-launcher-302-thread-5) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.2.0
   [junit4]   2> 785544 INFO  (jetty-launcher-302-thread-5) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 785544 INFO  (jetty-launcher-302-thread-5) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 785544 INFO  (jetty-launcher-302-thread-5) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-05T01:20:32.319Z
   [junit4]   2> 785633 INFO  (jetty-launcher-302-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 785694 INFO  (jetty-launcher-302-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 785803 INFO  (jetty-launcher-302-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 786043 INFO  (jetty-launcher-302-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 786043 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f89c3cd780004, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 786072 INFO  (jetty-launcher-302-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38281/solr
   [junit4]   2> 786079 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f89c3cd780002, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 786141 INFO  (jetty-launcher-302-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38281/solr
   [junit4]   2> 786141 INFO  (jetty-launcher-302-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38281/solr
   [junit4]   2> 786263 INFO  (jetty-launcher-302-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38281/solr
   [junit4]   2> 786079 INFO  (jetty-launcher-302-thread-5) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 786487 INFO  (jetty-launcher-302-thread-5) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38281/solr
   [junit4]   2> 786594 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f89c3cd780009, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 787533 INFO  (jetty-launcher-302-thread-5) [n:127.0.0.1:38364_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 787533 INFO  (jetty-launcher-302-thread-5) [n:127.0.0.1:38364_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38364_solr
   [junit4]   2> 787534 INFO  (jetty-launcher-302-thread-5) [n:127.0.0.1:38364_solr    ] o.a.s.c.Overseer Overseer (id=98949190884261903-127.0.0.1:38364_solr-n_0000000000) starting
   [junit4]   2> 787730 INFO  (jetty-launcher-302-thread-5) [n:127.0.0.1:38364_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38364_solr
   [junit4]   2> 787788 INFO  (zkCallback-332-thread-1-processing-n:127.0.0.1:38364_solr) [n:127.0.0.1:38364_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 787987 INFO  (zkCallback-328-thread-1-processing-n:127.0.0.1:37586_solr) [n:127.0.0.1:37586_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 788088 INFO  (jetty-launcher-302-thread-1) [n:127.0.0.1:37586_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 788308 INFO  (jetty-launcher-302-thread-1) [n:127.0.0.1:37586_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37586_solr
   [junit4]   2> 788373 INFO  (jetty-launcher-302-thread-2) [n:127.0.0.1:36714_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 788410 INFO  (zkCallback-328-thread-1-processing-n:127.0.0.1:37586_solr) [n:127.0.0.1:37586_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 788410 INFO  (zkCallback-332-thread-1-processing-n:127.0.0.1:38364_solr) [n:127.0.0.1:38364_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 788411 INFO  (jetty-launcher-302-thread-5) [n:127.0.0.1:38364_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38364.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dfb6943
   [junit4]   2> 788449 INFO  (jetty-launcher-302-thread-5) [n:127.0.0.1:38364_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38364.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dfb6943
   [junit4]   2> 788449 INFO  (jetty-launcher-302-thread-5) [n:127.0.0.1:38364_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38364.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dfb6943
   [junit4]   2> 788450 INFO  (jetty-launcher-302-thread-5) [n:127.0.0.1:38364_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorCloud_AF3A5DBD319994D0-001/tempDir-001/node5/.
   [junit4]   2> 788609 INFO  (jetty-launcher-302-thread-2) [n:127.0.0.1:36714_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 788735 INFO  (jetty-launcher-302-thread-2) [n:127.0.0.1:36714_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36714_solr
   [junit4]   2> 788817 INFO  (jetty-launcher-302-thread-1) [n:127.0.0.1:37586_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37586.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dfb6943
   [junit4]   2> 788840 INFO  (jetty-launcher-302-thread-1) [n:127.0.0.1:37586_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37586.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dfb6943
   [junit4]   2> 788840 INFO  (jetty-launcher-302-thread-1) [n:127.0.0.1:37586_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37586.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dfb6943
   [junit4]   2> 788865 INFO  (zkCallback-332-thread-1-processing-n:127.0.0.1:38364_solr) [n:127.0.0.1:38364_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 788903 INFO  (jetty-launcher-302-thread-1) [n:127.0.0.1:37586_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorCloud_AF3A5DBD319994D0-001/tempDir-001/node1/.
   [junit4]   2> 788903 INFO  (zkCallback-323-thread-1-processing-n:127.0.0.1:36714_solr) [n:127.0.0.1:36714_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 788910 INFO  (zkCallback-328-thread-1-processing-n:127.0.0.1:37586_solr) [n:127.0.0.1:37586_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 789257 INFO  (jetty-launcher-302-thread-2) [n:127.0.0.1:36714_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36714.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dfb6943
   [junit4]   2> 789317 INFO  (jetty-launcher-302-thread-2) [n:127.0.0.1:36714_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36714.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dfb6943
   [junit4]   2> 789318 INFO  (jetty-launcher-302-thread-2) [n:127.0.0.1:36714_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36714.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dfb6943
   [junit4]   2> 789319 INFO  (jetty-launcher-302-thread-2) [n:127.0.0.1:36714_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorCloud_AF3A5DBD319994D0-001/tempDir-001/node2/.
   [junit4]   2> 789978 INFO  (jetty-launcher-302-thread-4) [n:127.0.0.1:41112_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 790001 INFO  (jetty-launcher-302-thread-4) [n:127.0.0.1:41112_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 790001 INFO  (jetty-launcher-302-thread-3) [n:127.0.0.1:35491_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 790003 INFO  (jetty-launcher-302-thread-3) [n:127.0.0.1:35491_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 790036 INFO  (jetty-launcher-302-thread-4) [n:127.0.0.1:41112_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41112_solr
   [junit4]   2> 790037 INFO  (zkCallback-323-thread-1-processing-n:127.0.0.1:36714_solr) [n:127.0.0.1:36714_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 790038 INFO  (zkCallback-332-thread-1-processing-n:127.0.0.1:38364_solr) [n:127.0.0.1:38364_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 790068 INFO  (zkCallback-328-thread-1-processing-n:127.0.0.1:37586_solr) [n:127.0.0.1:37586_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 790138 INFO  (jetty-launcher-302-thread-3) [n:127.0.0.1:35491_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35491_solr
   [junit4]   2> 790138 INFO  (zkCallback-324-thread-1-processing-n:127.0.0.1:35491_solr) [n:127.0.0.1:35491_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 790142 INFO  (zkCallback-322-thread-1-processing-n:127.0.0.1:41112_solr) [n:127.0.0.1:41112_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 790162 INFO  (zkCallback-328-thread-1-processing-n:127.0.0.1:37586_solr) [n:127.0.0.1:37586_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 790182 INFO  (zkCallback-323-thread-1-processing-n:127.0.0.1:36714_solr) [n:127.0.0.1:36714_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 790211 INFO  (zkCallback-324-thread-1-processing-n:127.0.0.1:35491_solr) [n:127.0.0.1:35491_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 790211 INFO  (zkCallback-332-thread-1-processing-n:127.0.0.1:38364_solr) [n:127.0.0.1:38364_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 790215 INFO  (zkCallback-322-thread-1-processing-n:127.0.0.1:41112_solr) [n:127.0.0.1:41112_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 790285 INFO  (jetty-launcher-302-thread-4) [n:127.0.0.1:41112_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41112.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dfb6943
   [junit4]   2> 790328 INFO  (jetty-launcher-302-thread-4) [n:127.0.0.1:41112_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41112.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dfb6943
   [junit4]   2> 790341 INFO  (jetty-launcher-302-thread-4) [n:127.0.0.1:41112_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41112.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dfb6943
   [junit4]   2> 790342 INFO  (jetty-launcher-302-thread-4) [n:127.0.0.1:41112_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorCloud_AF3A5DBD319994D0-001/tempDir-001/node4/.
   [junit4]   2> 790411 INFO  (jetty-launcher-302-thread-3) [n:127.0.0.1:35491_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35491.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dfb6943
   [junit4]   2> 790450 INFO  (jetty-launcher-302-thread-3) [n:127.0.0.1:35491_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35491.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dfb6943
   [junit4]   2> 790450 INFO  (jetty-launcher-302-thread-3) [n:127.0.0.1:35491_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35491.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dfb6943
   [junit4]   2> 790486 INFO  (jetty-launcher-302-thread-3) [n:127.0.0.1:35491_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorCloud_AF3A5DBD319994D0-001/tempDir-001/node3/.
   [junit4]   2> 790927 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[AF3A5DBD319994D0]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 790928 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[AF3A5DBD319994D0]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38281/solr ready
   [junit4]   2> 792451 INFO  (qtp1359863794-3972) [n:127.0.0.1:36714_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&property.config=solrconfig-distrib-update-processor-chains.xml&property.schema=schema15.xml&collection.configName=solrCloudCollectionConfig&name=test_col&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 792597 INFO  (OverseerThreadFactory-872-thread-1-processing-n:127.0.0.1:38364_solr) [n:127.0.0.1:38364_solr    ] o.a.s.c.CreateCollectionCmd Create collection test_col
   [junit4]   2> 792833 INFO  (OverseerStateUpdate-98949190884261903-127.0.0.1:38364_solr-n_0000000000) [n:127.0.0.1:38364_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"test_col",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"test_col_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:36714/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 792854 INFO  (OverseerStateUpdate-98949190884261903-127.0.0.1:38364_solr-n_0000000000) [n:127.0.0.1:38364_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"test_col",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"test_col_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:35491/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 792857 INFO  (OverseerStateUpdate-98949190884261903-127.0.0.1:38364_solr-n_0000000000) [n:127.0.0.1:38364_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"test_col",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"test_col_shard2_replica_n3",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:41112/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 792874 INFO  (OverseerStateUpdate-98949190884261903-127.0.0.1:38364_solr-n_0000000000) [n:127.0.0.1:38364_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"test_col",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"test_col_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:37586/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 793061 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=test_col&version=2&replicaType=NRT&property.config=solrconfig-distrib-update-processor-chains.xml&property.schema=schema15.xml&coreNodeName=core_node5&name=test_col_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&wt=javabin
   [junit4]   2> 793073 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 793111 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=test_col&version=2&replicaType=NRT&property.config=solrconfig-distrib-update-processor-chains.xml&property.schema=schema15.xml&coreNodeName=core_node7&name=test_col_shard2_replica_n3&action=CREATE&numShards=2&shard=shard2&wt=javabin
   [junit4]   2> 793111 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 793179 INFO  (qtp88182679-3964) [n:127.0.0.1:35491_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=test_col&version=2&replicaType=NRT&property.config=solrconfig-distrib-update-processor-chains.xml&property.schema=schema15.xml&coreNodeName=core_node6&name=test_col_shard1_replica_n2&action=CREATE&numShards=2&shard=shard1&wt=javabin
   [junit4]   2> 793180 INFO  (qtp88182679-3964) [n:127.0.0.1:35491_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 793183 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=test_col&version=2&replicaType=NRT&property.config=solrconfig-distrib-update-processor-chains.xml&property.schema=schema15.xml&coreNodeName=core_node8&name=test_col_shard2_replica_n4&action=CREATE&numShards=2&shard=shard2&wt=javabin
   [junit4]   2> 793183 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 793410 INFO  (zkCallback-322-thread-1-processing-n:127.0.0.1:41112_solr) [n:127.0.0.1:41112_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 793411 INFO  (zkCallback-324-thread-1-processing-n:127.0.0.1:35491_solr) [n:127.0.0.1:35491_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 793411 INFO  (zkCallback-328-thread-1-processing-n:127.0.0.1:37586_solr) [n:127.0.0.1:37586_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 793423 INFO  (zkCallback-323-thread-1-processing-n:127.0.0.1:36714_solr) [n:127.0.0.1:36714_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 793439 INFO  (zkCallback-322-thread-2-processing-n:127.0.0.1:41112_solr) [n:127.0.0.1:41112_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 793447 INFO  (zkCallback-323-thread-2-processing-n:127.0.0.1:36714_solr) [n:127.0.0.1:36714_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 793447 INFO  (zkCallback-324-thread-2-processing-n:127.0.0.1:35491_solr) [n:127.0.0.1:35491_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 793447 INFO  (zkCallback-328-thread-2-processing-n:127.0.0.1:37586_solr) [n:127.0.0.1:37586_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 794471 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 794523 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 794580 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema15.xml instead
   [junit4]   2> 794744 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema15.xml instead
   [junit4]   2> 794784 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.s.IndexSchema [test_col_shard1_replica_n1] Schema name=test
   [junit4]   2> 794841 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.s.IndexSchema [test_col_shard2_replica_n4] Schema name=test
   [junit4]   2> 795228 INFO  (qtp88182679-3964) [n:127.0.0.1:35491_solr c:test_col s:shard1 r:core_node6 x:test_col_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 795243 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 795334 INFO  (qtp88182679-3964) [n:127.0.0.1:35491_solr c:test_col s:shard1 r:core_node6 x:test_col_shard1_replica_n2] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema15.xml instead
   [junit4]   2> 795334 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema15.xml instead
   [junit4]   2> 795338 INFO  (qtp88182679-3964) [n:127.0.0.1:35491_solr c:test_col s:shard1 r:core_node6 x:test_col_shard1_replica_n2] o.a.s.s.IndexSchema [test_col_shard1_replica_n2] Schema name=test
   [junit4]   2> 795374 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.s.IndexSchema [test_col_shard2_replica_n3] Schema name=test
   [junit4]   2> 795997 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 796215 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.s.ManagedIndexSchema Created and persisted managed schema znode at /configs/solrCloudCollectionConfig/managed-schema
   [junit4]   2> 796286 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, renamed the non-managed schema /configs/solrCloudCollectionConfig/schema15.xml to /configs/solrCloudCollectionConfig/schema15.xml.bak
   [junit4]   2> 796286 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'test_col_shard1_replica_n1' using configuration from collection test_col, trusted=true
   [junit4]   2> 796287 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36714.solr.core.test_col.shard1.replica_n1' (registry 'solr.core.test_col.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dfb6943
   [junit4]   2> 796287 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 796287 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.c.SolrCore [[test_col_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorCloud_AF3A5DBD319994D0-001/tempDir-001/node2/test_col_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorCloud_AF3A5DBD319994D0-001/tempDir-001/node2/./test_col_shard1_replica_n1/data/]
   [junit4]   2> 796289 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=21, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.590635781832641]
   [junit4]   2> 796320 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 796558 INFO  (qtp88182679-3964) [n:127.0.0.1:35491_solr c:test_col s:shard1 r:core_node6 x:test_col_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 796628 INFO  (qtp88182679-3964) [n:127.0.0.1:35491_solr c:test_col s:shard1 r:core_node6 x:test_col_shard1_replica_n2] o.a.s.s.ManagedIndexSchema Managed schema znode at /configs/solrCloudCollectionConfig/managed-schema already exists - no need to create it
   [junit4]   2> 796685 INFO  (qtp88182679-3964) [n:127.0.0.1:35491_solr c:test_col s:shard1 r:core_node6 x:test_col_shard1_replica_n2] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, the non-managed schema /configs/solrCloudCollectionConfig/schema15.xml no longer exists.
   [junit4]   2> 796685 INFO  (qtp88182679-3964) [n:127.0.0.1:35491_solr c:test_col s:shard1 r:core_node6 x:test_col_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'test_col_shard1_replica_n2' using configuration from collection test_col, trusted=true
   [junit4]   2> 796685 INFO  (qtp88182679-3964) [n:127.0.0.1:35491_solr c:test_col s:shard1 r:core_node6 x:test_col_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35491.solr.core.test_col.shard1.replica_n2' (registry 'solr.core.test_col.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dfb6943
   [junit4]   2> 796685 INFO  (qtp88182679-3964) [n:127.0.0.1:35491_solr c:test_col s:shard1 r:core_node6 x:test_col_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 796685 INFO  (qtp88182679-3964) [n:127.0.0.1:35491_solr c:test_col s:shard1 r:core_node6 x:test_col_shard1_replica_n2] o.a.s.c.SolrCore [[test_col_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorCloud_AF3A5DBD319994D0-001/tempDir-001/node3/test_col_shard1_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorCloud_AF3A5DBD319994D0-001/tempDir-001/node3/./test_col_shard1_replica_n2/data/]
   [junit4]   2> 796688 INFO  (qtp88182679-3964) [n:127.0.0.1:35491_solr c:test_col s:shard1 r:core_node6 x:test_col_shard1_replica_n2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=21, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.590635781832641]
   [junit4]   2> 796896 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 796896 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 796897 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 796897 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 796899 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=562106342, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 796899 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1cea2574[test_col_shard1_replica_n1] main]
   [junit4]   2> 796941 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 796954 INFO  (qtp88182679-3964) [n:127.0.0.1:35491_solr c:test_col s:shard1 r:core_node6 x:test_col_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 796954 INFO  (qtp88182679-3964) [n:127.0.0.1:35491_solr c:test_col s:shard1 r:core_node6 x:test_col_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 796955 INFO  (qtp88182679-3964) [n:127.0.0.1:35491_solr c:test_col s:shard1 r:core_node6 x:test_col_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 796955 INFO  (qtp88182679-3964) [n:127.0.0.1:35491_solr c:test_col s:shard1 r:core_node6 x:test_col_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 796956 INFO  (qtp88182679-3964) [n:127.0.0.1:35491_solr c:test_col s:shard1 r:core_node6 x:test_col_shard1_replica_n2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=562106342, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 796956 INFO  (qtp88182679-3964) [n:127.0.0.1:35491_solr c:test_col s:shard1 r:core_node6 x:test_col_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@74a129b[test_col_shard1_replica_n2] main]
   [junit4]   2> 796970 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
   [junit4]   2> 796990 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
   [junit4]   2> 796991 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/solrCloudCollectionConfig/managed-schema
   [junit4]   2> 796994 INFO  (qtp88182679-3964) [n:127.0.0.1:35491_solr c:test_col s:shard1 r:core_node6 x:test_col_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
   [junit4]   2> 797010 INFO  (qtp88182679-3964) [n:127.0.0.1:35491_solr c:test_col s:shard1 r:core_node6 x:test_col_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
   [junit4]   2> 797010 INFO  (qtp88182679-3964) [n:127.0.0.1:35491_solr c:test_col s:shard1 r:core_node6 x:test_col_shard1_replica_n2] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/solrCloudCollectionConfig/managed-schema
   [junit4]   2> 797035 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 797036 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583187066943963136
   [junit4]   2> 797038 INFO  (searcherExecutor-883-thread-1-processing-n:127.0.0.1:36714_solr x:test_col_shard1_replica_n1 s:shard1 c:test_col r:core_node5) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.c.SolrCore [test_col_shard1_replica_n1] Registered new searcher Searcher@1cea2574[test_col_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 797067 INFO  (qtp88182679-3964) [n:127.0.0.1:35491_solr c:test_col s:shard1 r:core_node6 x:test_col_shard1_replica_n2] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 0 from ZooKeeper
   [junit4]   2> 797070 INFO  (qtp88182679-3964) [n:127.0.0.1:35491_solr c:test_col s:shard1 r:core_node6 x:test_col_shard1_replica_n2] o.a.s.s.IndexSchema [test_col_shard1_replica_n2] Schema name=test
   [junit4]   2> 797284 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 797392 INFO  (zkCallback-324-thread-2-processing-n:127.0.0.1:35491_solr) [n:127.0.0.1:35491_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 797393 INFO  (zkCallback-324-thread-1-processing-n:127.0.0.1:35491_solr) [n:127.0.0.1:35491_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 797400 INFO  (zkCallback-323-thread-2-processing-n:127.0.0.1:36714_solr) [n:127.0.0.1:36714_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 797401 INFO  (zkCallback-323-thread-1-processing-n:127.0.0.1:36714_solr) [n:127.0.0.1:36714_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 797401 INFO  (zkCallback-322-thread-2-processing-n:127.0.0.1:41112_solr) [n:127.0.0.1:41112_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 797401 INFO  (zkCallback-328-thread-1-processing-n:127.0.0.1:37586_solr) [n:127.0.0.1:37586_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 797409 INFO  (zkCallback-328-thread-2-processing-n:127.0.0.1:37586_solr) [n:127.0.0.1:37586_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 797412 INFO  (zkCallback-322-thread-1-processing-n:127.0.0.1:41112_solr) [n:127.0.0.1:41112_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 797490 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.s.ManagedIndexSchema Managed schema znode at /configs/solrCloudCollectionConfig/managed-schema already exists - no need to create it
   [junit4]   2> 797490 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, the non-managed schema /configs/solrCloudCollectionConfig/schema15.xml no longer exists.
   [junit4]   2> 797490 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.c.CoreContainer Creating SolrCore 'test_col_shard2_replica_n3' using configuration from collection test_col, trusted=true
   [junit4]   2> 797491 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41112.solr.core.test_col.shard2.replica_n3' (registry 'solr.core.test_col.shard2.replica_n3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dfb6943
   [junit4]   2> 797491 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 797491 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.c.SolrCore [[test_col_shard2_replica_n3] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorCloud_AF3A5DBD319994D0-001/tempDir-001/node4/test_col_shard2_replica_n3], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorCloud_AF3A5DBD319994D0-001/tempDir-001/node4/./test_col_shard2_replica_n3/data/]
   [junit4]   2> 797493 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=21, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.590635781832641]
   [junit4]   2> 797596 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.s.ManagedIndexSchema Managed schema znode at /configs/solrCloudCollectionConfig/managed-schema already exists - no need to create it
   [junit4]   2> 797596 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, the non-managed schema /configs/solrCloudCollectionConfig/schema15.xml no longer exists.
   [junit4]   2> 797596 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'test_col_shard2_replica_n4' using configuration from collection test_col, trusted=true
   [junit4]   2> 797596 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37586.solr.core.test_col.shard2.replica_n4' (registry 'solr.core.test_col.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4dfb6943
   [junit4]   2> 797596 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 797596 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.c.SolrCore [[test_col_shard2_replica_n4] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorCloud_AF3A5DBD319994D0-001/tempDir-001/node1/test_col_shard2_replica_n4], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J1/temp/solr.cloud.TestTolerantUpdateProcessorCloud_AF3A5DBD319994D0-001/tempDir-001/node1/./test_col_shard2_replica_n4/data/]
   [junit4]   2> 797599 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=21, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.590635781832641]
   [junit4]   2> 798152 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 798152 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 798153 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 798153 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 798155 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=562106342, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 798155 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.s.SolrIndexSearcher Opening [Searcher@46495a98[test_col_shard2_replica_n3] main]
   [junit4]   2> 798157 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
   [junit4]   2> 798157 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
   [junit4]   2> 798157 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/solrCloudCollectionConfig/managed-schema
   [junit4]   2> 798158 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 0 from ZooKeeper
   [junit4]   2> 798185 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 798185 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 798185 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 798186 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 798187 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=562106342, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 798187 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@537c9c6f[test_col_shard2_replica_n4] main]
   [junit4]   2> 798193 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
   [junit4]   2> 798193 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
   [junit4]   2> 798193 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/solrCloudCollectionConfig/managed-schema
   [junit4]   2> 798193 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 0 from ZooKeeper
   [junit4]   2> 798196 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.s.IndexSchema [test_col_shard2_replica_n4] Schema name=test
   [junit4]   2> 798209 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.s.IndexSchema [test_col_shard2_replica_n3] Schema name=test
   [junit4]   2> 798959 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 799174 INFO  (qtp88182679-3964) [n:127.0.0.1:35491_solr c:test_col s:shard1 r:core_node6 x:test_col_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 799210 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 799283 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 1089 ms
   [junit4]   2> 799284 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583187069301161984
   [junit4]   2> 799298 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 1140 ms
   [junit4]   2> 799300 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583187069317939200
   [junit4]   2> 799429 INFO  (searcherExecutor-892-thread-1-processing-n:127.0.0.1:37586_solr x:test_col_shard2_replica_n4 s:shard2 c:test_col r:core_node8) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.c.SolrCore [test_col_shard2_replica_n4] Registered new searcher Searcher@537c9c6f[test_col_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 799506 INFO  (searcherExecutor-891-thread-1-processing-n:127.0.0.1:41112_solr x:test_col_shard2_replica_n3 s:shard2 c:test_col r:core_node7) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.c.SolrCore [test_col_shard2_replica_n3] Registered new searcher Searcher@46495a98[test_col_shard2_replica_n3] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 799528 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 799615 INFO  (zkCallback-328-thread-1-processing-n:127.0.0.1:37586_solr) [n:127.0.0.1:37586_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 799623 INFO  (zkCallback-328-thread-2-processing-n:127.0.0.1:37586_solr) [n:127.0.0.1:37586_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 799623 INFO  (zkCallback-324-thread-2-processing-n:127.0.0.1:35491_solr) [n:127.0.0.1:35491_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 799623 INFO  (zkCallback-324-thread-1-processing-n:127.0.0.1:35491_solr) [n:127.0.0.1:35491_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 799623 INFO  (zkCallback-322-thread-1-processing-n:127.0.0.1:41112_solr) [n:127.0.0.1:41112_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 799624 INFO  (zkCallback-322-thread-2-processing-n:127.0.0.1:41112_solr) [n:127.0.0.1:41112_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 799624 INFO  (zkCallback-323-thread-2-processing-n:127.0.0.1:36714_solr) [n:127.0.0.1:36714_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 799624 INFO  (zkCallback-323-thread-1-processing-n:127.0.0.1:36714_solr) [n:127.0.0.1:36714_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 800038 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 800038 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 800038 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:37586/solr/test_col_shard2_replica_n4/
   [junit4]   2> 800038 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.u.PeerSync PeerSync: core=test_col_shard2_replica_n4 url=http://127.0.0.1:37586/solr START replicas=[http://127.0.0.1:41112/solr/test_col_shard2_replica_n3/] nUpdates=100
   [junit4]   2> 800052 INFO  (qtp595796666-3955) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.c.S.Request [test_col_shard2_replica_n3]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 800056 INFO  (qtp88182679-3964) [n:127.0.0.1:35491_solr c:test_col s:shard1 r:core_node6 x:test_col_shard1_replica_n2] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 2989 ms
   [junit4]   2> 800057 INFO  (qtp88182679-3964) [n:127.0.0.1:35491_solr c:test_col s:shard1 r:core_node6 x:test_col_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583187070111711232
   [junit4]   2> 800063 INFO  (searcherExecutor-884-thread-1-processing-n:127.0.0.1:35491_solr x:test_col_shard1_replica_n2 s:shard1 c:test_col r:core_node6) [n:127.0.0.1:35491_solr c:test_col s:shard1 r:core_node6 x:test_col_shard1_replica_n2] o.a.s.c.SolrCore [test_col_shard1_replica_n2] Registered new searcher Searcher@74a129b[test_col_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 800201 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 800201 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 800201 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:36714/solr/test_col_shard1_replica_n1/
   [junit4]   2> 800201 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=test_col_shard1_replica_n1 url=http://127.0.0.1:36714/solr START replicas=[http://127.0.0.1:35491/solr/test_col_shard1_replica_n2/] nUpdates=100
   [junit4]   2> 800250 INFO  (qtp88182679-3962) [n:127.0.0.1:35491_solr c:test_col s:shard1 r:core_node6 x:test_col_shard1_replica_n2] o.a.s.c.S.Request [test_col_shard1_replica_n2]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=17
   [junit4]   2> 800343 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.u.PeerSync PeerSync: core=test_col_shard2_replica_n4 url=http://127.0.0.1:37586/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 800343 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 800343 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 800343 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 800345 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:37586/solr/test_col_shard2_replica_n4/ shard2
   [junit4]   2> 800522 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=test_col_shard1_replica_n1 url=http://127.0.0.1:36714/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 800522 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 800522 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 800522 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 800522 INFO  (zkCallback-328-thread-1-processing-n:127.0.0.1:37586_solr) [n:127.0.0.1:37586_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 800522 INFO  (zkCallback-322-thread-2-processing-n:127.0.0.1:41112_solr) [n:127.0.0.1:41112_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 800522 INFO  (zkCallback-322-thread-1-processing-n:127.0.0.1:41112_solr) [n:127.0.0.1:41112_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 800523 INFO  (zkCallback-323-thread-2-processing-n:127.0.0.1:36714_solr) [n:127.0.0.1:36714_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 800523 INFO  (zkCallback-323-thread-1-processing-n:127.0.0.1:36714_solr) [n:127.0.0.1:36714_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 800525 INFO  (qtp1359863794-3976) [n:127.0.0.1:36714_solr c:test_col s:shard1 r:core_node5 x:test_col_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:36714/solr/test_col_shard1_replica_n1/ shard1
   [junit4]   2> 800550 INFO  (zkCallback-328-thread-2-processing-n:127.0.0.1:37586_solr) [n:127.0.0.1:37586_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 800550 INFO  (zkCallback-324-thread-1-processing-n:127.0.0.1:35491_solr) [n:127.0.0.1:35491_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 800550 INFO  (zkCallback-324-thread-2-processing-n:127.0.0.1:35491_solr) [n:127.0.0.1:35491_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 800558 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 800560 INFO  (qtp886841162-3944) [n:127.0.0.1:37586_solr c:test_col s:shard2 r:core_node8 x:test_col_shard2_replica_n4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=test_col&version=2&replicaType=NRT&property.config=solrconfig-distrib-update-processor-chains.xml&property.schema=schema15.xml&coreNodeName=core_node8&name=test_col_shard2_replica_n4&action=CREATE&numShards=2&shard=shard2&wt=javabin} status=0 QTime=7376
   [junit4]   2> 800580 INFO  (qtp595796666-3953) [n:127.0.0.1:41112_solr c:test_col s:shard2 r:core_node7 x:test_col_shard2_replica_n3] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=test_col&version=2&replicaType=NRT&property.config=solrconfig-distrib-update-processor-chains.xml&property.schema=schema15.xml&coreNodeName=core_node7&name=test_col_shard2_replica_n3&action=CREATE&numShards=2&shard=shard2&wt=javabin} status=0 QTime=7469
   [junit4]   2> 800742 INFO  (zkCallback-328-thread-2-processing-n:127.0.0.1:37586_solr) [n:127.0.0.1:37586_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 800742 INFO  (zkCallback-328-thread-1-processing-n:127.0.0.1:37586_solr) [n:127.0.0.1:37586_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 800742 INFO  (zkCallback-324-thread-2-processing-n:127.0.0.1:35491_solr) [n:127.0.0.1:35491_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 800742 INFO  (zkCallback-323-thread-2-processing-n:127.0.0.1:36714_solr) [n:127.0.0.1:36714_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 800742 INFO  (zkCallback-324-thread-1-processing-n:127.0.0.1:35491_solr) [n:127.0.0.1:35491_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 800742 INFO  (zkCallback-323-thread-1-processing-n:127.0.0.1:36714_solr) [n:127.0.0.1:36714_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 800742 INFO  (zkCallback-322-thread-2-processing-n:127.0.0.1:41112_solr) [n:127.0.0.1:41112_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collection [test_col] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 800742 INFO  (zkCallback-322-thread-1-processing-n:127.0.0.1:41112_solr) [n:127.0.0.1:41112_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/test_col/state.json] for collecti

[...truncated too long message...]

oseExecutor-2056-thread-1) [n:127.0.0.1:40421__%2Ffo c:source_collection s:shard1 r:core_node5 x:source_collection_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.source_collection.shard1.leader, tag=845778770
   [junit4]   2> 1261761 INFO  (coreCloseExecutor-2056-thread-1) [n:127.0.0.1:40421__%2Ffo c:source_collection s:shard1 r:core_node5 x:source_collection_shard1_replica_n2] o.a.s.h.CdcrRequestHandler Solr core is being closed - shutting down CDCR handler @ source_collection:shard1
   [junit4]   2> 1261788 INFO  (zkCallback-969-thread-9-processing-n:127.0.0.1:40421__%2Ffo) [n:127.0.0.1:40421__%2Ffo    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/source_collection/state.json] for collection [source_collection] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1261829 INFO  (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[AF3A5DBD319994D0]) [    ] o.a.s.c.Overseer Overseer (id=98949217923629070-127.0.0.1:40421__%2Ffo-n_0000000003) closing
   [junit4]   2> 1261840 INFO  (OverseerStateUpdate-98949217923629070-127.0.0.1:40421__%2Ffo-n_0000000003) [n:127.0.0.1:40421__%2Ffo    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:40421__%2Ffo
   [junit4]   2> 1261840 WARN  (OverseerAutoScalingTriggerThread-98949217923629070-127.0.0.1:40421__%2Ffo-n_0000000003) [n:127.0.0.1:40421__%2Ffo    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 1262027 INFO  (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[AF3A5DBD319994D0]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@16cf98b0{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1262028 INFO  (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[AF3A5DBD319994D0]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5ce54055{/_/fo,null,UNAVAILABLE}
   [junit4]   2> 1262064 INFO  (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[AF3A5DBD319994D0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testCdcrDocVersions
   [junit4]   2> 1262064 ERROR (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[AF3A5DBD319994D0]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1262080 INFO  (TEST-CdcrVersionReplicationTest.testCdcrDocVersions-seed#[AF3A5DBD319994D0]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41795 41795
   [junit4]   2> 1262374 INFO  (Thread-792) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41795 41795
   [junit4]   2> 1262374 WARN  (Thread-792) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	17	/solr/aliases.json
   [junit4]   2> 	8	/solr/configs/conf1
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 	2	/solr/collections/source_collection/leaders/shard1/leader
   [junit4]   2> 	2	/solr/collections/source_collection/leaders/shard2/leader
   [junit4]   2> 	2	/solr/collections/tmp_collection/leaders/shard2/leader
   [junit4]   2> 	2	/solr/collections/tmp_collection/leaders/shard1/leader
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	17	/solr/clusterprops.json
   [junit4]   2> 	17	/solr/clusterstate.json
   [junit4]   2> 	4	/solr/collections/source_collection/cdcr/state/buffer
   [junit4]   2> 	4	/solr/collections/tmp_collection/state.json
   [junit4]   2> 	4	/solr/collections/source_collection/cdcr/state/process
   [junit4]   2> 	4	/solr/collections/tmp_collection/cdcr/state/buffer
   [junit4]   2> 	4	/solr/collections/source_collection/state.json
   [junit4]   2> 	4	/solr/collections/tmp_collection/cdcr/state/process
   [junit4]   2> 	2	/solr/autoscaling.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	17	/solr/live_nodes
   [junit4]   2> 	17	/solr/collections
   [junit4]   2> 	2	/solr/overseer/queue
   [junit4]   2> 	2	/solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 	2	/solr/overseer/collection-queue-work
   [junit4]   2> 	2	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=CdcrVersionReplicationTest -Dtests.method=testCdcrDocVersions -Dtests.seed=AF3A5DBD319994D0 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=is -Dtests.timezone=Europe/Tallinn -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   61.3s J2 | CdcrVersionReplicationTest.testCdcrDocVersions <<<
   [junit4]    > Throwable #1: org.apache.solr.common.SolrException: Could not load collection from ZK: source_collection
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([AF3A5DBD319994D0:57AC561FC3FF7BCC]:0)
   [junit4]    > 	at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1172)
   [junit4]    > 	at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:692)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.getDocCollection(CloudSolrClient.java:1198)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:840)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:183)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:957)
   [junit4]    > 	at org.apache.solr.cloud.CdcrVersionReplicationTest.doQuery(CdcrVersionReplicationTest.java:270)
   [junit4]    > 	at org.apache.solr.cloud.CdcrVersionReplicationTest.doTestCdcrDocVersions(CdcrVersionReplicationTest.java:170)
   [junit4]    > 	at org.apache.solr.cloud.CdcrVersionReplicationTest.testCdcrDocVersions(CdcrVersionReplicationTest.java:74)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]    > Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/source_collection/state.json
   [junit4]    > 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]    > 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]    > 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:332)
   [junit4]    > 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:332)
   [junit4]    > 	at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1184)
   [junit4]    > 	at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
   [junit4]    > 	... 51 more
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrVersionReplicationTest_AF3A5DBD319994D0-001
   [junit4]   2> Nov 05, 2017 1:28:25 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {id=PostingsFormat(name=MockRandom)}, docValues:{_version_=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=1602, maxMBSortInHeap=6.0150615123514575, sim=RandomSimilarity(queryNorm=false): {}, locale=is, timezone=Europe/Tallinn
   [junit4]   2> NOTE: Linux 4.4.0-83-generic amd64/Oracle Corporation 1.8.0_152 (64-bit)/cpus=4,threads=1,free=119771728,total=465567744
   [junit4]   2> NOTE: All tests run in this JVM: [TestJavabinTupleStreamParser, TestFunctionQuery, TestManagedSchemaThreadSafety, AddBlockUpdateTest, ClusterStateTest, TestFieldCacheReopen, TestRawTransformer, QueryElevationComponentTest, EchoParamsTest, FieldMutatingUpdateProcessorTest, AtomicUpdatesTest, TestLeaderInitiatedRecoveryThread, TestChildDocTransformer, ChaosMonkeyNothingIsSafeTest, TestRestManager, CoreAdminHandlerTest, TestAuthorizationFramework, IndexSchemaTest, CloudMLTQParserTest, TestDistributedMissingSort, TestScoreJoinQPNoScore, TestPayloadScoreQParserPlugin, XmlUpdateRequestHandlerTest, TestInfoStreamLogging, TestFieldResource, ExitableDirectoryReaderTest, TestPartialUpdateDeduplication, TestMiniSolrCloudClusterSSL, HdfsSyncSliceTest, ClassificationUpdateProcessorTest, OverseerStatusTest, SystemInfoHandlerTest, RecoveryZkTest, ConnectionReuseTest, TestSha256AuthenticationProvider, TestClusterStateMutator, DataDrivenBlockJoinTest, CurrencyFieldTypeTest, TestHashQParserPlugin, NumberUtilsTest, TestCoreContainer, SolrCoreCheckLockOnStartupTest, TestCustomStream, TestSolrDeletionPolicy2, HdfsChaosMonkeySafeLeaderTest, SSLMigrationTest, RequiredFieldsTest, UninvertDocValuesMergePolicyTest, DefaultValueUpdateProcessorTest, DocValuesNotIndexedTest, TestQueryTypes, UniqFieldsUpdateProcessorFactoryTest, SolrShardReporterTest, SharedFSAutoReplicaFailoverTest, TestLegacyField, OverseerTest, AutoAddReplicasPlanActionTest, TestSolrCoreSnapshots, TestFiltering, TestDFISimilarityFactory, CdcrVersionReplicationTest]
   [junit4] Completed [135/747 (2!)] on J2 in 62.18s, 1 test, 1 error <<< FAILURES!

[...truncated 49324 lines...]

[JENKINS] Lucene-Solr-Tests-7.x - Build # 223 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/223/

All tests passed

Build Log:
[...truncated 949 lines...]
   [junit4] JVM J0: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_210229_7874930084330209027884.sysout
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] #
   [junit4] # There is insufficient memory for the Java Runtime Environment to continue.
   [junit4] # Native memory allocation (mmap) failed to map 18874368 bytes for committing reserved memory.
   [junit4] # An error report file with more information is saved as:
   [junit4] # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/J0/hs_err_pid1115.log
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_210229_7877978209266132209272.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x00000000fe800000, 18874368, 0) failed; error='Cannot allocate memory' (errno=12)
   [junit4] <<< JVM J0: EOF ----

[...truncated 753 lines...]
   [junit4] ERROR: JVM J0 ended with an exception, command line: /usr/local/asfpackages/java/jdk1.8.0_144/jre/bin/java -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/heapdumps -ea -esa -Dtests.prefix=tests -Dtests.seed=43A586F65B213C98 -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=7.2.0 -Dtests.cleanthreads=perMethod -Djava.util.logging.config.file=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/tools/junit4/logging.properties -Dtests.nightly=false -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=2 -DtempDir=./temp -Djava.io.tmpdir=./temp -Djunit4.tempDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp -Dcommon.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene -Dclover.db.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/clover/db -Djava.security.policy=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/tools/junit4/tests.policy -Dtests.LUCENE_VERSION=7.2.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Dtests.src.home=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x -Djava.security.egd=file:/dev/./urandom -Djunit4.childvm.cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/J0 -Djunit4.childvm.id=0 -Djunit4.childvm.count=3 -Dtests.leaveTemporary=false -Dtests.filterstacks=true -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Dfile.encoding=ISO-8859-1 -classpath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/codecs/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/test-framework/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/test-framework/lib/junit-4.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/test-framework/lib/randomizedtesting-runner-2.5.3.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/classes/test:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.4.0.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-log4j.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit4.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jai.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-javamail.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bsf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-net.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-antlr.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jsch.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-oro.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-logging.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-netrexx.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-testutil.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jdepend.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bcel.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-xalan2.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-resolver.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jmf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-regexp.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-swing.jar:/usr/local/asfpackages/java/jdk1.8.0_144/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.5.3.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_210229_7877504767895765768006.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_210229_7873003255820317911864.suites -stdin
   [junit4] ERROR: JVM J0 ended with an exception: Forked process returned with error code: 1. Very likely a JVM crash.  See process stdout at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_210229_7874930084330209027884.sysout See process stderr at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_210229_7877978209266132209272.syserr
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1519)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:126)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:982)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:979)
   [junit4] 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4] 	at java.lang.Thread.run(Thread.java:748)

BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:835: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:779: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build.xml:50: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/common-build.xml:1512: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/common-build.xml:1038: At least one slave process threw an exception, first: Forked process returned with error code: 1. Very likely a JVM crash.  See process stdout at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_210229_7874930084330209027884.sysout See process stderr at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_210229_7877978209266132209272.syserr

Total time: 53 minutes 7 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[Fast Archiver] No artifacts from Lucene-Solr-Tests-7.x #218 to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene-Solr-Tests-7.x - Build # 222 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/222/

All tests passed

Build Log:
[...truncated 826 lines...]
   [junit4] JVM J0: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_201150_4683587702659080023037.sysout
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] #
   [junit4] # There is insufficient memory for the Java Runtime Environment to continue.
   [junit4] # Native memory allocation (mmap) failed to map 65536 bytes for committing reserved memory.
   [junit4] # An error report file with more information is saved as:
   [junit4] # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/J0/hs_err_pid23377.log
   [junit4] #
   [junit4] # Compiler replay data is saved as:
   [junit4] # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/J0/replay_pid23377.log
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_201150_4688240968023194733672.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x00007fb278930000, 65536, 1) failed; error='Cannot allocate memory' (errno=12)
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J2: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J2-20171104_201150_4682700656333009887283.sysout
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] #
   [junit4] # There is insufficient memory for the Java Runtime Environment to continue.
   [junit4] # Native memory allocation (mmap) failed to map 12288 bytes for committing reserved memory.
   [junit4] [thread 139872248506112 also had an error]
   [junit4] [thread 139872252716800 also had an error]
   [junit4] [thread 139874069026560 also had an error]
   [junit4] [thread 139872250611456 also had an error]
   [junit4] # An error report file with more information is saved as:
   [junit4] # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/J2/hs_err_pid23378.log
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J2-20171104_201150_4686290253823793317798.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x00007f36f9031000, 12288, 0) failed; error='Cannot allocate memory' (errno=12)Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x00007f368b9fa000, 12288, 0) failed; error='Cannot allocate memory' (errno=12)Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x00007f368bdfe000, 12288, 0) failed; error='Cannot allocate memory' (errno=12)Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x00007f36f8229000, 12288, 0) failed; error='Cannot allocate memory' (errno=12)Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x00007f368bbfc000, 12288, 0) failed; error='Cannot allocate memory' (errno=12)
   [junit4] 
   [junit4] 
   [junit4] 
   [junit4] 
   [junit4] <<< JVM J2: EOF ----

[...truncated 829 lines...]
   [junit4] ERROR: JVM J0 ended with an exception, command line: /usr/local/asfpackages/java/jdk1.8.0_144/jre/bin/java -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/heapdumps -ea -esa -Dtests.prefix=tests -Dtests.seed=177B568CE0BFE653 -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=7.2.0 -Dtests.cleanthreads=perMethod -Djava.util.logging.config.file=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/tools/junit4/logging.properties -Dtests.nightly=false -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=2 -DtempDir=./temp -Djava.io.tmpdir=./temp -Djunit4.tempDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp -Dcommon.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene -Dclover.db.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/clover/db -Djava.security.policy=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/tools/junit4/tests.policy -Dtests.LUCENE_VERSION=7.2.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Dtests.src.home=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x -Djava.security.egd=file:/dev/./urandom -Djunit4.childvm.cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/J0 -Djunit4.childvm.id=0 -Djunit4.childvm.count=3 -Dtests.leaveTemporary=false -Dtests.filterstacks=true -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Dfile.encoding=US-ASCII -classpath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/codecs/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/test-framework/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/test-framework/lib/junit-4.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/test-framework/lib/randomizedtesting-runner-2.5.3.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/classes/test:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.4.0.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-log4j.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit4.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jai.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-javamail.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bsf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-net.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-antlr.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jsch.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-oro.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-logging.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-netrexx.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-testutil.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jdepend.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bcel.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-xalan2.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-resolver.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jmf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-regexp.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-swing.jar:/usr/local/asfpackages/java/jdk1.8.0_144/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.5.3.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_201150_4685539971957200862261.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_201150_4688870926601280998713.suites -stdin
   [junit4] ERROR: JVM J0 ended with an exception: Forked process returned with error code: 1. Very likely a JVM crash.  See process stdout at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_201150_4683587702659080023037.sysout See process stderr at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_201150_4688240968023194733672.syserr
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1519)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:126)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:982)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:979)
   [junit4] 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4] 	at java.lang.Thread.run(Thread.java:748)
   [junit4] ERROR: JVM J2 ended with an exception, command line: /usr/local/asfpackages/java/jdk1.8.0_144/jre/bin/java -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/heapdumps -ea -esa -Dtests.prefix=tests -Dtests.seed=177B568CE0BFE653 -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=7.2.0 -Dtests.cleanthreads=perMethod -Djava.util.logging.config.file=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/tools/junit4/logging.properties -Dtests.nightly=false -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=2 -DtempDir=./temp -Djava.io.tmpdir=./temp -Djunit4.tempDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp -Dcommon.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene -Dclover.db.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/clover/db -Djava.security.policy=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/tools/junit4/tests.policy -Dtests.LUCENE_VERSION=7.2.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Dtests.src.home=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x -Djava.security.egd=file:/dev/./urandom -Djunit4.childvm.cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/J2 -Djunit4.childvm.id=2 -Djunit4.childvm.count=3 -Dtests.leaveTemporary=false -Dtests.filterstacks=true -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Dfile.encoding=US-ASCII -classpath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/codecs/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/test-framework/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/test-framework/lib/junit-4.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/test-framework/lib/randomizedtesting-runner-2.5.3.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/classes/test:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.4.0.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-log4j.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit4.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jai.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-javamail.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bsf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-net.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-antlr.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jsch.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-oro.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-logging.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-netrexx.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-testutil.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jdepend.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bcel.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-xalan2.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-resolver.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jmf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-regexp.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-swing.jar:/usr/local/asfpackages/java/jdk1.8.0_144/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.5.3.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J2-20171104_201150_4684647276467736297938.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J2-20171104_201150_4682088718066003030943.suites -stdin
   [junit4] ERROR: JVM J2 ended with an exception: Forked process returned with error code: 1. Very likely a JVM crash.  See process stdout at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J2-20171104_201150_4682700656333009887283.sysout See process stderr at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J2-20171104_201150_4686290253823793317798.syserr
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1519)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:126)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:982)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:979)
   [junit4] 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4] 	at java.lang.Thread.run(Thread.java:748)

BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:835: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:779: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build.xml:50: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/common-build.xml:1512: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/common-build.xml:1038: At least one slave process threw an exception, first: Forked process returned with error code: 1. Very likely a JVM crash.  See process stdout at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_201150_4683587702659080023037.sysout See process stderr at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_201150_4688240968023194733672.syserr

Total time: 50 minutes 0 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[Fast Archiver] No artifacts from Lucene-Solr-Tests-7.x #218 to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene-Solr-Tests-7.x - Build # 221 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/221/

All tests passed

Build Log:
[...truncated 947 lines...]
   [junit4] JVM J0: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_185041_0872790672236780767749.sysout
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] #
   [junit4] # There is insufficient memory for the Java Runtime Environment to continue.
   [junit4] # Native memory allocation (mmap) failed to map 98566144 bytes for committing reserved memory.
   [junit4] # An error report file with more information is saved as:
   [junit4] # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/J0/hs_err_pid8137.log
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_185041_0874261868065627693869.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x00000000e8180000, 98566144, 0) failed; error='Cannot allocate memory' (errno=12)
   [junit4] <<< JVM J0: EOF ----

[...truncated 732 lines...]
   [junit4] ERROR: JVM J0 ended with an exception, command line: /usr/local/asfpackages/java/jdk1.8.0_144/jre/bin/java -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/heapdumps -ea -esa -Dtests.prefix=tests -Dtests.seed=BC739D0BE63FF7D -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=7.2.0 -Dtests.cleanthreads=perMethod -Djava.util.logging.config.file=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/tools/junit4/logging.properties -Dtests.nightly=false -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=2 -DtempDir=./temp -Djava.io.tmpdir=./temp -Djunit4.tempDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp -Dcommon.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene -Dclover.db.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/clover/db -Djava.security.policy=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/tools/junit4/tests.policy -Dtests.LUCENE_VERSION=7.2.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Dtests.src.home=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x -Djava.security.egd=file:/dev/./urandom -Djunit4.childvm.cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/J0 -Djunit4.childvm.id=0 -Djunit4.childvm.count=3 -Dtests.leaveTemporary=false -Dtests.filterstacks=true -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -classpath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/codecs/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/test-framework/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/test-framework/lib/junit-4.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/test-framework/lib/randomizedtesting-runner-2.5.3.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/classes/test:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.4.0.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-log4j.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit4.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jai.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-javamail.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bsf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-net.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-antlr.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jsch.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-oro.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-logging.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-netrexx.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-testutil.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jdepend.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bcel.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-xalan2.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-resolver.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jmf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-regexp.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-swing.jar:/usr/local/asfpackages/java/jdk1.8.0_144/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.5.3.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_185041_0878926087738574617315.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_185041_0872840160582815732573.suites -stdin
   [junit4] ERROR: JVM J0 ended with an exception: Forked process returned with error code: 1. Very likely a JVM crash.  See process stdout at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_185041_0872790672236780767749.sysout See process stderr at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_185041_0874261868065627693869.syserr
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1519)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:126)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:982)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:979)
   [junit4] 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4] 	at java.lang.Thread.run(Thread.java:748)

BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:835: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:779: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build.xml:50: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/common-build.xml:1505: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/common-build.xml:1032: At least one slave process threw an exception, first: Forked process returned with error code: 1. Very likely a JVM crash.  See process stdout at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_185041_0872790672236780767749.sysout See process stderr at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_185041_0874261868065627693869.syserr

Total time: 46 minutes 12 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[Fast Archiver] No artifacts from Lucene-Solr-Tests-7.x #218 to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene-Solr-Tests-7.x - Build # 220 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/220/

All tests passed

Build Log:
[...truncated 1162 lines...]
   [junit4] JVM J0: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_165707_8479081727716544151930.sysout
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] #
   [junit4] # There is insufficient memory for the Java Runtime Environment to continue.
   [junit4] # Native memory allocation (mmap) failed to map 65536 bytes for committing reserved memory.
   [junit4] # An error report file with more information is saved as:
   [junit4] # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/J0/hs_err_pid17933.log
   [junit4] #
   [junit4] # Compiler replay data is saved as:
   [junit4] # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/J0/replay_pid17933.log
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_165707_8476361997695163894240.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x00007fbd5b7aa000, 65536, 1) failed; error='Cannot allocate memory' (errno=12)
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J2: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J2-20171104_165707_8405533570310458645231.sysout
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] #
   [junit4] # There is insufficient memory for the Java Runtime Environment to continue.
   [junit4] # Native memory allocation (mmap) failed to map 524288 bytes for committing reserved memory.
   [junit4] # An error report file with more information is saved as:
   [junit4] # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/J2/hs_err_pid17932.log
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J2-20171104_165707_8407425109561372689955.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x00000000ffd80000, 524288, 0) failed; error='Cannot allocate memory' (errno=12)
   [junit4] <<< JVM J2: EOF ----

[...truncated 575 lines...]
   [junit4] ERROR: JVM J0 ended with an exception, command line: /usr/local/asfpackages/java/jdk1.8.0_144/jre/bin/java -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/heapdumps -ea -esa -Dtests.prefix=tests -Dtests.seed=4DE8B7116986413E -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=7.2.0 -Dtests.cleanthreads=perMethod -Djava.util.logging.config.file=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/tools/junit4/logging.properties -Dtests.nightly=false -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=2 -DtempDir=./temp -Djava.io.tmpdir=./temp -Djunit4.tempDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp -Dcommon.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene -Dclover.db.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/clover/db -Djava.security.policy=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/tools/junit4/tests.policy -Dtests.LUCENE_VERSION=7.2.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Dtests.src.home=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x -Djava.security.egd=file:/dev/./urandom -Djunit4.childvm.cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/J0 -Djunit4.childvm.id=0 -Djunit4.childvm.count=3 -Dtests.leaveTemporary=false -Dtests.filterstacks=true -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Dfile.encoding=UTF-8 -classpath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/codecs/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/test-framework/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/test-framework/lib/junit-4.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/test-framework/lib/randomizedtesting-runner-2.5.3.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/classes/test:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.4.0.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-log4j.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit4.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jai.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-javamail.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bsf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-net.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-antlr.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jsch.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-oro.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-logging.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-netrexx.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-testutil.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jdepend.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bcel.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-xalan2.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-resolver.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jmf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-regexp.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-swing.jar:/usr/local/asfpackages/java/jdk1.8.0_144/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.5.3.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_165707_8479108147373285568890.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_165707_8476150207952668181813.suites -stdin
   [junit4] ERROR: JVM J0 ended with an exception: Forked process returned with error code: 1. Very likely a JVM crash.  See process stdout at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_165707_8479081727716544151930.sysout See process stderr at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_165707_8476361997695163894240.syserr
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1519)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:126)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:982)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:979)
   [junit4] 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4] 	at java.lang.Thread.run(Thread.java:748)
   [junit4] ERROR: JVM J2 ended with an exception, command line: /usr/local/asfpackages/java/jdk1.8.0_144/jre/bin/java -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/heapdumps -ea -esa -Dtests.prefix=tests -Dtests.seed=4DE8B7116986413E -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=7.2.0 -Dtests.cleanthreads=perMethod -Djava.util.logging.config.file=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/tools/junit4/logging.properties -Dtests.nightly=false -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=2 -DtempDir=./temp -Djava.io.tmpdir=./temp -Djunit4.tempDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp -Dcommon.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene -Dclover.db.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/clover/db -Djava.security.policy=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/tools/junit4/tests.policy -Dtests.LUCENE_VERSION=7.2.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Dtests.src.home=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x -Djava.security.egd=file:/dev/./urandom -Djunit4.childvm.cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/J2 -Djunit4.childvm.id=2 -Djunit4.childvm.count=3 -Dtests.leaveTemporary=false -Dtests.filterstacks=true -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Dfile.encoding=UTF-8 -classpath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/codecs/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/test-framework/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/test-framework/lib/junit-4.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/test-framework/lib/randomizedtesting-runner-2.5.3.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/classes/test:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.4.0.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-log4j.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit4.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jai.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-javamail.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bsf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-net.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-antlr.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jsch.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-oro.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-logging.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-netrexx.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-testutil.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jdepend.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bcel.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-xalan2.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-resolver.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jmf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-regexp.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-swing.jar:/usr/local/asfpackages/java/jdk1.8.0_144/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.5.3.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J2-20171104_165707_8405760989839451236459.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J2-20171104_165707_8403369049568153939136.suites -stdin
   [junit4] ERROR: JVM J2 ended with an exception: Forked process returned with error code: 1. Very likely a JVM crash.  See process stdout at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J2-20171104_165707_8405533570310458645231.sysout See process stderr at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J2-20171104_165707_8407425109561372689955.syserr
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1519)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:126)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:982)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:979)
   [junit4] 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4] 	at java.lang.Thread.run(Thread.java:748)

BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:826: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:770: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build.xml:50: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/common-build.xml:1505: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/common-build.xml:1032: At least one slave process threw an exception, first: Forked process returned with error code: 1. Very likely a JVM crash.  See process stdout at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_165707_8479081727716544151930.sysout See process stderr at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_165707_8476361997695163894240.syserr

Total time: 48 minutes 34 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[Fast Archiver] No artifacts from Lucene-Solr-Tests-7.x #218 to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene-Solr-Tests-7.x - Build # 219 - Failure

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/219/

All tests passed

Build Log:
[...truncated 950 lines...]
   [junit4] JVM J0: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_150853_6114648412633339833263.sysout
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] #
   [junit4] # There is insufficient memory for the Java Runtime Environment to continue.
   [junit4] # Native memory allocation (mmap) failed to map 98041856 bytes for committing reserved memory.
   [junit4] # An error report file with more information is saved as:
   [junit4] # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/J0/hs_err_pid28547.log
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_150853_6116080349967986187558.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x00000000e7800000, 98041856, 0) failed; error='Cannot allocate memory' (errno=12)
   [junit4] <<< JVM J0: EOF ----

[...truncated 808 lines...]
   [junit4] ERROR: JVM J0 ended with an exception, command line: /usr/local/asfpackages/java/jdk1.8.0_144/jre/bin/java -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/heapdumps -ea -esa -Dtests.prefix=tests -Dtests.seed=E3C9E02F95E2E688 -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=7.2.0 -Dtests.cleanthreads=perMethod -Djava.util.logging.config.file=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/tools/junit4/logging.properties -Dtests.nightly=false -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=2 -DtempDir=./temp -Djava.io.tmpdir=./temp -Djunit4.tempDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp -Dcommon.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene -Dclover.db.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/clover/db -Djava.security.policy=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/tools/junit4/tests.policy -Dtests.LUCENE_VERSION=7.2.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Dtests.src.home=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x -Djava.security.egd=file:/dev/./urandom -Djunit4.childvm.cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/J0 -Djunit4.childvm.id=0 -Djunit4.childvm.count=3 -Dtests.leaveTemporary=false -Dtests.filterstacks=true -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Dfile.encoding=UTF-8 -classpath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/codecs/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/test-framework/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/test-framework/lib/junit-4.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/test-framework/lib/randomizedtesting-runner-2.5.3.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/classes/test:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.4.0.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-log4j.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit4.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jai.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-javamail.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bsf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-net.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-antlr.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jsch.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-oro.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-logging.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-netrexx.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-testutil.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jdepend.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bcel.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-xalan2.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-resolver.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jmf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-regexp.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-swing.jar:/usr/local/asfpackages/java/jdk1.8.0_144/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.5.3.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_150853_6116076564497621096574.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_150853_6116729165991986220417.suites -stdin
   [junit4] ERROR: JVM J0 ended with an exception: Forked process returned with error code: 1. Very likely a JVM crash.  See process stdout at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_150853_6114648412633339833263.sysout See process stderr at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_150853_6116080349967986187558.syserr
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1519)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:126)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:982)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:979)
   [junit4] 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4] 	at java.lang.Thread.run(Thread.java:748)

BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:826: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:770: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build.xml:50: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/common-build.xml:1505: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/common-build.xml:1032: At least one slave process threw an exception, first: Forked process returned with error code: 1. Very likely a JVM crash.  See process stdout at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_150853_6114648412633339833263.sysout See process stderr at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/lucene/build/core/test/temp/junit4-J0-20171104_150853_6116080349967986187558.syserr

Total time: 51 minutes 6 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[Fast Archiver] No artifacts from Lucene-Solr-Tests-7.x #218 to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene-Solr-Tests-7.x - Build # 218 - Still unstable

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-7.x/218/

2 tests failed.
FAILED:  org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test

Error Message:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:46787/c8n_1x3_lf_shard1_replica_n2

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:46787/c8n_1x3_lf_shard1_replica_n2
	at __randomizedtesting.SeedInfo.seed([EA9FDB590618BC3B:62CBE483A8E4D1C3]:0)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:557)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1008)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.sendDocsWithRetry(AbstractFullDistribZkTestBase.java:796)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.sendDocsWithRetry(AbstractFullDistribZkTestBase.java:784)
	at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.testRf3WithLeaderFailover(LeaderFailoverAfterPartitionTest.java:177)
	at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test(LeaderFailoverAfterPartitionTest.java:56)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:46787/c8n_1x3_lf_shard1_replica_n2
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:654)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:551)
	... 48 more
Caused by: java.net.SocketTimeoutException: Read timed out
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:171)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
	at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
	at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
	at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542)
	... 53 more


FAILED:  org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testEventQueue

Error Message:
action wasn't interrupted

Stack Trace:
java.lang.AssertionError: action wasn't interrupted
	at __randomizedtesting.SeedInfo.seed([EA9FDB590618BC3B:232A99F70F7F7ACE]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testEventQueue(TriggerIntegrationTest.java:689)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 11793 lines...]
   [junit4] Suite: org.apache.solr.cloud.LeaderFailoverAfterPartitionTest
   [junit4]   2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/init-core-data-001
   [junit4]   2> 747967 WARN  (SUITE-LeaderFailoverAfterPartitionTest-seed#[EA9FDB590618BC3B]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=5 numCloses=5
   [junit4]   2> 747967 INFO  (SUITE-LeaderFailoverAfterPartitionTest-seed#[EA9FDB590618BC3B]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 747968 INFO  (SUITE-LeaderFailoverAfterPartitionTest-seed#[EA9FDB590618BC3B]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 747968 INFO  (SUITE-LeaderFailoverAfterPartitionTest-seed#[EA9FDB590618BC3B]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 747968 INFO  (SUITE-LeaderFailoverAfterPartitionTest-seed#[EA9FDB590618BC3B]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 748039 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 748058 INFO  (Thread-748) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 748058 INFO  (Thread-748) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 748167 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.ZkTestServer start zk server on port:40719
   [junit4]   2> 748176 ERROR (Thread-748) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 748439 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 748455 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 748473 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 748474 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 748474 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 748475 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 748509 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 748510 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 748511 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 748511 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 748526 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 748533 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
   [junit4]   2> 750336 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 750424 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7c4ef263{/,null,AVAILABLE}
   [junit4]   2> 750474 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@5c4a62{HTTP/1.1,[http/1.1]}{127.0.0.1:34618}
   [junit4]   2> 750474 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.e.j.s.Server Started @762937ms
   [junit4]   2> 750474 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/tempDir-001/control/data, hostContext=/, hostPort=45033, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/control-001/cores}
   [junit4]   2> 750474 ERROR (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 750474 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 750474 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 750474 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 750475 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-04T11:55:03.862Z
   [junit4]   2> 750612 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 750612 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/control-001/solr.xml
   [junit4]   2> 750650 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 750650 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 756644 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@2d474cb5, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 756751 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40719/solr
   [junit4]   2> 757596 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:45033_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 757608 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:45033_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45033_
   [junit4]   2> 757609 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:45033_    ] o.a.s.c.Overseer Overseer (id=98946023521583108-127.0.0.1:45033_-n_0000000000) starting
   [junit4]   2> 757694 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:45033_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45033_
   [junit4]   2> 757767 INFO  (OverseerStateUpdate-98946023521583108-127.0.0.1:45033_-n_0000000000) [n:127.0.0.1:45033_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 758032 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:45033_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2d474cb5
   [junit4]   2> 758069 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:45033_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2d474cb5
   [junit4]   2> 758069 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:45033_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2d474cb5
   [junit4]   2> 758070 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:45033_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/control-001/cores
   [junit4]   2> 758455 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 758455 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40719/solr ready
   [junit4]   2> 758471 INFO  (SocketProxy-Acceptor-45033) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=57728,localport=45033], receiveBufferSize:531000
   [junit4]   2> 758528 INFO  (SocketProxy-Acceptor-45033) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=34618,localport=59186], receiveBufferSize=530904
   [junit4]   2> 758545 INFO  (qtp1073813646-2126) [n:127.0.0.1:45033_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:45033_&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 758638 INFO  (OverseerThreadFactory-1071-thread-1-processing-n:127.0.0.1:45033_) [n:127.0.0.1:45033_    ] o.a.s.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 758749 INFO  (SocketProxy-Acceptor-45033) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=57732,localport=45033], receiveBufferSize:531000
   [junit4]   2> 758750 INFO  (SocketProxy-Acceptor-45033) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=34618,localport=59190], receiveBufferSize=530904
   [junit4]   2> 758776 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 758776 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 759069 INFO  (zkCallback-247-thread-1-processing-n:127.0.0.1:45033_) [n:127.0.0.1:45033_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 760174 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 760283 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 764972 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 765082 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 765082 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2d474cb5
   [junit4]   2> 765083 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 765116 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 765119 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=40, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2779659765120155]
   [junit4]   2> 765135 WARN  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 765482 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 765482 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 765483 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 765483 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 765484 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=32, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8985562952811531]
   [junit4]   2> 765485 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@216acc6f[control_collection_shard1_replica_n1] main]
   [junit4]   2> 765499 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 765499 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 765500 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 765516 INFO  (searcherExecutor-1074-thread-1-processing-n:127.0.0.1:45033_ x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@216acc6f[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 765519 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583136394608377856
   [junit4]   2> 765522 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 765522 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 765522 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:45033/control_collection_shard1_replica_n1/
   [junit4]   2> 765522 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 765522 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:45033/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 765522 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 765572 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:45033/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 765653 INFO  (zkCallback-247-thread-2-processing-n:127.0.0.1:45033_) [n:127.0.0.1:45033_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 765682 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 765683 INFO  (qtp1073813646-2124) [n:127.0.0.1:45033_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=6907
   [junit4]   2> 765760 INFO  (qtp1073813646-2126) [n:127.0.0.1:45033_    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 765889 INFO  (zkCallback-247-thread-1-processing-n:127.0.0.1:45033_) [n:127.0.0.1:45033_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 766564 INFO  (OverseerCollectionConfigSetProcessor-98946023521583108-127.0.0.1:45033_-n_0000000000) [n:127.0.0.1:45033_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 766763 INFO  (qtp1073813646-2126) [n:127.0.0.1:45033_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:45033_&wt=javabin&version=2} status=0 QTime=8218
   [junit4]   2> 766803 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 766804 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40719/solr ready
   [junit4]   2> 766804 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 766837 INFO  (SocketProxy-Acceptor-45033) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=57740,localport=45033], receiveBufferSize:531000
   [junit4]   2> 766857 INFO  (SocketProxy-Acceptor-45033) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=34618,localport=59198], receiveBufferSize=530904
   [junit4]   2> 766858 INFO  (qtp1073813646-2127) [n:127.0.0.1:45033_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 766930 INFO  (OverseerThreadFactory-1071-thread-2-processing-n:127.0.0.1:45033_) [n:127.0.0.1:45033_    ] o.a.s.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 766983 WARN  (OverseerThreadFactory-1071-thread-2-processing-n:127.0.0.1:45033_) [n:127.0.0.1:45033_    ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 767264 INFO  (qtp1073813646-2127) [n:127.0.0.1:45033_    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 767264 INFO  (qtp1073813646-2127) [n:127.0.0.1:45033_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=406
   [junit4]   2> 768947 INFO  (OverseerCollectionConfigSetProcessor-98946023521583108-127.0.0.1:45033_-n_0000000000) [n:127.0.0.1:45033_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 769090 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/shard-1-001 of type NRT
   [junit4]   2> 769091 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 769166 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@65d2427a{/,null,AVAILABLE}
   [junit4]   2> 769166 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@2710ac7b{HTTP/1.1,[http/1.1]}{127.0.0.1:34949}
   [junit4]   2> 769166 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.e.j.s.Server Started @781629ms
   [junit4]   2> 769166 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=46787, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/shard-1-001/cores}
   [junit4]   2> 769166 ERROR (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 769166 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 769216 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 769216 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 769216 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-04T11:55:22.603Z
   [junit4]   2> 769391 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 769391 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/shard-1-001/solr.xml
   [junit4]   2> 769437 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 769437 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 769438 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@2d474cb5, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 769494 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40719/solr
   [junit4]   2> 769731 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:46787_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 769749 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:46787_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 769750 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:46787_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46787_
   [junit4]   2> 769751 INFO  (zkCallback-255-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 769858 INFO  (zkCallback-247-thread-2-processing-n:127.0.0.1:45033_) [n:127.0.0.1:45033_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 769932 INFO  (zkCallback-260-thread-1-processing-n:127.0.0.1:46787_) [n:127.0.0.1:46787_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 770556 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:46787_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2d474cb5
   [junit4]   2> 770608 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:46787_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2d474cb5
   [junit4]   2> 770609 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:46787_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2d474cb5
   [junit4]   2> 770627 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:46787_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/shard-1-001/cores
   [junit4]   2> 776725 WARN  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]-SendThread(127.0.0.1:40719)) [    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 6974ms for sessionid 0x15f86e257f10006
   [junit4]   2> 776742 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f86e257f10006, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 776833 INFO  (qtp1073813646-2123) [n:127.0.0.1:45033_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:46787_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 776835 INFO  (OverseerThreadFactory-1071-thread-3-processing-n:127.0.0.1:45033_) [n:127.0.0.1:45033_    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:46787_ for creating new replica
   [junit4]   2> 776869 WARN  (zkCallback-255-thread-3) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7c094b8c name: ZooKeeperConnection Watcher:127.0.0.1:40719/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
   [junit4]   2> 776869 WARN  (zkCallback-255-thread-3) [    ] o.a.s.c.c.ConnectionManager zkClient has disconnected
   [junit4]   2> 776877 INFO  (SocketProxy-Acceptor-46787) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=44554,localport=46787], receiveBufferSize:531000
   [junit4]   2> 776922 INFO  (SocketProxy-Acceptor-46787) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=34949,localport=48596], receiveBufferSize=530904
   [junit4]   2> 776959 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 776960 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 778096 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 778281 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema [collection1_shard2_replica_n41] Schema name=test
   [junit4]   2> 785103 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 785199 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n41' using configuration from collection collection1, trusted=true
   [junit4]   2> 785212 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n41' (registry 'solr.core.collection1.shard2.replica_n41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2d474cb5
   [junit4]   2> 785212 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 785212 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [[collection1_shard2_replica_n41] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/shard-1-001/cores/collection1_shard2_replica_n41], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/shard-1-001/cores/collection1_shard2_replica_n41/data/]
   [junit4]   2> 785232 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=40, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2779659765120155]
   [junit4]   2> 785270 WARN  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 785631 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 785631 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 785632 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 785632 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 785633 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=32, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8985562952811531]
   [junit4]   2> 785633 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.SolrIndexSearcher Opening [Searcher@1d3cdb50[collection1_shard2_replica_n41] main]
   [junit4]   2> 785643 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 785644 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 785644 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 785644 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583136415710969856
   [junit4]   2> 785717 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 785717 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 785717 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46787/collection1_shard2_replica_n41/
   [junit4]   2> 785717 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 785718 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy http://127.0.0.1:46787/collection1_shard2_replica_n41/ has no replicas
   [junit4]   2> 785718 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 785720 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:46787/collection1_shard2_replica_n41/ shard2
   [junit4]   2> 785725 INFO  (searcherExecutor-1085-thread-1-processing-n:127.0.0.1:46787_ x:collection1_shard2_replica_n41 s:shard2 c:collection1) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [collection1_shard2_replica_n41] Registered new searcher Searcher@1d3cdb50[collection1_shard2_replica_n41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 785826 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 785827 INFO  (qtp1317127777-2180) [n:127.0.0.1:46787_ c:collection1 s:shard2  x:collection1_shard2_replica_n41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=8867
   [junit4]   2> 785844 INFO  (qtp1073813646-2123) [n:127.0.0.1:45033_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:46787_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=9011
   [junit4]   2> 786810 INFO  (OverseerCollectionConfigSetProcessor-98946023521583108-127.0.0.1:45033_-n_0000000000) [n:127.0.0.1:45033_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 787030 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/shard-2-001 of type NRT
   [junit4]   2> 787031 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 787140 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2d81f8c{/,null,AVAILABLE}
   [junit4]   2> 787140 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@7575dc2c{HTTP/1.1,[http/1.1]}{127.0.0.1:39497}
   [junit4]   2> 787140 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.e.j.s.Server Started @799603ms
   [junit4]   2> 787140 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/tempDir-001/jetty2, solrconfig=solrconfig.xml, hostContext=/, hostPort=44329, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/shard-2-001/cores}
   [junit4]   2> 787140 ERROR (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 787141 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 787141 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 787141 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 787141 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-04T11:55:40.528Z
   [junit4]   2> 787162 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 787162 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/shard-2-001/solr.xml
   [junit4]   2> 787198 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 787198 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 787199 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@2d474cb5, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 787334 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40719/solr
   [junit4]   2> 787445 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:44329_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 787447 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:44329_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 787481 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:44329_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44329_
   [junit4]   2> 787482 INFO  (zkCallback-255-thread-3) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 787482 INFO  (zkCallback-260-thread-1-processing-n:127.0.0.1:46787_) [n:127.0.0.1:46787_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 787517 INFO  (zkCallback-247-thread-1-processing-n:127.0.0.1:45033_) [n:127.0.0.1:45033_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 787517 INFO  (zkCallback-266-thread-1-processing-n:127.0.0.1:44329_) [n:127.0.0.1:44329_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 787958 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:44329_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2d474cb5
   [junit4]   2> 788067 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:44329_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2d474cb5
   [junit4]   2> 788067 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:44329_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2d474cb5
   [junit4]   2> 788102 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:44329_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/shard-2-001/cores
   [junit4]   2> 788557 INFO  (SocketProxy-Acceptor-44329) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=50102,localport=44329], receiveBufferSize:531000
   [junit4]   2> 788595 INFO  (SocketProxy-Acceptor-44329) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=39497,localport=49152], receiveBufferSize=530904
   [junit4]   2> 788631 INFO  (qtp1640265028-2217) [n:127.0.0.1:44329_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:44329_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 788704 INFO  (OverseerThreadFactory-1071-thread-4-processing-n:127.0.0.1:45033_) [n:127.0.0.1:45033_    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:44329_ for creating new replica
   [junit4]   2> 788705 INFO  (SocketProxy-Acceptor-44329) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=50106,localport=44329], receiveBufferSize:531000
   [junit4]   2> 788706 INFO  (SocketProxy-Acceptor-44329) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=39497,localport=49156], receiveBufferSize=530904
   [junit4]   2> 788814 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 788814 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 788997 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 789362 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema [collection1_shard1_replica_n43] Schema name=test
   [junit4]   2> 803780 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 803779 WARN  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]-SendThread(127.0.0.1:40719)) [n:127.0.0.1:44329_    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 13832ms for sessionid 0x15f86e257f1000c
   [junit4]   2> 803801 WARN  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]-SendThread(127.0.0.1:40719)) [n:127.0.0.1:45033_    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 14862ms for sessionid 0x15f86e257f10004
   [junit4]   2> 803801 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f86e257f1000c, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 803801 WARN  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]-SendThread(127.0.0.1:40719)) [    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 14971ms for sessionid 0x15f86e257f10006
   [junit4]   2> 803801 WARN  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]-SendThread(127.0.0.1:40719)) [n:127.0.0.1:46787_    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 14971ms for sessionid 0x15f86e257f10009
   [junit4]   2> 803966 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f86e257f10009, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 803966 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f86e257f10004, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 803959 WARN  (zkCallback-266-thread-2-processing-n:127.0.0.1:44329_) [n:127.0.0.1:44329_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1d14d0fc name: ZooKeeperConnection Watcher:127.0.0.1:40719/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
   [junit4]   2> 803976 WARN  (zkCallback-266-thread-2-processing-n:127.0.0.1:44329_) [n:127.0.0.1:44329_    ] o.a.s.c.c.ConnectionManager zkClient has disconnected
   [junit4]   2> 804008 WARN  (zkCallback-247-thread-3-processing-n:127.0.0.1:45033_) [n:127.0.0.1:45033_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1d1dd0e9 name: ZooKeeperConnection Watcher:127.0.0.1:40719/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
   [junit4]   2> 804008 WARN  (zkCallback-247-thread-3-processing-n:127.0.0.1:45033_) [n:127.0.0.1:45033_    ] o.a.s.c.c.ConnectionManager zkClient has disconnected
   [junit4]   2> 804020 WARN  (zkCallback-260-thread-1-processing-n:127.0.0.1:46787_) [n:127.0.0.1:46787_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1b6013a7 name: ZooKeeperConnection Watcher:127.0.0.1:40719/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
   [junit4]   2> 804020 WARN  (zkCallback-260-thread-1-processing-n:127.0.0.1:46787_) [n:127.0.0.1:46787_    ] o.a.s.c.c.ConnectionManager zkClient has disconnected
   [junit4]   2> 804037 WARN  (zkCallback-255-thread-2) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7c094b8c name: ZooKeeperConnection Watcher:127.0.0.1:40719/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
   [junit4]   2> 804037 WARN  (zkCallback-255-thread-2) [    ] o.a.s.c.c.ConnectionManager zkClient has disconnected
   [junit4]   2> 805695 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n43' using configuration from collection collection1, trusted=true
   [junit4]   2> 805731 WARN  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]-SendThread(127.0.0.1:40719)) [    ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x15f86e257f10006 has expired
   [junit4]   2> 805731 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n43' (registry 'solr.core.collection1.shard1.replica_n43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2d474cb5
   [junit4]   2> 805731 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 805732 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [[collection1_shard1_replica_n43] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/shard-2-001/cores/collection1_shard1_replica_n43], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/shard-2-001/cores/collection1_shard1_replica_n43/data/]
   [junit4]   2> 805741 WARN  (zkCallback-255-thread-3) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7c094b8c name: ZooKeeperConnection Watcher:127.0.0.1:40719/solr got event WatchedEvent state:Expired type:None path:null path: null type: None
   [junit4]   2> 805741 WARN  (zkCallback-255-thread-3) [    ] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
   [junit4]   2> 805741 WARN  (zkCallback-255-thread-3) [    ] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one...
   [junit4]   2> 805824 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=40, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2779659765120155]
   [junit4]   2> 805840 WARN  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 805866 INFO  (zkCallback-255-thread-3) [    ] o.a.s.c.c.ConnectionManager Connection with ZooKeeper reestablished.
   [junit4]   2> 805943 INFO  (zkCallback-255-thread-3) [    ] o.a.s.c.c.DefaultConnectionStrategy Reconnected to ZooKeeper
   [junit4]   2> 805943 INFO  (zkCallback-255-thread-3) [    ] o.a.s.c.c.ConnectionManager Connected:true
   [junit4]   2> 806270 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 806270 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 806271 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 806271 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 806290 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=32, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8985562952811531]
   [junit4]   2> 806290 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.s.SolrIndexSearcher Opening [Searcher@3d582fb2[collection1_shard1_replica_n43] main]
   [junit4]   2> 806363 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 806363 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 806364 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 806364 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1583136437437464576
   [junit4]   2> 806367 INFO  (searcherExecutor-1096-thread-1-processing-n:127.0.0.1:44329_ x:collection1_shard1_replica_n43 s:shard1 c:collection1) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [collection1_shard1_replica_n43] Registered new searcher Searcher@3d582fb2[collection1_shard1_replica_n43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 806401 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 806401 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 806401 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:44329/collection1_shard1_replica_n43/
   [junit4]   2> 806401 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 806401 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy http://127.0.0.1:44329/collection1_shard1_replica_n43/ has no replicas
   [junit4]   2> 806401 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 806436 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:44329/collection1_shard1_replica_n43/ shard1
   [junit4]   2> 806509 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 806511 INFO  (qtp1640265028-2215) [n:127.0.0.1:44329_ c:collection1 s:shard1  x:collection1_shard1_replica_n43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=17697
   [junit4]   2> 806588 INFO  (qtp1640265028-2217) [n:127.0.0.1:44329_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:44329_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=17956
   [junit4]   2> 807424 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/shard-3-001 of type NRT
   [junit4]   2> 807424 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 807541 INFO  (OverseerCollectionConfigSetProcessor-98946023521583108-127.0.0.1:45033_-n_0000000000) [n:127.0.0.1:45033_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 807643 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@57de6972{/,null,AVAILABLE}
   [junit4]   2> 807643 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@7c1a98d8{HTTP/1.1,[http/1.1]}{127.0.0.1:38308}
   [junit4]   2> 807643 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.e.j.s.Server Started @820105ms
   [junit4]   2> 807643 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/tempDir-001/jetty3, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/, hostPort=34505, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/shard-3-001/cores}
   [junit4]   2> 807643 ERROR (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 807643 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.2.0
   [junit4]   2> 807643 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 807643 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 807643 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-11-04T11:56:01.030Z
   [junit4]   2> 807754 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 807754 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/shard-3-001/solr.xml
   [junit4]   2> 807811 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 807811 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 807812 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@2d474cb5, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 807898 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40719/solr
   [junit4]   2> 808193 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:34505_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 808212 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:34505_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 808213 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:34505_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34505_
   [junit4]   2> 808214 INFO  (zkCallback-260-thread-4-processing-n:127.0.0.1:46787_) [n:127.0.0.1:46787_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 808248 INFO  (zkCallback-255-thread-3) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 808264 INFO  (zkCallback-266-thread-5-processing-n:127.0.0.1:44329_) [n:127.0.0.1:44329_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 808284 INFO  (zkCallback-247-thread-6-processing-n:127.0.0.1:45033_) [n:127.0.0.1:45033_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 808301 INFO  (zkCallback-272-thread-1-processing-n:127.0.0.1:34505_) [n:127.0.0.1:34505_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 808996 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:34505_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2d474cb5
   [junit4]   2> 809144 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:34505_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2d474cb5
   [junit4]   2> 809144 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:34505_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2d474cb5
   [junit4]   2> 809214 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[EA9FDB590618BC3B]) [n:127.0.0.1:34505_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/shard-3-001/cores
   [junit4]   2> 809763 INFO  (SocketProxy-Acceptor-34505) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=39450,localport=34505], receiveBufferSize:531000
   [junit4]   2> 809820 INFO  (SocketProxy-Acceptor-34505) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=38308,localport=47456], receiveBufferSize=530904
   [junit4]   2> 809896 INFO  (qtp1054789277-2270) [n:127.0.0.1:34505_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:34505_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 809966 INFO  (OverseerThreadFactory-1071-thread-5-processing-n:127.0.0.1:45033_) [n:127.0.0.1:45033_    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:34505_ for creating new replica
   [junit4]   2> 809968 INFO  (SocketProxy-Acceptor-34505) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=39454,localport=34505], receiveBufferSize:531000
   [junit4]   2> 810006 INFO  (SocketProxy-Acceptor-34505) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=38308,localport=47460], receiveBufferSize=530904
   [junit4]   2> 810056 INFO  (qtp1054789277-2268) [n:127.0.0.1:34505_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 810057 INFO  (qtp1054789277-2268) [n:127.0.0.1:34505_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 811184 INFO  (qtp1054789277-2268) [n:127.0.0.1:34505_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.2.0
   [junit4]   2> 811345 INFO  (qtp1054789277-2268) [n:127.0.0.1:34505_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.s.IndexSchema [collection1_shard2_replica_n45] Schema name=test
   [junit4]   2> 812929 INFO  (qtp1054789277-2268) [n:127.0.0.1:34505_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 813308 INFO  (qtp1054789277-2268) [n:127.0.0.1:34505_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n45' using configuration from collection collection1, trusted=true
   [junit4]   2> 813310 INFO  (qtp1054789277-2268) [n:127.0.0.1:34505_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n45' (registry 'solr.core.collection1.shard2.replica_n45') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2d474cb5
   [junit4]   2> 813310 INFO  (qtp1054789277-2268) [n:127.0.0.1:34505_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 813311 INFO  (qtp1054789277-2268) [n:127.0.0.1:34505_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.c.SolrCore [[collection1_shard2_replica_n45] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/shard-3-001/cores/collection1_shard2_replica_n45], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_EA9FDB590618BC3B-001/shard-3-001/cores/collection1_shard2_replica_n45/data/]
   [junit4]   2> 813362 INFO  (qtp1054789277-2268) [n:127.0.0.1:34505_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=40, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2779659765120155]
   [junit4]   2> 813435 WARN  (qtp1054789277-2268) [n:127.0.0.1:34505_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 814132 INFO  (qtp1054789277-2268) [n:127.0.0.1:34505_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 814132 INFO  (qtp1054789277-2268) [n:127.0.0.1:34505_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 814268 INFO  (qtp1054789277-2268) [n:127.0.0.1:34505_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 814268 INFO  (qtp1054789277-2268) [n:127.0.0.1:34505_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 814304 INFO  (qtp1054789277-2268) [n:127.0.0.1:34505_ c:collection1 s:shard2  x:collection1_shard2_replica_n45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=32, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFS

[...truncated too long message...]

or registry=solr.cluster, tag=null
   [junit4]   2> 5940188 INFO  (jetty-closer-2728-thread-3) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 5940151 INFO  (jetty-closer-2728-thread-4) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:37216_solr
   [junit4]   2> 5940151 INFO  (zkCallback-2870-thread-1-processing-n:127.0.0.1:42998_solr) [n:127.0.0.1:42998_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (4)
   [junit4]   2> 5940187 INFO  (jetty-closer-2728-thread-8) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 5940189 INFO  (jetty-closer-2728-thread-4) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 5940189 INFO  (jetty-closer-2728-thread-4) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 5940190 INFO  (zkCallback-2802-thread-2-processing-n:127.0.0.1:46045_solr) [n:127.0.0.1:46045_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 5940171 INFO  (zkCallback-2906-thread-2-processing-n:127.0.0.1:44846_solr) [n:127.0.0.1:44846_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (1)
   [junit4]   2> 5940171 INFO  (jetty-closer-2728-thread-5) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2ba4523e{/solr,null,UNAVAILABLE}
   [junit4]   2> 5940168 DEBUG (jetty-closer-2728-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 5940208 INFO  (zkCallback-2846-thread-2-processing-n:127.0.0.1:37216_solr) [n:127.0.0.1:37216_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 5940240 INFO  (jetty-closer-2728-thread-8) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@9227b75{/solr,null,UNAVAILABLE}
   [junit4]   2> 5940260 INFO  (jetty-closer-2728-thread-6) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@14202a47{/solr,null,UNAVAILABLE}
   [junit4]   2> 5940261 INFO  (jetty-closer-2728-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@40c489d0{/solr,null,UNAVAILABLE}
   [junit4]   2> 5940281 INFO  (jetty-closer-2728-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6e51fecb{/solr,null,UNAVAILABLE}
   [junit4]   2> 5941776 INFO  (jetty-closer-2728-thread-4) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@671aacbd{/solr,null,UNAVAILABLE}
   [junit4]   2> 5941777 ERROR (SUITE-TriggerIntegrationTest-seed#[EA9FDB590618BC3B]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 5941777 INFO  (SUITE-TriggerIntegrationTest-seed#[EA9FDB590618BC3B]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39714 39714
   [junit4]   2> 5941845 INFO  (Thread-4279) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39714 39714
   [junit4]   2> 5941845 WARN  (Thread-4279) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	41	/solr/aliases.json
   [junit4]   2> 	41	/solr/clusterprops.json
   [junit4]   2> 	16	/solr/security.json
   [junit4]   2> 	2	/solr/configs/conf
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	41	/solr/clusterstate.json
   [junit4]   2> 	17	/solr/collections/collection1/state.json
   [junit4]   2> 	6	/solr/autoscaling.json
   [junit4]   2> 	4	/solr/overseer_elect/election/98946354673549343-127.0.0.1:46045_solr-n_0000000006
   [junit4]   2> 	3	/solr/overseer_elect/election/98946354673549371-127.0.0.1:42998_solr-n_0000000012
   [junit4]   2> 	2	/solr/overseer_elect/election/98946354673549334-127.0.0.1:35919_solr-n_0000000004
   [junit4]   2> 	2	/solr/overseer_elect/election/98946354673549361-127.0.0.1:37216_solr-n_0000000010
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	41	/solr/live_nodes
   [junit4]   2> 	41	/solr/collections
   [junit4]   2> 	6	/solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 	6	/solr/overseer/queue
   [junit4]   2> 	6	/solr/overseer/collection-queue-work
   [junit4]   2> 	6	/solr/overseer/queue-work
   [junit4]   2> 	3	/solr/autoscaling/events/node_added_trigger
   [junit4]   2> 	2	/solr/autoscaling/events/node_lost_trigger
   [junit4]   2> 	2	/solr/autoscaling/events/node_added_trigger1
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-7.x/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_EA9FDB590618BC3B-001
   [junit4]   2> Nov 04, 2017 1:21:35 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1572, maxMBSortInHeap=6.535209798759785, sim=RandomSimilarity(queryNorm=false): {}, locale=sr-Latn-ME, timezone=GB
   [junit4]   2> NOTE: Linux 4.4.0-83-generic amd64/Oracle Corporation 1.8.0_152 (64-bit)/cpus=4,threads=1,free=242977104,total=520617984
   [junit4]   2> NOTE: All tests run in this JVM: [DocumentBuilderTest, TestFastOutputStream, TestSystemCollAutoCreate, TestCloudInspectUtil, TestReplicationHandler, TestExceedMaxTermLength, TestMultiValuedNumericRangeQuery, BitVectorTest, TestInitQParser, TestManagedSynonymFilterFactory, StatsReloadRaceTest, TestRandomFaceting, TestConfigReload, CollectionStateFormat2Test, RAMDirectoryFactoryTest, LeaderFailoverAfterPartitionTest, TestFieldTypeCollectionResource, AssignBackwardCompatibilityTest, FileUtilsTest, TestFilteredDocIdSet, CursorPagingTest, TestUtils, ZkControllerTest, TestMergePolicyConfig, JsonLoaderTest, TestCloudNestedDocsSort, TestNumericTerms64, TestCSVLoader, TestDynamicFieldResource, TestOverriddenPrefixQueryForCustomFieldType, TestPointFields, TestDelegationWithHadoopAuth, TestXmlQParser, URLClassifyProcessorTest, MinimalSchemaTest, OutOfBoxZkACLAndCredentialsProvidersTest, TestConfigsApi, TestExactStatsCache, SolrGraphiteReporterTest, TestMissingGroups, TestStressVersions, TestPostingsSolrHighlighter, TestFieldCacheWithThreads, ConjunctionSolrSpellCheckerTest, TestComponentsName, ForceLeaderTest, MetricsConfigTest, SliceStateTest, RestartWhileUpdatingTest, TestIndexingPerformance, CacheHeaderTest, TestSolrIndexConfig, SuggestComponentContextFilterQueryTest, CollectionsAPISolrJTest, ExternalFileFieldSortTest, TestInitParams, TestJsonFacets, TestBulkSchemaAPI, TestMaxTokenLenTokenizer, TestScoreJoinQPScore, SolrXmlInZkTest, RemoteQueryErrorTest, TestTrackingShardHandlerFactory, DocValuesTest, TermsComponentTest, TestSolrJ, TestUnifiedSolrHighlighter, UpdateParamsTest, TestSweetSpotSimilarityFactory, SimpleCollectionCreateDeleteTest, TestMacros, TestInPlaceUpdatesStandalone, TestReRankQParserPlugin, TestOnReconnectListenerSupport, DateFieldTest, TestSerializedLuceneMatchVersion, TestSuggestSpellingConverter, StatelessScriptUpdateProcessorFactoryTest, DateRangeFieldTest, TestSolrDeletionPolicy1, TermVectorComponentTest, TestSolrCLIRunExample, MergeStrategyTest, RuleEngineTest, TestCrossCoreJoin, TestBadConfig, TestClusterProperties, BasicAuthStandaloneTest, TestConfig, TestPKIAuthenticationPlugin, SyncSliceTest, HdfsThreadLeakTest, RegexBytesRefFilterTest, BasicZkTest, TestLegacyFieldReuse, TestRequestStatusCollectionAPI, TestHighFrequencyDictionaryFactory, TemplateUpdateProcessorTest, MoveReplicaTest, SolrCoreTest, TestReversedWildcardFilterFactory, DirectUpdateHandlerOptimizeTest, TestPHPSerializedResponseWriter, SaslZkACLProviderTest, SearchHandlerTest, TestBlendedInfixSuggestions, DistributedQueryElevationComponentTest, TestManagedResource, DistributedMLTComponentTest, HdfsRecoveryZkTest, TestConfigSetsAPI, TestUpdate, TestConfigOverlay, AutoscalingHistoryHandlerTest, NodeLostTriggerTest, CleanupOldIndexTest, TestWordDelimiterFilterFactory, CoreSorterTest, TestGeoJSONResponseWriter, TestIntervalFaceting, DistributedQueueTest, TestSolr4Spatial2, TestFaceting, TestRecovery, TestHashPartitioner, TestJoin, StatsComponentTest, SoftAutoCommitTest, SOLR749Test, TestQuerySenderNoQuery, ResponseLogComponentTest, MultiTermTest, SampleTest, TestBinaryField, TestSearchPerf, DirectSolrConnectionTest, NotRequiredUniqueKeyTest, TestPhraseSuggestions, TestXIncludeConfig, EchoParamsTest, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, TimeZoneUtilsTest, ResourceLoaderTest, ScriptEngineTest, PreAnalyzedFieldTest, DistributedIntervalFacetingTest, TestEmbeddedSolrServerAdminHandler, TestEmbeddedSolrServerSchemaAPI, TestJettySolrRunner, ActionThrottleTest, AliasIntegrationTest, CdcrReplicationHandlerTest, CdcrRequestHandlerTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, ConcurrentDeleteAndCreateCollectionTest, ConfigSetsAPITest, ConnectionManagerTest, CustomCollectionTest, DeleteShardTest, DistribCursorPagingTest, LeaderElectionContextKeyTest, LeaderFailureAfterFreshStartTest, MissingSegmentRecoveryTest, MoveReplicaHDFSTest, NodeMutatorTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerModifyCollectionTest, OverseerTaskQueueTest, ShardSplitTest, TestTolerantUpdateProcessorCloud, TlogReplayBufferedWhileIndexingTest, VMParamsZkACLAndCredentialsProvidersTest, ZkFailoverTest, ComputePlanActionTest, SystemLogListenerTest, TriggerIntegrationTest]
   [junit4] Completed [590/747 (2!)] on J0 in 141.82s, 12 tests, 1 failure <<< FAILURES!

[...truncated 47764 lines...]