You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2019/12/24 03:20:55 UTC

[JENKINS-EA] Lucene-Solr-BadApples-master-Linux (64bit/jdk-14-ea+27) - Build # 308 - Failure!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-BadApples-master-Linux/308/
Java: 64bit/jdk-14-ea+27 -XX:-UseCompressedOops -XX:+UseSerialGC

All tests passed

Build Log:
[...truncated 507 lines...]
   [junit4] JVM J2: stdout was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/core/test/temp/junit4-J2-20191224_030458_31715171859877218376594.sysout
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] #
   [junit4] # A fatal error has been detected by the Java Runtime Environment:
   [junit4] #
   [junit4] #  SIGSEGV (0xb) at pc=0x00007fbe776ba5a8, pid=12810, tid=13000
   [junit4] #
   [junit4] # JRE version: OpenJDK Runtime Environment (14.0+27) (build 14-ea+27-1339)
   [junit4] # Java VM: OpenJDK 64-Bit Server VM (14-ea+27-1339, mixed mode, tiered, serial gc, linux-amd64)
   [junit4] # Problematic frame:
   [junit4] # V  [libjvm.so+0x9d85a8]  IdealLoopTree::est_loop_flow_merge_sz() const+0x158
   [junit4] #
   [junit4] # No core dump will be written. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
   [junit4] #
   [junit4] # An error report file with more information is saved as:
   [junit4] # /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/core/test/J2/hs_err_pid12810.log
   [junit4] #
   [junit4] # Compiler replay data is saved as:
   [junit4] # /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/core/test/J2/replay_pid12810.log
   [junit4] #
   [junit4] # If you would like to submit a bug report, please visit:
   [junit4] #   https://bugreport.java.com/bugreport/crash.jsp
   [junit4] #
   [junit4] <<< JVM J2: EOF ----

[...truncated 74 lines...]
   [junit4] JVM J0: stdout was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/core/test/temp/junit4-J0-20191224_030458_3189110449349401458353.sysout
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] #
   [junit4] # A fatal error has been detected by the Java Runtime Environment:
   [junit4] #
   [junit4] #  SIGSEGV (0xb) at pc=0x00007fb842f765a8, pid=12809, tid=13967
   [junit4] #
   [junit4] # JRE version: OpenJDK Runtime Environment (14.0+27) (build 14-ea+27-1339)
   [junit4] # Java VM: OpenJDK 64-Bit Server VM (14-ea+27-1339, mixed mode, tiered, serial gc, linux-amd64)
   [junit4] # Problematic frame:
   [junit4] # V  [libjvm.so+0x9d85a8]  IdealLoopTree::est_loop_flow_merge_sz() const+0x158
   [junit4] #
   [junit4] # No core dump will be written. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
   [junit4] #
   [junit4] # An error report file with more information is saved as:
   [junit4] # /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/core/test/J0/hs_err_pid12809.log
   [junit4] #
   [junit4] # Compiler replay data is saved as:
   [junit4] # /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/core/test/J0/replay_pid12809.log
   [junit4] #
   [junit4] # If you would like to submit a bug report, please visit:
   [junit4] #   https://bugreport.java.com/bugreport/crash.jsp
   [junit4] #
   [junit4] <<< JVM J0: EOF ----

[...truncated 1107 lines...]
   [junit4] ERROR: JVM J0 ended with an exception, command line: /home/jenkins/tools/java/64bit/jdk-14-ea+27/bin/java -XX:-UseCompressedOops -XX:+UseSerialGC -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/heapdumps -ea -esa --illegal-access=deny -Dtests.prefix=tests -Dtests.seed=7AFF44F664E4AE5A -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=9.0.0 -Dtests.cleanthreads=perMethod -Djava.util.logging.config.file=/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/tools/junit4/logging.properties -Dtests.nightly=false -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=3 -DtempDir=./temp -Djava.io.tmpdir=./temp -Dcommon.dir=/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene -Dclover.db.dir=/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/clover/db -Djava.security.policy=/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/tools/junit4/tests.policy -Dtests.LUCENE_VERSION=9.0.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Dtests.src.home=/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux -Djava.security.egd=file:/dev/./urandom -Djunit4.childvm.cwd=/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/core/test/J0 -Djunit4.tempDir=/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/core/test/temp -Djunit4.childvm.id=0 -Djunit4.childvm.count=3 -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Dtests.filterstacks=true -Dtests.leaveTemporary=false -Dtests.badapples=true -classpath /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/codecs/classes/java:/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/test-framework/classes/java:/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/test-framework/lib/hamcrest-core-1.3.jar:/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/test-framework/lib/junit-4.12.jar:/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.7.5.jar:/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/core/classes/java:/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/core/classes/test:/home/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.7.5.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/core/test/temp/junit4-J0-20191224_030458_31811915939629128866304.events @/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/core/test/temp/junit4-J0-20191224_030458_3184184175350293771173.suites -stdin
   [junit4] ERROR: JVM J0 ended with an exception: Forked process returned with error code: 134. Very likely a JVM crash.  See process stdout at: /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/core/test/temp/junit4-J0-20191224_030458_3189110449349401458353.sysout
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1542)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:123)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:997)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:994)
   [junit4] 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4] 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4] 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
   [junit4] 	at java.base/java.lang.Thread.run(Thread.java:832)
   [junit4] ERROR: JVM J2 ended with an exception, command line: /home/jenkins/tools/java/64bit/jdk-14-ea+27/bin/java -XX:-UseCompressedOops -XX:+UseSerialGC -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/heapdumps -ea -esa --illegal-access=deny -Dtests.prefix=tests -Dtests.seed=7AFF44F664E4AE5A -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=9.0.0 -Dtests.cleanthreads=perMethod -Djava.util.logging.config.file=/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/tools/junit4/logging.properties -Dtests.nightly=false -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=3 -DtempDir=./temp -Djava.io.tmpdir=./temp -Dcommon.dir=/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene -Dclover.db.dir=/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/clover/db -Djava.security.policy=/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/tools/junit4/tests.policy -Dtests.LUCENE_VERSION=9.0.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Dtests.src.home=/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux -Djava.security.egd=file:/dev/./urandom -Djunit4.childvm.cwd=/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/core/test/J2 -Djunit4.tempDir=/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/core/test/temp -Djunit4.childvm.id=2 -Djunit4.childvm.count=3 -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Dtests.filterstacks=true -Dtests.leaveTemporary=false -Dtests.badapples=true -classpath /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/codecs/classes/java:/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/test-framework/classes/java:/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/test-framework/lib/hamcrest-core-1.3.jar:/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/test-framework/lib/junit-4.12.jar:/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.7.5.jar:/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/core/classes/java:/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/core/classes/test:/home/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.7.5.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/core/test/temp/junit4-J2-20191224_030458_3171594087858520446123.events @/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/core/test/temp/junit4-J2-20191224_030458_31714676950661355372638.suites -stdin
   [junit4] ERROR: JVM J2 ended with an exception: Forked process returned with error code: 134. Very likely a JVM crash.  See process stdout at: /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/core/test/temp/junit4-J2-20191224_030458_31715171859877218376594.sysout
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1542)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:123)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:997)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:994)
   [junit4] 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4] 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4] 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
   [junit4] 	at java.base/java.lang.Thread.run(Thread.java:832)

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/build.xml:643: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/build.xml:578: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/build.xml:59: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build.xml:50: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/common-build.xml:1510: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/common-build.xml:1037: At least one slave process threw an exception, first: Forked process returned with error code: 134. Very likely a JVM crash.  See process stdout at: /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/core/test/temp/junit4-J0-20191224_030458_3189110449349401458353.sysout

Total time: 16 minutes 15 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-BadApples-master-Linux (64bit/jdk-13.0.1) - Build # 310 - Failure!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-BadApples-master-Linux/310/
Java: 64bit/jdk-13.0.1 -XX:+UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseZGC

1 tests failed.
FAILED:  org.apache.lucene.index.TestIndexingSequenceNumbers.testStressConcurrentCommit

Error Message:
this IndexWriter is closed

Stack Trace:
org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
	at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:681)
	at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:695)
	at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3392)
	at org.apache.lucene.index.TestIndexingSequenceNumbers.testStressConcurrentCommit(TestIndexingSequenceNumbers.java:228)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:567)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:830)
Caused by: java.lang.OutOfMemoryError: Java heap space
	at __randomizedtesting.SeedInfo.seed([2E842BEEF2EB883E]:0)
	at java.base/java.lang.Integer.valueOf(Integer.java:1071)
	at org.apache.lucene.index.BufferedUpdates.addTerm(BufferedUpdates.java:148)
	at org.apache.lucene.index.DocumentsWriterDeleteQueue$TermNode.apply(DocumentsWriterDeleteQueue.java:420)
	at org.apache.lucene.index.DocumentsWriterDeleteQueue$DeleteSlice.apply(DocumentsWriterDeleteQueue.java:349)
	at org.apache.lucene.index.DocumentsWriterDeleteQueue.tryApplyGlobalSlice(DocumentsWriterDeleteQueue.java:200)
	at org.apache.lucene.index.DocumentsWriterDeleteQueue.add(DocumentsWriterDeleteQueue.java:162)
	at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:315)
	at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:451)
	at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1284)
	at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1277)
	at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:206)




Build Log:
[...truncated 2062 lines...]
   [junit4] Suite: org.apache.lucene.index.TestIndexingSequenceNumbers
   [junit4]   2> дец 28, 2019 1:52:45 ПРИЈЕ ПОДНЕ com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
   [junit4]   2> WARNING: Uncaught exception in thread: Thread[Thread-4319,5,TGRP-TestIndexingSequenceNumbers]
   [junit4]   2> java.lang.RuntimeException: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
   [junit4]   2> 	at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:216)
   [junit4]   2> Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:681)
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:695)
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3392)
   [junit4]   2> 	at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:184)
   [junit4]   2> Caused by: java.lang.OutOfMemoryError: Java heap space
   [junit4]   2> 	at __randomizedtesting.SeedInfo.seed([2E842BEEF2EB883E]:0)
   [junit4]   2> 	at java.base/java.lang.Integer.valueOf(Integer.java:1071)
   [junit4]   2> 	at org.apache.lucene.index.BufferedUpdates.addTerm(BufferedUpdates.java:148)
   [junit4]   2> 	at org.apache.lucene.index.DocumentsWriterDeleteQueue$TermNode.apply(DocumentsWriterDeleteQueue.java:420)
   [junit4]   2> 	at org.apache.lucene.index.DocumentsWriterDeleteQueue$DeleteSlice.apply(DocumentsWriterDeleteQueue.java:349)
   [junit4]   2> 	at org.apache.lucene.index.DocumentsWriterDeleteQueue.tryApplyGlobalSlice(DocumentsWriterDeleteQueue.java:200)
   [junit4]   2> 	at org.apache.lucene.index.DocumentsWriterDeleteQueue.add(DocumentsWriterDeleteQueue.java:162)
   [junit4]   2> 	at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:315)
   [junit4]   2> 	at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:451)
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1284)
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1277)
   [junit4]   2> 	at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:206)
   [junit4]   2> 
   [junit4]   2> дец 28, 2019 1:52:46 ПРИЈЕ ПОДНЕ com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
   [junit4]   2> WARNING: Uncaught exception in thread: Thread[Lucene Merge Thread #3001,5,TGRP-TestIndexingSequenceNumbers]
   [junit4]   2> java.lang.OutOfMemoryError: Java heap space
   [junit4]   2> 
   [junit4]   2> дец 28, 2019 1:52:46 ПРИЈЕ ПОДНЕ com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
   [junit4]   2> WARNING: Uncaught exception in thread: Thread[Thread-4322,5,TGRP-TestIndexingSequenceNumbers]
   [junit4]   2> java.lang.RuntimeException: java.lang.IllegalArgumentException: Self-suppression not permitted
   [junit4]   2> 	at __randomizedtesting.SeedInfo.seed([2E842BEEF2EB883E]:0)
   [junit4]   2> 	at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:216)
   [junit4]   2> Caused by: java.lang.IllegalArgumentException: Self-suppression not permitted
   [junit4]   2> 	at java.base/java.lang.Throwable.addSuppressed(Throwable.java:1062)
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.rollbackInternalNoCommit(IndexWriter.java:2357)
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.rollbackInternal(IndexWriter.java:2252)
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.maybeCloseOnTragicEvent(IndexWriter.java:4894)
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.tragicEvent(IndexWriter.java:4884)
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1602)
   [junit4]   2> 	at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1586)
   [junit4]   2> 	at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:208)
   [junit4]   2> Caused by: java.lang.OutOfMemoryError: Java heap space
   [junit4]   2> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestIndexingSequenceNumbers -Dtests.method=testStressConcurrentCommit -Dtests.seed=2E842BEEF2EB883E -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=sr-Cyrl-ME -Dtests.timezone=Etc/GMT+2 -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR    301s J0 | TestIndexingSequenceNumbers.testStressConcurrentCommit <<<
   [junit4]    > Throwable #1: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:681)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:695)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3392)
   [junit4]    > 	at org.apache.lucene.index.TestIndexingSequenceNumbers.testStressConcurrentCommit(TestIndexingSequenceNumbers.java:228)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.base/java.lang.reflect.Method.invoke(Method.java:567)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:830)
   [junit4]    > Caused by: java.lang.OutOfMemoryError: Java heap space
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([2E842BEEF2EB883E]:0)
   [junit4]    > 	at java.base/java.lang.Integer.valueOf(Integer.java:1071)
   [junit4]    > 	at org.apache.lucene.index.BufferedUpdates.addTerm(BufferedUpdates.java:148)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriterDeleteQueue$TermNode.apply(DocumentsWriterDeleteQueue.java:420)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriterDeleteQueue$DeleteSlice.apply(DocumentsWriterDeleteQueue.java:349)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriterDeleteQueue.tryApplyGlobalSlice(DocumentsWriterDeleteQueue.java:200)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriterDeleteQueue.add(DocumentsWriterDeleteQueue.java:162)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:315)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:451)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1284)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1277)
   [junit4]    > 	at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:206)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=4622, name=Thread-4321, state=RUNNABLE, group=TGRP-TestIndexingSequenceNumbers]
   [junit4]    > Caused by: java.lang.OutOfMemoryError: Java heap spaceThrowable #3: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=4616, name=Thread-4315, state=RUNNABLE, group=TGRP-TestIndexingSequenceNumbers]
   [junit4]    > Caused by: java.lang.RuntimeException: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
   [junit4]    > 	at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:216)
   [junit4]    > Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:681)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:695)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1281)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1277)
   [junit4]    > 	at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:206)
   [junit4]    > Caused by: java.lang.OutOfMemoryError: Java heap space
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([2E842BEEF2EB883E]:0)
   [junit4]    > 	at java.base/java.lang.Integer.valueOf(Integer.java:1071)
   [junit4]    > 	at org.apache.lucene.index.BufferedUpdates.addTerm(BufferedUpdates.java:148)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriterDeleteQueue$TermNode.apply(DocumentsWriterDeleteQueue.java:420)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriterDeleteQueue$DeleteSlice.apply(DocumentsWriterDeleteQueue.java:349)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriterDeleteQueue.tryApplyGlobalSlice(DocumentsWriterDeleteQueue.java:200)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriterDeleteQueue.add(DocumentsWriterDeleteQueue.java:162)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:315)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:451)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1284)
   [junit4]    > 	... 2 moreThrowable #4: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=4618, name=Thread-4317, state=RUNNABLE, group=TGRP-TestIndexingSequenceNumbers]
   [junit4]    > Caused by: java.lang.OutOfMemoryError: Java heap space
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([2E842BEEF2EB883E]:0)
   [junit4]    > 	at java.base/java.lang.Integer.valueOf(Integer.java:1071)
   [junit4]    > 	at org.apache.lucene.index.BufferedUpdates.addTerm(BufferedUpdates.java:148)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriterDeleteQueue$TermNode.apply(DocumentsWriterDeleteQueue.java:420)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriterDeleteQueue$DeleteSlice.apply(DocumentsWriterDeleteQueue.java:349)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriterDeleteQueue.tryApplyGlobalSlice(DocumentsWriterDeleteQueue.java:200)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriterDeleteQueue.add(DocumentsWriterDeleteQueue.java:162)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:315)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:451)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1284)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1277)
   [junit4]    > 	at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:206)Throwable #5: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=4620, name=Thread-4319, state=RUNNABLE, group=TGRP-TestIndexingSequenceNumbers]
   [junit4]    > Caused by: java.lang.RuntimeException: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
   [junit4]    > 	at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:216)
   [junit4]    > Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:681)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:695)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3392)
   [junit4]    > 	at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:184)
   [junit4]    > Caused by: java.lang.OutOfMemoryError: Java heap space
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([2E842BEEF2EB883E]:0)
   [junit4]    > 	at java.base/java.lang.Integer.valueOf(Integer.java:1071)
   [junit4]    > 	at org.apache.lucene.index.BufferedUpdates.addTerm(BufferedUpdates.java:148)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriterDeleteQueue$TermNode.apply(DocumentsWriterDeleteQueue.java:420)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriterDeleteQueue$DeleteSlice.apply(DocumentsWriterDeleteQueue.java:349)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriterDeleteQueue.tryApplyGlobalSlice(DocumentsWriterDeleteQueue.java:200)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriterDeleteQueue.add(DocumentsWriterDeleteQueue.java:162)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:315)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:451)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1284)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1277)
   [junit4]    > 	at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:206)Throwable #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=4623, name=Thread-4322, state=RUNNABLE, group=TGRP-TestIndexingSequenceNumbers]
   [junit4]    > Caused by: java.lang.RuntimeException: java.lang.IllegalArgumentException: Self-suppression not permitted
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([2E842BEEF2EB883E]:0)
   [junit4]    > 	at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:216)
   [junit4]    > Caused by: java.lang.IllegalArgumentException: Self-suppression not permitted
   [junit4]    > 	at java.base/java.lang.Throwable.addSuppressed(Throwable.java:1062)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.rollbackInternalNoCommit(IndexWriter.java:2357)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.rollbackInternal(IndexWriter.java:2252)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.maybeCloseOnTragicEvent(IndexWriter.java:4894)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.tragicEvent(IndexWriter.java:4884)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1602)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1586)
   [junit4]    > 	at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:208)
   [junit4]    > Caused by: java.lang.OutOfMemoryError: Java heap spaceThrowable #7: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=7625, name=Lucene Merge Thread #3001, state=RUNNABLE, group=TGRP-TestIndexingSequenceNumbers]
   [junit4]    > Caused by: java.lang.OutOfMemoryError: Java heap space
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/core/test/J0/temp/lucene.index.TestIndexingSequenceNumbers_2E842BEEF2EB883E-001
   [junit4]   2> NOTE: test params are: codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=5, maxDocsPerChunk=10, blockSize=552), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=5, blockSize=552)), sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@133a870b), locale=sr-Cyrl-ME, timezone=Etc/GMT+2
   [junit4]   2> NOTE: Linux 5.0.0-37-generic amd64/AdoptOpenJDK 13.0.1 (64-bit)/cpus=8,threads=1,free=39845888,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [TestDocumentsWriterStallControl, TestParallelReaderEmptyIndex, TestDistributionSPL, FiniteStringsIteratorTest, TestStressNRT, TestSortRandom, TestIndexWriterLockRelease, TestNRTCachingDirectory, TestSpanBoostQuery, TestReusableStringReader, TestIndexWriterMerging, TestStressDeletes, TestBooleanSimilarity, TestIndependenceStandardized, TestFixedLengthBytesRefArray, TestMmapDirectory, TestBinaryDocValuesUpdates, TestPerSegmentDeletes, TestPrefixQuery, TestIndexInput, TestFeatureDoubleValues, TestSpans, TestTerm, TestLatLonPointDistanceFeatureQuery, TestBooleanScorer, TestBlendedTermQuery, TestSoftDeletesRetentionMergePolicy, TestMultiDocValues, TestDirectoryReaderReopen, TestDocValuesQueries, TestDocValuesFieldUpdates, TestMaxScoreAccumulator, TestArrayUtil, TestPagedBytes, TestFastCompressionMode, TestIndexReaderClose, TestBufferedIndexInput, TestBasicModelIF, TestInPlaceMergeSorter, TestFieldInvertState, TestIndexWriterExceptions2, TestAnalyzerWrapper, TestLucene50StoredFieldsFormatHighCompression, TestLongBitSet, TestIntroSorter, TestBytesRefHash, TestCrashCausesCorruptIndex, TestSpanMultiTermQueryWrapper, TestFileSwitchDirectory, TestComplexExplanations, TestNotDocIdSet, TestSimpleFSDirectory, TestAllFilesDetectTruncation, TestRecyclingIntBlockAllocator, TestLatLonDocValuesQueries, TestField, TestNRTThreads, TestMultiTermsEnum, TestRadixSelector, TestSpanOrQuery, TestTimSorter, TestSPIClassIterator, TestFlushByRamOrCountsPolicy, TestCompiledAutomaton, TestLongRange, TestVersion, Test2BPositions, TestIndexWriterReader, TestAxiomaticF1EXP, TestDeterminizeLexicon, TestOmitPositions, TestPostingsOffsets, TestLucene60FieldInfoFormat, TestByteBlockPool, TestBoolean2ScorerSupplier, TestMultiSliceMerge, TestSimilarity2, TestCharArraySet, TestTotalHitCountCollector, TestDoubleValuesSource, TestTwoPhaseCommitTool, TestNeedsScores, TestSearcherManager, TestLongRangeFieldQueries, TestTerms, TestPolygon, TestTransactionRollback, TestLucene80NormsFormatMergeInstance, TestPerFieldPostingsFormat, Test2BDocs, Test2BPostings, Test2BPostingsBytes, Test2BSortedDocValuesFixedSorted, Test2BSortedDocValuesOrds, Test2BTerms, Test4GBStoredFields, TestAddIndexes, TestAllFilesCheckIndexHeader, TestAtomicUpdate, TestBagOfPositions, TestConsistentFieldNumbers, TestCrash, TestDeletionPolicy, TestDirectoryReader, TestDocIDMerger, TestDocInverterPerFieldErrorInfo, TestDocValues, TestDocsWithFieldSet, TestDuelingCodecsAtNight, TestExceedMaxTermLength, TestExitableDirectoryReader, TestFieldInfos, TestFieldReuse, TestFieldUpdatesBuffer, TestFieldsReader, TestFilterCodecReader, TestFilterDirectoryReader, TestFilterLeafReader, TestFilterMergePolicy, TestFlex, TestForTooMuchCloning, TestForceMergeForever, TestFrozenBufferedUpdates, TestIndexSorting, TestIndexWriterCommit, TestIndexWriterNRTIsCurrent, TestIndexWriterOnDiskFull, TestIndexWriterOnJRECrash, TestIndexWriterWithThreads, TestIndexableField, TestIndexingSequenceNumbers]
   [junit4] Completed [502/526 (1!)] on J0 in 328.52s, 8 tests, 1 error <<< FAILURES!

[...truncated 73 lines...]
   [junit4] JVM J0: stdout was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/core/test/temp/junit4-J0-20191228_033859_47710925011755398648489.sysout
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: Java heap space
   [junit4] Dumping heap to /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/heapdumps/java_pid8349.hprof ...
   [junit4] Heap dump file created [419048464 bytes in 1.707 secs]
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/core/test/temp/junit4-J0-20191228_033859_4774010638786427075561.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] 
   [junit4] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "Thread-4317"
   [junit4] 
   [junit4] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "Thread-4316"
   [junit4] 
   [junit4] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "Thread-4315"
   [junit4] 
   [junit4] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "Thread-4321"
   [junit4] 
   [junit4] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "Thread-4318"
   [junit4] 
   [junit4] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "Thread-4320"
   [junit4] <<< JVM J0: EOF ----

[...truncated 5047 lines...]
   [junit4] JVM J2: stdout was not empty, see: /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/codecs/test/temp/junit4-J2-20191228_040154_81949283315148643240.sysout
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] #
   [junit4] # A fatal error has been detected by the Java Runtime Environment:
   [junit4] #
   [junit4] #  SIGSEGV (0xb) at pc=0x00007f4ff86ef1c9, pid=30468, tid=30543
   [junit4] #
   [junit4] # JRE version: OpenJDK Runtime Environment (13.0.1+9) (build 13.0.1+9)
   [junit4] # Java VM: OpenJDK 64-Bit Server VM (13.0.1+9, mixed mode, tiered, z gc, linux-amd64)
   [junit4] # Problematic frame:
   [junit4] # V  [libjvm.so+0xce71c9]  PhaseIterGVN::transform_old(Node*)+0x159
   [junit4] #
   [junit4] # No core dump will be written. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
   [junit4] #
   [junit4] # An error report file with more information is saved as:
   [junit4] # /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/codecs/test/J2/hs_err_pid30468.log
   [junit4] [thread 1046 also had an error][thread 1048 also had an error]
   [junit4] 
   [junit4] 
   [junit4] ------ Timeout during error reporting after 120 s. ------
   [junit4] # [ timer expired, abort... ]
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] ERROR: JVM J2 ended with an exception, command line: /home/jenkins/tools/java/64bit/jdk-13.0.1/bin/java -XX:+UseCompressedOops -XX:+UnlockExperimentalVMOptions -XX:+UseZGC -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/heapdumps -ea -esa --illegal-access=deny -Dtests.prefix=tests -Dtests.seed=D9DA3B9D7AC9FCC6 -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=9.0.0 -Dtests.cleanthreads=perMethod -Djava.util.logging.config.file=/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/tools/junit4/logging.properties -Dtests.nightly=false -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=3 -DtempDir=./temp -Djava.io.tmpdir=./temp -Dcommon.dir=/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene -Dclover.db.dir=/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/clover/db -Djava.security.policy=/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/tools/junit4/tests.policy -Dtests.LUCENE_VERSION=9.0.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Dtests.src.home=/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux -Djava.security.egd=file:/dev/./urandom -Djunit4.childvm.cwd=/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/codecs/test/J2 -Djunit4.tempDir=/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/codecs/test/temp -Djunit4.childvm.id=2 -Djunit4.childvm.count=3 -Dfile.encoding=UTF-8 -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Dtests.filterstacks=true -Dtests.leaveTemporary=false -Dtests.badapples=true -classpath /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/codecs/classes/test:/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/test-framework/classes/java:/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/codecs/classes/java:/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/core/classes/java:/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/test-framework/lib/hamcrest-core-1.3.jar:/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/test-framework/lib/junit-4.12.jar:/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.7.5.jar:/home/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.7.5.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/codecs/test/temp/junit4-J2-20191228_040154_81910190644372894564188.events @/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/codecs/test/temp/junit4-J2-20191228_040154_8194220279977837925545.suites -stdin
   [junit4] ERROR: JVM J2 ended with an exception: Forked process returned with error code: 134. Very likely a JVM crash.  See process stdout at: /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/codecs/test/temp/junit4-J2-20191228_040154_81949283315148643240.sysout
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1542)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:123)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:997)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:994)
   [junit4] 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4] 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
   [junit4] 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
   [junit4] 	at java.base/java.lang.Thread.run(Thread.java:830)

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/build.xml:643: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/build.xml:578: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/build.xml:59: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build.xml:481: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/common-build.xml:2199: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/module-build.xml:57: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/common-build.xml:1510: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/common-build.xml:1037: At least one slave process threw an exception, first: Forked process returned with error code: 134. Very likely a JVM crash.  See process stdout at: /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/lucene/build/codecs/test/temp/junit4-J2-20191228_040154_81949283315148643240.sysout

Total time: 27 minutes 48 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS-EA] Lucene-Solr-BadApples-master-Linux (64bit/jdk-14-ea+27) - Build # 309 - Still unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-BadApples-master-Linux/309/
Java: 64bit/jdk-14-ea+27 -XX:-UseCompressedOops -XX:+UseG1GC

1 tests failed.
FAILED:  org.apache.solr.cloud.TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader

Error Message:
Doc with id=4 not found in https://127.0.0.1:41251/solr/outOfSyncReplicasCannotBecomeLeader-false due to: Path not found: /id; rsp={doc=null}

Stack Trace:
java.lang.AssertionError: Doc with id=4 not found in https://127.0.0.1:41251/solr/outOfSyncReplicasCannotBecomeLeader-false due to: Path not found: /id; rsp={doc=null}
	at __randomizedtesting.SeedInfo.seed([76C576F9E4F582E6:82E56E927928DDC]:0)
	at org.junit.Assert.fail(Assert.java:88)
	at org.junit.Assert.assertTrue(Assert.java:41)
	at org.apache.solr.cloud.TestCloudConsistency.assertDocExists(TestCloudConsistency.java:285)
	at org.apache.solr.cloud.TestCloudConsistency.assertDocsExistInAllReplicas(TestCloudConsistency.java:269)
	at org.apache.solr.cloud.TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader(TestCloudConsistency.java:140)
	at org.apache.solr.cloud.TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader(TestCloudConsistency.java:99)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:832)




Build Log:
[...truncated 13688 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestCloudConsistency
   [junit4]   2> 689480 INFO  (SUITE-TestCloudConsistency-seed#[76C576F9E4F582E6]-worker) [     ] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_76C576F9E4F582E6-001/data-dir-88-001
   [junit4]   2> 689481 INFO  (SUITE-TestCloudConsistency-seed#[76C576F9E4F582E6]-worker) [     ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 689481 INFO  (SUITE-TestCloudConsistency-seed#[76C576F9E4F582E6]-worker) [     ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 689482 INFO  (SUITE-TestCloudConsistency-seed#[76C576F9E4F582E6]-worker) [     ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 689484 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.SolrTestCaseJ4 ###Starting testOutOfSyncReplicasCannotBecomeLeader
   [junit4]   2> 689484 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_76C576F9E4F582E6-001/tempDir-001
   [junit4]   2> 689485 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 689485 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 689485 INFO  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 689585 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.ZkTestServer start zk server on port:40733
   [junit4]   2> 689585 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:40733
   [junit4]   2> 689585 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:40733
   [junit4]   2> 689585 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 40733
   [junit4]   2> 689586 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 689591 INFO  (zkConnectionManagerCallback-3812-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 689591 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 689598 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 689603 INFO  (zkConnectionManagerCallback-3814-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 689603 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 689616 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 689617 INFO  (zkConnectionManagerCallback-3816-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 689617 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 689722 WARN  (jetty-launcher-3817-thread-1) [     ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
   [junit4]   2> 689722 WARN  (jetty-launcher-3817-thread-3) [     ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
   [junit4]   2> 689722 WARN  (jetty-launcher-3817-thread-4) [     ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
   [junit4]   2> 689722 INFO  (jetty-launcher-3817-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 689722 INFO  (jetty-launcher-3817-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 689722 INFO  (jetty-launcher-3817-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 689722 INFO  (jetty-launcher-3817-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 689722 INFO  (jetty-launcher-3817-thread-4) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 689722 INFO  (jetty-launcher-3817-thread-4) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 689722 INFO  (jetty-launcher-3817-thread-4) [     ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 14-ea+27-1339
   [junit4]   2> 689722 INFO  (jetty-launcher-3817-thread-3) [     ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 14-ea+27-1339
   [junit4]   2> 689722 INFO  (jetty-launcher-3817-thread-1) [     ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 14-ea+27-1339
   [junit4]   2> 689722 WARN  (jetty-launcher-3817-thread-2) [     ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
   [junit4]   2> 689722 INFO  (jetty-launcher-3817-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 689722 INFO  (jetty-launcher-3817-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 689722 INFO  (jetty-launcher-3817-thread-2) [     ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 14-ea+27-1339
   [junit4]   2> 689740 INFO  (jetty-launcher-3817-thread-3) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 689740 INFO  (jetty-launcher-3817-thread-3) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 689740 INFO  (jetty-launcher-3817-thread-3) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 689743 INFO  (jetty-launcher-3817-thread-1) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 689743 INFO  (jetty-launcher-3817-thread-1) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 689743 INFO  (jetty-launcher-3817-thread-1) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 689743 INFO  (jetty-launcher-3817-thread-3) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4d36ec1a{/solr,null,AVAILABLE}
   [junit4]   2> 689743 INFO  (jetty-launcher-3817-thread-4) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 689743 INFO  (jetty-launcher-3817-thread-4) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 689743 INFO  (jetty-launcher-3817-thread-4) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 689744 INFO  (jetty-launcher-3817-thread-1) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7e6c2b86{/solr,null,AVAILABLE}
   [junit4]   2> 689744 INFO  (jetty-launcher-3817-thread-4) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@25c57810{/solr,null,AVAILABLE}
   [junit4]   2> 689744 INFO  (jetty-launcher-3817-thread-1) [     ] o.e.j.s.AbstractConnector Started ServerConnector@2627b63{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:32943}
   [junit4]   2> 689744 INFO  (jetty-launcher-3817-thread-1) [     ] o.e.j.s.Server Started @689793ms
   [junit4]   2> 689744 INFO  (jetty-launcher-3817-thread-1) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=32943}
   [junit4]   2> 689745 INFO  (jetty-launcher-3817-thread-4) [     ] o.e.j.s.AbstractConnector Started ServerConnector@2ae151d7{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:38957}
   [junit4]   2> 689745 INFO  (jetty-launcher-3817-thread-4) [     ] o.e.j.s.Server Started @689793ms
   [junit4]   2> 689745 INFO  (jetty-launcher-3817-thread-4) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38957}
   [junit4]   2> 689745 ERROR (jetty-launcher-3817-thread-1) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 689745 INFO  (jetty-launcher-3817-thread-1) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 689745 INFO  (jetty-launcher-3817-thread-1) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 9.0.0
   [junit4]   2> 689745 ERROR (jetty-launcher-3817-thread-4) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 689745 INFO  (jetty-launcher-3817-thread-4) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 689745 INFO  (jetty-launcher-3817-thread-1) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 689745 INFO  (jetty-launcher-3817-thread-1) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 689745 INFO  (jetty-launcher-3817-thread-4) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 9.0.0
   [junit4]   2> 689745 INFO  (jetty-launcher-3817-thread-1) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-12-26T05:39:18.844321Z
   [junit4]   2> 689745 INFO  (jetty-launcher-3817-thread-4) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 689745 INFO  (jetty-launcher-3817-thread-4) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 689745 INFO  (jetty-launcher-3817-thread-4) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-12-26T05:39:18.844352Z
   [junit4]   2> 689746 INFO  (jetty-launcher-3817-thread-3) [     ] o.e.j.s.AbstractConnector Started ServerConnector@2ca0fc1f{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:40371}
   [junit4]   2> 689746 INFO  (jetty-launcher-3817-thread-3) [     ] o.e.j.s.Server Started @689795ms
   [junit4]   2> 689746 INFO  (jetty-launcher-3817-thread-3) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40371}
   [junit4]   2> 689746 ERROR (jetty-launcher-3817-thread-3) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 689747 INFO  (jetty-launcher-3817-thread-3) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 689747 INFO  (jetty-launcher-3817-thread-3) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 9.0.0
   [junit4]   2> 689747 INFO  (jetty-launcher-3817-thread-3) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 689747 INFO  (jetty-launcher-3817-thread-3) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 689747 INFO  (jetty-launcher-3817-thread-3) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-12-26T05:39:18.846082Z
   [junit4]   2> 689748 INFO  (jetty-launcher-3817-thread-2) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 689748 INFO  (jetty-launcher-3817-thread-2) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 689748 INFO  (jetty-launcher-3817-thread-2) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 689748 INFO  (jetty-launcher-3817-thread-3) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 689748 INFO  (jetty-launcher-3817-thread-4) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 689748 INFO  (jetty-launcher-3817-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 689749 INFO  (zkConnectionManagerCallback-3821-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 689749 INFO  (jetty-launcher-3817-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 689749 INFO  (jetty-launcher-3817-thread-2) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2b802b65{/solr,null,AVAILABLE}
   [junit4]   2> 689749 INFO  (jetty-launcher-3817-thread-2) [     ] o.e.j.s.AbstractConnector Started ServerConnector@7a4b4043{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:42799}
   [junit4]   2> 689750 INFO  (jetty-launcher-3817-thread-2) [     ] o.e.j.s.Server Started @689798ms
   [junit4]   2> 689750 INFO  (jetty-launcher-3817-thread-2) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42799}
   [junit4]   2> 689750 ERROR (jetty-launcher-3817-thread-2) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 689750 INFO  (jetty-launcher-3817-thread-2) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 689750 INFO  (jetty-launcher-3817-thread-2) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 9.0.0
   [junit4]   2> 689750 INFO  (jetty-launcher-3817-thread-2) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 689750 INFO  (jetty-launcher-3817-thread-2) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 689750 INFO  (jetty-launcher-3817-thread-2) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-12-26T05:39:18.849338Z
   [junit4]   2> 689751 INFO  (jetty-launcher-3817-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 689751 INFO  (zkConnectionManagerCallback-3820-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 689751 INFO  (jetty-launcher-3817-thread-4) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 689751 INFO  (zkConnectionManagerCallback-3823-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 689751 INFO  (jetty-launcher-3817-thread-3) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 689752 INFO  (zkConnectionManagerCallback-3825-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 689752 INFO  (jetty-launcher-3817-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 689752 INFO  (jetty-launcher-3817-thread-3) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 689752 INFO  (jetty-launcher-3817-thread-4) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 689752 INFO  (jetty-launcher-3817-thread-2) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 689753 INFO  (jetty-launcher-3817-thread-1) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 690024 INFO  (jetty-launcher-3817-thread-3) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 690025 WARN  (jetty-launcher-3817-thread-3) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@6fb0dde0[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 690025 WARN  (jetty-launcher-3817-thread-3) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@6fb0dde0[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 690029 WARN  (jetty-launcher-3817-thread-3) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@29dc9e25[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 690029 WARN  (jetty-launcher-3817-thread-3) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@29dc9e25[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 690030 INFO  (jetty-launcher-3817-thread-3) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40733/solr
   [junit4]   2> 690031 INFO  (jetty-launcher-3817-thread-3) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 690046 INFO  (zkConnectionManagerCallback-3834-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 690046 INFO  (jetty-launcher-3817-thread-3) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 690046 INFO  (jetty-launcher-3817-thread-4) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 690051 WARN  (jetty-launcher-3817-thread-4) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@68a78185[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 690051 WARN  (jetty-launcher-3817-thread-4) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@68a78185[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 690055 WARN  (jetty-launcher-3817-thread-4) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@75ebba1b[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 690055 WARN  (jetty-launcher-3817-thread-4) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@75ebba1b[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 690056 INFO  (jetty-launcher-3817-thread-4) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40733/solr
   [junit4]   2> 690062 INFO  (jetty-launcher-3817-thread-2) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 690066 INFO  (jetty-launcher-3817-thread-4) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 690066 INFO  (zkConnectionManagerCallback-3840-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 690066 INFO  (jetty-launcher-3817-thread-4) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 690066 WARN  (jetty-launcher-3817-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3a46242b[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 690066 WARN  (jetty-launcher-3817-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3a46242b[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 690071 WARN  (jetty-launcher-3817-thread-2) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@cbd7ce3[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 690071 WARN  (jetty-launcher-3817-thread-2) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@cbd7ce3[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 690072 INFO  (jetty-launcher-3817-thread-2) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40733/solr
   [junit4]   2> 690077 INFO  (jetty-launcher-3817-thread-2) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 690077 INFO  (zkConnectionManagerCallback-3847-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 690077 INFO  (jetty-launcher-3817-thread-2) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 690108 INFO  (jetty-launcher-3817-thread-1) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 690108 WARN  (jetty-launcher-3817-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@709bb2ef[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 690108 WARN  (jetty-launcher-3817-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@709bb2ef[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 690110 WARN  (jetty-launcher-3817-thread-1) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@4702642b[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 690110 WARN  (jetty-launcher-3817-thread-1) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@4702642b[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 690111 INFO  (jetty-launcher-3817-thread-1) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40733/solr
   [junit4]   2> 690111 INFO  (jetty-launcher-3817-thread-1) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 690112 INFO  (zkConnectionManagerCallback-3853-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 690112 INFO  (jetty-launcher-3817-thread-1) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 690157 INFO  (jetty-launcher-3817-thread-3) [n:127.0.0.1:40371_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 690158 INFO  (zkConnectionManagerCallback-3855-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 690158 INFO  (jetty-launcher-3817-thread-3) [n:127.0.0.1:40371_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 690199 INFO  (jetty-launcher-3817-thread-3) [n:127.0.0.1:40371_solr     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:40371_solr
   [junit4]   2> 690199 INFO  (jetty-launcher-3817-thread-3) [n:127.0.0.1:40371_solr     ] o.a.s.c.Overseer Overseer (id=72248589558546443-127.0.0.1:40371_solr-n_0000000000) starting
   [junit4]   2> 690202 INFO  (OverseerStateUpdate-72248589558546443-127.0.0.1:40371_solr-n_0000000000) [n:127.0.0.1:40371_solr     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:40371_solr
   [junit4]   2> 690202 INFO  (jetty-launcher-3817-thread-3) [n:127.0.0.1:40371_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40371_solr
   [junit4]   2> 690203 INFO  (OverseerStateUpdate-72248589558546443-127.0.0.1:40371_solr-n_0000000000) [n:127.0.0.1:40371_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 690203 WARN  (jetty-launcher-3817-thread-3) [n:127.0.0.1:40371_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 690214 INFO  (jetty-launcher-3817-thread-3) [n:127.0.0.1:40371_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 690237 INFO  (jetty-launcher-3817-thread-3) [n:127.0.0.1:40371_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40371.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@41409383
   [junit4]   2> 690246 INFO  (jetty-launcher-3817-thread-3) [n:127.0.0.1:40371_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40371.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@41409383
   [junit4]   2> 690246 INFO  (jetty-launcher-3817-thread-3) [n:127.0.0.1:40371_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40371.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@41409383
   [junit4]   2> 690249 INFO  (jetty-launcher-3817-thread-3) [n:127.0.0.1:40371_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 690249 INFO  (jetty-launcher-3817-thread-3) [n:127.0.0.1:40371_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_76C576F9E4F582E6-001/tempDir-001/node3/.
   [junit4]   2> 690258 INFO  (jetty-launcher-3817-thread-1) [n:127.0.0.1:32943_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 690263 INFO  (zkConnectionManagerCallback-3861-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 690263 INFO  (jetty-launcher-3817-thread-1) [n:127.0.0.1:32943_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 690269 INFO  (jetty-launcher-3817-thread-1) [n:127.0.0.1:32943_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 690271 INFO  (jetty-launcher-3817-thread-1) [n:127.0.0.1:32943_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:32943_solr as DOWN
   [junit4]   2> 690271 INFO  (jetty-launcher-3817-thread-1) [n:127.0.0.1:32943_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 690271 INFO  (jetty-launcher-3817-thread-1) [n:127.0.0.1:32943_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32943_solr
   [junit4]   2> 690272 INFO  (zkCallback-3854-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 690272 INFO  (zkCallback-3860-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 690273 WARN  (jetty-launcher-3817-thread-1) [n:127.0.0.1:32943_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 690283 INFO  (jetty-launcher-3817-thread-1) [n:127.0.0.1:32943_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 690307 INFO  (jetty-launcher-3817-thread-1) [n:127.0.0.1:32943_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_32943.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@41409383
   [junit4]   2> 690317 INFO  (jetty-launcher-3817-thread-1) [n:127.0.0.1:32943_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_32943.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@41409383
   [junit4]   2> 690317 INFO  (jetty-launcher-3817-thread-1) [n:127.0.0.1:32943_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_32943.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@41409383
   [junit4]   2> 690320 INFO  (jetty-launcher-3817-thread-1) [n:127.0.0.1:32943_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 690321 INFO  (jetty-launcher-3817-thread-1) [n:127.0.0.1:32943_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_76C576F9E4F582E6-001/tempDir-001/node1/.
   [junit4]   2> 690358 INFO  (jetty-launcher-3817-thread-2) [n:127.0.0.1:42799_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 690359 INFO  (zkConnectionManagerCallback-3867-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 690359 INFO  (jetty-launcher-3817-thread-2) [n:127.0.0.1:42799_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 690361 INFO  (jetty-launcher-3817-thread-2) [n:127.0.0.1:42799_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 690363 INFO  (jetty-launcher-3817-thread-2) [n:127.0.0.1:42799_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:42799_solr as DOWN
   [junit4]   2> 690364 INFO  (jetty-launcher-3817-thread-2) [n:127.0.0.1:42799_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 690364 INFO  (jetty-launcher-3817-thread-2) [n:127.0.0.1:42799_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42799_solr
   [junit4]   2> 690364 INFO  (zkCallback-3860-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 690364 INFO  (zkCallback-3854-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 690364 INFO  (zkCallback-3866-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 690365 WARN  (jetty-launcher-3817-thread-2) [n:127.0.0.1:42799_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 690372 INFO  (jetty-launcher-3817-thread-2) [n:127.0.0.1:42799_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 690383 INFO  (jetty-launcher-3817-thread-2) [n:127.0.0.1:42799_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42799.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@41409383
   [junit4]   2> 690389 INFO  (jetty-launcher-3817-thread-2) [n:127.0.0.1:42799_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42799.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@41409383
   [junit4]   2> 690389 INFO  (jetty-launcher-3817-thread-2) [n:127.0.0.1:42799_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42799.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@41409383
   [junit4]   2> 690390 INFO  (jetty-launcher-3817-thread-2) [n:127.0.0.1:42799_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 690391 INFO  (jetty-launcher-3817-thread-2) [n:127.0.0.1:42799_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_76C576F9E4F582E6-001/tempDir-001/node2/.
   [junit4]   2> 690458 INFO  (jetty-launcher-3817-thread-4) [n:127.0.0.1:38957_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 690459 INFO  (zkConnectionManagerCallback-3873-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 690459 INFO  (jetty-launcher-3817-thread-4) [n:127.0.0.1:38957_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 690461 INFO  (jetty-launcher-3817-thread-4) [n:127.0.0.1:38957_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 690463 INFO  (jetty-launcher-3817-thread-4) [n:127.0.0.1:38957_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:38957_solr as DOWN
   [junit4]   2> 690464 INFO  (jetty-launcher-3817-thread-4) [n:127.0.0.1:38957_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 690464 INFO  (jetty-launcher-3817-thread-4) [n:127.0.0.1:38957_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38957_solr
   [junit4]   2> 690465 INFO  (zkCallback-3860-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 690465 INFO  (zkCallback-3854-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 690465 INFO  (zkCallback-3866-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 690465 INFO  (zkCallback-3872-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 690466 WARN  (jetty-launcher-3817-thread-4) [n:127.0.0.1:38957_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 690476 INFO  (jetty-launcher-3817-thread-4) [n:127.0.0.1:38957_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 690495 INFO  (jetty-launcher-3817-thread-4) [n:127.0.0.1:38957_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38957.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@41409383
   [junit4]   2> 690503 INFO  (jetty-launcher-3817-thread-4) [n:127.0.0.1:38957_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38957.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@41409383
   [junit4]   2> 690503 INFO  (jetty-launcher-3817-thread-4) [n:127.0.0.1:38957_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38957.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@41409383
   [junit4]   2> 690504 INFO  (jetty-launcher-3817-thread-4) [n:127.0.0.1:38957_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 690504 INFO  (jetty-launcher-3817-thread-4) [n:127.0.0.1:38957_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_76C576F9E4F582E6-001/tempDir-001/node4/.
   [junit4]   2> 690548 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.MiniSolrCloudCluster waitForAllNodes: numServers=4
   [junit4]   2> 690549 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 690550 INFO  (zkConnectionManagerCallback-3882-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 690550 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 690551 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 690551 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40733/solr ready
   [junit4]   2> 690553 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2042964372
   [junit4]   2> 690553 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:40371_solr
   [junit4]   2> 690554 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.ZkController Publish this node as DOWN...
   [junit4]   2> 690554 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.ZkController Publish node=127.0.0.1:40371_solr as DOWN
   [junit4]   2> 690555 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 690556 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 690556 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@17b196c6: rootName = solr_40371, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@681e
   [junit4]   2> 690565 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 690565 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@118fe376: rootName = solr_40371, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@3591aa1f
   [junit4]   2> 690570 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 690570 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@71d20fb0: rootName = solr_40371, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@7f08bd51
   [junit4]   2> 690570 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 690570 INFO  (closeThreadPool-3886-thread-1) [     ] o.a.s.c.Overseer Overseer (id=72248589558546443-127.0.0.1:40371_solr-n_0000000000) closing
   [junit4]   2> 690570 INFO  (OverseerStateUpdate-72248589558546443-127.0.0.1:40371_solr-n_0000000000) [n:127.0.0.1:40371_solr     ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:40371_solr
   [junit4]   2> 690570 INFO  (OverseerAutoScalingTriggerThread-72248589558546443-127.0.0.1:40371_solr-n_0000000000) [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 690571 INFO  (zkCallback-3866-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 690572 INFO  (closeThreadPool-3886-thread-2) [     ] o.a.s.c.Overseer Overseer (id=72248589558546443-127.0.0.1:40371_solr-n_0000000000) closing
   [junit4]   2> 690572 INFO  (zkCallback-3860-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 690572 INFO  (zkCallback-3872-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 690572 INFO  (zkCallback-3881-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 690572 INFO  (zkCallback-3860-thread-2) [     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:32943_solr
   [junit4]   2> 690572 INFO  (zkCallback-3860-thread-2) [n:127.0.0.1:32943_solr     ] o.a.s.c.Overseer Overseer (id=72248589558546444-127.0.0.1:32943_solr-n_0000000001) starting
   [junit4]   2> 690574 INFO  (OverseerStateUpdate-72248589558546444-127.0.0.1:32943_solr-n_0000000001) [n:127.0.0.1:32943_solr     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:32943_solr
   [junit4]   2> 690672 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.Overseer Overseer (id=72248589558546443-127.0.0.1:40371_solr-n_0000000000) closing
   [junit4]   2> 690672 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@2ca0fc1f{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:0}
   [junit4]   2> 690672 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4d36ec1a{/solr,null,UNAVAILABLE}
   [junit4]   2> 690672 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 690673 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 690674 WARN  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
   [junit4]   2> 690674 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 690674 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 14-ea+27-1339
   [junit4]   2> 690675 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 690675 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 690675 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 690675 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@24527dff{/solr,null,AVAILABLE}
   [junit4]   2> 690676 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.AbstractConnector Started ServerConnector@269df4e4{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:42203}
   [junit4]   2> 690676 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.Server Started @690725ms
   [junit4]   2> 690676 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42991}
   [junit4]   2> 690676 ERROR (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 690676 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 690676 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 9.0.0
   [junit4]   2> 690676 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 690676 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 690676 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-12-26T05:39:19.775896Z
   [junit4]   2> 690678 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 690678 INFO  (zkConnectionManagerCallback-3888-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 690678 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 690678 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 690872 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 690873 WARN  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@7e20cbf7[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 690873 WARN  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@7e20cbf7[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 690876 WARN  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@3dc7d24[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 690876 WARN  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@3dc7d24[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 690876 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40733/solr
   [junit4]   2> 690877 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 690878 INFO  (zkConnectionManagerCallback-3895-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 690878 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 690980 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [n:127.0.0.1:42991_solr     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 690981 INFO  (zkConnectionManagerCallback-3897-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 690981 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [n:127.0.0.1:42991_solr     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 690983 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [n:127.0.0.1:42991_solr     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 690986 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [n:127.0.0.1:42991_solr     ] o.a.s.c.ZkController Publish node=127.0.0.1:42991_solr as DOWN
   [junit4]   2> 690986 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [n:127.0.0.1:42991_solr     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 690986 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [n:127.0.0.1:42991_solr     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42991_solr
   [junit4]   2> 690987 INFO  (zkCallback-3866-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 690987 INFO  (zkCallback-3872-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 690987 INFO  (zkCallback-3860-thread-2) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 690987 INFO  (zkCallback-3881-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 690987 INFO  (zkCallback-3896-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 690988 WARN  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [n:127.0.0.1:42991_solr     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 691018 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [n:127.0.0.1:42991_solr     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 691041 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [n:127.0.0.1:42991_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42991.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@41409383
   [junit4]   2> 691079 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [n:127.0.0.1:42991_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42991.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@41409383
   [junit4]   2> 691079 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [n:127.0.0.1:42991_solr     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42991.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@41409383
   [junit4]   2> 691084 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [n:127.0.0.1:42991_solr     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 691087 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [n:127.0.0.1:42991_solr     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_76C576F9E4F582E6-001/tempDir-001/node3/.
   [junit4]   2> 691158 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.TestCloudConsistency Adding proxy for URL: https://127.0.0.1:42203/solr. Proxy: https://127.0.0.1:42991/solr
   [junit4]   2> 691158 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1009583704
   [junit4]   2> 691158 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:32943_solr
   [junit4]   2> 691159 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.ZkController Publish this node as DOWN...
   [junit4]   2> 691159 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.ZkController Publish node=127.0.0.1:32943_solr as DOWN
   [junit4]   2> 691160 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 691160 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@b30aebf: rootName = solr_32943, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@deecf5d
   [junit4]   2> 691165 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 691165 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5b6813f3: rootName = solr_32943, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@3591aa1f
   [junit4]   2> 691168 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 691168 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@19282575: rootName = solr_32943, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@7f08bd51
   [junit4]   2> 691168 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 691170 INFO  (closeThreadPool-3905-thread-2) [     ] o.a.s.c.Overseer Overseer (id=72248589558546444-127.0.0.1:32943_solr-n_0000000001) closing
   [junit4]   2> 691170 INFO  (OverseerAutoScalingTriggerThread-72248589558546444-127.0.0.1:32943_solr-n_0000000001) [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 691170 INFO  (OverseerStateUpdate-72248589558546444-127.0.0.1:32943_solr-n_0000000001) [n:127.0.0.1:32943_solr     ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:32943_solr
   [junit4]   2> 691171 INFO  (closeThreadPool-3905-thread-1) [     ] o.a.s.c.Overseer Overseer (id=72248589558546444-127.0.0.1:32943_solr-n_0000000001) closing
   [junit4]   2> 691172 INFO  (zkCallback-3881-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 691172 INFO  (zkCallback-3866-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 691172 INFO  (zkCallback-3896-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 691172 INFO  (zkCallback-3872-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 691172 INFO  (zkCallback-3866-thread-2) [     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42799_solr
   [junit4]   2> 691173 INFO  (zkCallback-3866-thread-2) [n:127.0.0.1:42799_solr     ] o.a.s.c.Overseer Overseer (id=72248589558546445-127.0.0.1:42799_solr-n_0000000002) starting
   [junit4]   2> 691175 INFO  (OverseerStateUpdate-72248589558546445-127.0.0.1:42799_solr-n_0000000002) [n:127.0.0.1:42799_solr     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:42799_solr
   [junit4]   2> 691272 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.Overseer Overseer (id=72248589558546444-127.0.0.1:32943_solr-n_0000000001) closing
   [junit4]   2> 691273 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@2627b63{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:0}
   [junit4]   2> 691274 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7e6c2b86{/solr,null,UNAVAILABLE}
   [junit4]   2> 691275 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 691275 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 691277 WARN  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
   [junit4]   2> 691277 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 691277 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 14-ea+27-1339
   [junit4]   2> 691278 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 691278 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 691278 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 691278 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@44a52aca{/solr,null,AVAILABLE}
   [junit4]   2> 691287 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.AbstractConnector Started ServerConnector@1285789d{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:44289}
   [junit4]   2> 691287 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.Server Started @691336ms
   [junit4]   2> 691287 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41251}
   [junit4]   2> 691288 ERROR (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 691288 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 691288 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 9.0.0
   [junit4]   2> 691288 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 691288 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 691288 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-12-26T05:39:20.387382Z
   [junit4]   2> 691289 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 691290 INFO  (zkConnectionManagerCallback-3907-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 691290 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 691291 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 691429 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 691430 WARN  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@663bf3a6[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 691430 WARN  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@663bf3a6[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 691443 WARN  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@43261124[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 691443 WARN  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@43261124[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 691444 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40733/solr
   [junit4]   2> 691460 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 691478 INFO  (zkConnectionManagerCallback-3914-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 691478 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 691582 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 691583 INFO  (zkConnectionManagerCallback-3916-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 691583 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 691585 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 691587 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.ZkController Publish node=127.0.0.1:41251_solr as DOWN
   [junit4]   2> 691588 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 691588 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41251_solr
   [junit4]   2> 691589 INFO  (zkCallback-3872-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 691589 INFO  (zkCallback-3881-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 691589 INFO  (zkCallback-3866-thread-2) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 691589 INFO  (zkCallback-3915-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 691590 WARN  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 691599 INFO  (zkCallback-3896-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 691601 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 691622 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41251.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@41409383
   [junit4]   2> 691635 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41251.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@41409383
   [junit4]   2> 691635 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41251.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@41409383
   [junit4]   2> 691636 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.p.PackageLoader /packages.json updated to version -1
   [junit4]   2> 691637 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_76C576F9E4F582E6-001/tempDir-001/node1/.
   [junit4]   2> 691688 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.TestCloudConsistency Adding proxy for URL: https://127.0.0.1:44289/solr. Proxy: https://127.0.0.1:41251/solr
   [junit4]   2> 691688 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1851428079
   [junit4]   2> 691688 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:42799_solr
   [junit4]   2> 691688 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.ZkController Publish this node as DOWN...
   [junit4]   2> 691688 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.ZkController Publish node=127.0.0.1:42799_solr as DOWN
   [junit4]   2> 691690 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 691690 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@49137e43: rootName = solr_42799, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@55b5cd02
   [junit4]   2> 691697 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 691697 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6c122f60: rootName = solr_42799, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@3591aa1f
   [junit4]   2> 691700 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 691700 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@662c6fd: rootName = solr_42799, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@7f08bd51
   [junit4]   2> 691700 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 691701 INFO  (closeThreadPool-3924-thread-1) [     ] o.a.s.c.Overseer Overseer (id=72248589558546445-127.0.0.1:42799_solr-n_0000000002) closing
   [junit4]   2> 691701 INFO  (OverseerStateUpdate-72248589558546445-127.0.0.1:42799_solr-n_0000000002) [n:127.0.0.1:42799_solr     ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:42799_solr
   [junit4]   2> 691701 INFO  (OverseerAutoScalingTriggerThread-72248589558546445-127.0.0.1:42799_solr-n_0000000002) [     ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 691703 INFO  (closeThreadPool-3924-thread-2) [     ] o.a.s.c.Overseer Overseer (id=72248589558546445-127.0.0.1:42799_solr-n_0000000002) closing
   [junit4]   2> 691708 INFO  (zkCallback-3896-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 691717 INFO  (zkCallback-3915-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 691717 INFO  (zkCallback-3872-thread-1) [     ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38957_solr
   [junit4]   2> 691717 INFO  (zkCallback-3881-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 691718 INFO  (zkCallback-3872-thread-2) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 691718 INFO  (zkCallback-3872-thread-1) [n:127.0.0.1:38957_solr     ] o.a.s.c.Overseer Overseer (id=72248589558546446-127.0.0.1:38957_solr-n_0000000003) starting
   [junit4]   2> 691720 INFO  (OverseerStateUpdate-72248589558546446-127.0.0.1:38957_solr-n_0000000003) [n:127.0.0.1:38957_solr     ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:38957_solr
   [junit4]   2> 691808 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.Overseer Overseer (id=72248589558546445-127.0.0.1:42799_solr-n_0000000002) closing
   [junit4]   2> 691811 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@7a4b4043{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:0}
   [junit4]   2> 691811 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2b802b65{/solr,null,UNAVAILABLE}
   [junit4]   2> 691811 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 691812 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0)
   [junit4]   2> 691813 WARN  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.h.g.GzipHandler minGzipSize of 0 is inefficient for short content, break even is size 23
   [junit4]   2> 691814 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 691814 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.Server jetty-9.4.24.v20191120; built: 2019-11-20T21:37:49.771Z; git: 363d5f2df3a8a28de40604320230664b9c793c16; jvm 14-ea+27-1339
   [junit4]   2> 691851 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 691851 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 691851 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 691851 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3179516c{/solr,null,AVAILABLE}
   [junit4]   2> 691852 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.AbstractConnector Started ServerConnector@19a5a5d3{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:46177}
   [junit4]   2> 691852 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.s.Server Started @691901ms
   [junit4]   2> 691852 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45697}
   [junit4]   2> 691852 ERROR (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 691852 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 691852 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 9.0.0
   [junit4]   2> 691852 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 691852 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 691852 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2019-12-26T05:39:20.951510Z
   [junit4]   2> 691853 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 691854 INFO  (zkConnectionManagerCallback-3926-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 691854 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 691855 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 692033 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=true]
   [junit4]   2> 692034 WARN  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@4c8a8952[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 692034 WARN  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@4c8a8952[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 692036 WARN  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.u.s.S.config Trusting all certificates configured for Client@6a6a958f[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 692036 WARN  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@6a6a958f[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 692037 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40733/solr
   [junit4]   2> 692037 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 692038 INFO  (zkConnectionManagerCallback-3933-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 692038 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 692140 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 692141 INFO  (zkConnectionManagerCallback-3935-thread-1) [     ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 692141 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 692143 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 692144 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.ZkController Publish node=127.0.0.1:45697_solr as DOWN
   [junit4]   2> 692145 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 692145 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45697_solr
   [junit4]   2> 692146 INFO  (zkCallback-3896-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 692146 INFO  (zkCallback-3872-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 692146 INFO  (zkCallback-3881-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 692146 INFO  (zkCallback-3915-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 692146 INFO  (zkCallback-3934-thread-1) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 692147 WARN  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.CoreContainer Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
   [junit4]   2> 692158 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 692181 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45697.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@41409383
   [junit4]   2> 692194 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader-seed#[76C576F9E4F582E6]) [     ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45697.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@41409383
   [junit4]   2> 692194 INFO  (TEST-TestCloudConsistency.testOutOfSyn

[...truncated too long message...]

ck-4209-thread-3) [     ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (1)
   [junit4]   2> 750887 INFO  (jetty-closer-4218-thread-4) [     ] o.a.s.c.Overseer Overseer (id=72248591925051419-127.0.0.1:39721_solr-n_0000000007) closing
   [junit4]   2> 750891 INFO  (jetty-closer-4218-thread-4) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@27599127{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:0}
   [junit4]   2> 750891 INFO  (jetty-closer-4218-thread-4) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6772d8a3{/solr,null,UNAVAILABLE}
   [junit4]   2> 750891 INFO  (jetty-closer-4218-thread-4) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 750988 INFO  (jetty-closer-4218-thread-1) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@2449e765{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:42169}
   [junit4]   2> 750988 INFO  (jetty-closer-4218-thread-1) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@51222163{/solr,null,UNAVAILABLE}
   [junit4]   2> 750988 INFO  (jetty-closer-4218-thread-1) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 756302 ERROR (recoveryExecutor-4174-thread-1-processing-n:127.0.0.1:44233_solr x:outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n3 c:outOfSyncReplicasCannotBecomeLeader-true s:shard1 r:core_node4) [n:127.0.0.1:44233_solr c:outOfSyncReplicasCannotBecomeLeader-true s:shard1 r:core_node4 x:outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n3 ] o.a.s.c.RecoveryStrategy SolrCore not found - cannot recover:outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n3
   [junit4]   2> 756303 ERROR (recoveryExecutor-4190-thread-1-processing-n:127.0.0.1:37215_solr x:outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n5 c:outOfSyncReplicasCannotBecomeLeader-true s:shard1 r:core_node6) [n:127.0.0.1:37215_solr c:outOfSyncReplicasCannotBecomeLeader-true s:shard1 r:core_node6 x:outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n5 ] o.a.s.c.RecoveryStrategy SolrCore not found - cannot recover:outOfSyncReplicasCannotBecomeLeader-true_shard1_replica_n5
   [junit4]   2> 756303 INFO  (jetty-closer-4218-thread-2) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@2f075267{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:46751}
   [junit4]   2> 756304 INFO  (jetty-closer-4218-thread-2) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5fb10acc{/solr,null,UNAVAILABLE}
   [junit4]   2> 756304 INFO  (jetty-closer-4218-thread-3) [     ] o.e.j.s.AbstractConnector Stopped ServerConnector@70fb067b{ssl,[ssl, alpn, http/1.1, h2]}{127.0.0.1:35029}
   [junit4]   2> 756304 INFO  (jetty-closer-4218-thread-2) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 756304 INFO  (jetty-closer-4218-thread-3) [     ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@41c8028f{/solr,null,UNAVAILABLE}
   [junit4]   2> 756304 INFO  (jetty-closer-4218-thread-3) [     ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 756304 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 756506 WARN  (ZkTestServer Run Thread) [     ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	34	/solr/collections/outOfSyncReplicasCannotBecomeLeader-true/terms/shard1
   [junit4]   2> 	12	/solr/aliases.json
   [junit4]   2> 	11	/solr/packages.json
   [junit4]   2> 	11	/solr/security.json
   [junit4]   2> 	8	/solr/collections/outOfSyncReplicasCannotBecomeLeader-true/state.json
   [junit4]   2> 	6	/solr/configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED
   [junit4]   2> 	6	/solr/configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/managed-schema
   [junit4]   2> 	5	/solr/collections/outOfSyncReplicasCannotBecomeLeader-true/collectionprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	120	/solr/collections/outOfSyncReplicasCannotBecomeLeader-true/state.json
   [junit4]   2> 	12	/solr/clusterprops.json
   [junit4]   2> 	12	/solr/clusterstate.json
   [junit4]   2> 	6	/solr/autoscaling.json
   [junit4]   2> 	3	/solr/overseer_elect/election/72248591925051410-127.0.0.1:42037_solr-n_0000000004
   [junit4]   2> 	2	/solr/collections/outOfSyncReplicasCannotBecomeLeader-true/leader_elect/shard1/election/72248591925051410-core_node2-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	83	/solr/overseer/queue
   [junit4]   2> 	82	/solr/live_nodes
   [junit4]   2> 	22	/solr/collections
   [junit4]   2> 	21	/solr/overseer/collection-queue-work
   [junit4]   2> 	6	/solr/autoscaling/events/.scheduled_maintenance
   [junit4]   2> 	6	/solr/autoscaling/events/.auto_add_replicas
   [junit4]   2> 	6	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> 756508 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:34505
   [junit4]   2> 756508 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:34505
   [junit4]   2> 756508 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart-seed#[76C576F9E4F582E6]) [     ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 34505
   [junit4]   2> 756509 INFO  (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart-seed#[76C576F9E4F582E6]) [     ] o.a.s.SolrTestCaseJ4 ###Ending testOutOfSyncReplicasCannotBecomeLeaderAfterRestart
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-BadApples-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_76C576F9E4F582E6-001
   [junit4]   2> Dec 26, 2019 5:40:25 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene84): {}, docValues:{}, maxPointsInLeafNode=869, maxMBSortInHeap=7.1582452084724295, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@7d918f0c), locale=en-SX, timezone=Etc/Greenwich
   [junit4]   2> NOTE: Linux 5.0.0-36-generic amd64/Oracle Corporation 14-ea (64-bit)/cpus=8,threads=1,free=204228968,total=484442112
   [junit4]   2> NOTE: All tests run in this JVM: [DistributedExpandComponentTest, TestSQLHandlerNonCloud, TestSchemaResource, CursorMarkTest, TestReloadAndDeleteDocs, TestTolerantSearch, OutOfBoxZkACLAndCredentialsProvidersTest, TestIntervalFaceting, SolrJmxReporterCloudTest, MultiDestinationAuditLoggerTest, MultiThreadedOCPTest, OverseerTest, TestHttpServletCarrier, TokenizerChainTest, HdfsTlogReplayBufferedWhileIndexingTest, AuditLoggerIntegrationTest, TestPackages, DistributedFacetPivotWhiteBoxTest, TestTrieFacet, ShardRoutingCustomTest, TestExactSharedStatsCache, TestDynamicFieldResource, TestCloudRecovery, MoveReplicaHDFSTest, TestConfigOverlay, SolrTestCaseJ4Test, DirectoryFactoryTest, TestJsonRequest, HdfsRestartWhileUpdatingTest, TestMinMaxOnMultiValuedField, NodeLostTriggerIntegrationTest, TestSimTriggerIntegration, SortSpecParsingTest, SystemCollectionCompatTest, TestDistributedStatsComponentCardinality, DirectSolrConnectionTest, TestBlendedInfixSuggestions, RestoreTriggerStateTest, DirectSolrSpellCheckerTest, TestManagedSynonymFilterFactory, HLLSerializationTest, TestUnifiedSolrHighlighter, TestPrepRecovery, HdfsBasicDistributedZkTest, SolrIndexMetricsTest, SparseHLLTest, VersionInfoTest, WrapperMergePolicyFactoryTest, TestWithCollection, CopyFieldTest, CircularListTest, SpatialRPTFieldTypeTest, TestSha256AuthenticationProvider, AnalysisErrorHandlingTest, HdfsDirectoryTest, MoreLikeThisHandlerTest, TestScoreJoinQPScore, ZkStateReaderTest, AssignTest, TestComplexPhraseQParserPlugin, TimeZoneUtilsTest, HighlighterMaxOffsetTest, TestReplicationHandler, TestOmitPositions, OverseerSolrResponseUnsafeSerializationTest, RemoteQueryErrorTest, TestSolrIndexConfig, TestJsonFacetRefinement, TestMaxTokenLenTokenizer, TestLockTree, ConfigSetsAPITest, TestDocumentBuilder, TestSerializedLuceneMatchVersion, TestDistribDocBasedVersion, ReplicationFactorTest, TestSkipOverseerOperations, ZkNodePropsTest, TestCloudConsistency]
   [junit4] Completed [249/894 (1!)] on J2 in 67.80s, 2 tests, 1 failure <<< FAILURES!

[...truncated 47170 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-BadApples-master-Linux/309/consoleText

[repro] Revision: 7350f03cd1070b29f90617ab7e04b4f28e0e8e30

[repro] Repro line:  ant test  -Dtestcase=TestCloudConsistency -Dtests.method=testOutOfSyncReplicasCannotBecomeLeader -Dtests.seed=76C576F9E4F582E6 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=en-SX -Dtests.timezone=Etc/Greenwich -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1

[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       TestCloudConsistency
[repro] ant compile-test

[...truncated 3333 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestCloudConsistency" -Dtests.showOutput=onerror  -Dtests.seed=76C576F9E4F582E6 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=en-SX -Dtests.timezone=Etc/Greenwich -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1

[...truncated 80 lines...]
[repro] Failures w/original seeds:
[repro]   0/5 failed: org.apache.solr.cloud.TestCloudConsistency
[repro] Exiting with code 0

[...truncated 43 lines...]