You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2016/10/03 05:31:01 UTC

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_102) - Build # 17957 - Still Failing!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/17957/
Java: 64bit/jdk1.8.0_102 -XX:+UseCompressedOops -XX:+UseG1GC

All tests passed

Build Log:
[...truncated 13242 lines...]
   [junit4] JVM J1: stdout was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/temp/junit4-J1-20161003_052806_137.sysout
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: Java heap space
   [junit4] Dumping heap to /home/jenkins/workspace/Lucene-Solr-master-Linux/heapdumps/java_pid3460.hprof ...
   [junit4] Heap dump file created [603454506 bytes in 2.966 secs]
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/temp/junit4-J1-20161003_052806_137.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] 
   [junit4] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "aliveCheckExecutor-247-thread-1"
   [junit4] 
   [junit4] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "qtp1784680434-1554"
   [junit4] 
   [junit4] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "Connection evictor"
   [junit4] 
   [junit4] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "Connection evictor"
   [junit4] 
   [junit4] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "Connection evictor"
   [junit4] 
   [junit4] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "Connection evictor"
   [junit4] 
   [junit4] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "Connection evictor"
   [junit4] 
   [junit4] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "Connection evictor"
   [junit4] 
   [junit4] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "Connection evictor"
   [junit4] 
   [junit4] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "Connection evictor"
   [junit4] 
   [junit4] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "org.eclipse.jetty.server.session.HashSessionManager@3feaf9eTimer"
   [junit4] 
   [junit4] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "org.eclipse.jetty.server.session.HashSessionManager@22dcec18Timer"
   [junit4] 
   [junit4] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "org.eclipse.jetty.server.session.HashSessionManager@5174244fTimer"
   [junit4] 
   [junit4] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "SUITE-TestLBHttpSolrClient-seed#[92296505D1CEEF69]"
   [junit4] WARN: JVM out of memory. -> java.lang.OutOfMemoryError: Java heap space
   [junit4] <<< JVM J1: EOF ----

[...truncated 4 lines...]
   [junit4] ERROR: JVM J1 ended with an exception, command line: /home/jenkins/tools/java/64bit/jdk1.8.0_102/jre/bin/java -XX:+UseCompressedOops -XX:+UseG1GC -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/jenkins/workspace/Lucene-Solr-master-Linux/heapdumps -ea -esa -Dtests.prefix=tests -Dtests.seed=92296505D1CEEF69 -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=7.0.0 -Dtests.cleanthreads=perClass -Djava.util.logging.config.file=/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/tools/junit4/logging.properties -Dtests.nightly=false -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=3 -DtempDir=./temp -Djava.io.tmpdir=./temp -Djunit4.tempDir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/temp -Dcommon.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene -Dclover.db.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/clover/db -Djava.security.policy=/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/tools/junit4/solr-tests.policy -Dtests.LUCENE_VERSION=7.0.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Djunit4.childvm.cwd=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/J1 -Djunit4.childvm.id=1 -Djunit4.childvm.count=3 -Dtests.leaveTemporary=false -Dtests.filterstacks=true -Dtests.disableHdfs=true -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Dfile.encoding=ISO-8859-1 -classpath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/classes/test:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/test-lib/slf4j-log4j12-1.7.7.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-test-framework/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/src/test-files:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/commons-io-2.5.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/guava-14.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/httpclient-4.4.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/httpcore-4.4.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/httpmime-4.4.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/jackson-annotations-2.5.4.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/jackson-core-2.5.4.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/jackson-databind-2.5.4.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/jcl-over-slf4j-1.7.7.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/noggit-0.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/slf4j-api-1.7.7.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/stax2-api-3.1.4.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/woodstox-core-asl-4.4.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/solrj/lib/zookeeper-3.4.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/test-framework/lib/junit-4.10.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.3.4.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/lucene-analyzers-common-7.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-7.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-7.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/lucene-codecs-7.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/lucene-backward-codecs-7.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/lucene-highlighter-7.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/memory/lucene-memory-7.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/lucene-misc-7.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/lucene-spatial-extras-7.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/lucene-expressions-7.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/lucene-suggest-7.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/lucene-grouping-7.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/lucene-queries-7.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/lucene-queryparser-7.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/lucene-join-7.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/lucene-sandbox-7.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/lucene-classification-7.0.0-SNAPSHOT.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/antlr4-runtime-4.5.1-1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/asm-5.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/asm-commons-5.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/caffeine-1.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-cli-1.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-codec-1.10.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-collections-3.2.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-configuration-1.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-exec-1.3.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-fileupload-1.3.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-io-2.5.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/commons-lang-2.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/curator-client-2.8.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/curator-framework-2.8.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/curator-recipes-2.8.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/dom4j-1.6.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/guava-14.0.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/hadoop-annotations-2.7.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/hadoop-auth-2.7.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/hadoop-common-2.7.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/hadoop-hdfs-2.7.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/hppc-0.7.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/htrace-core-3.2.0-incubating.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/jackson-core-2.5.4.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/jackson-core-asl-1.9.13.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/jackson-dataformat-smile-2.5.4.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/jackson-mapper-asl-1.9.13.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/jcl-over-slf4j-1.7.7.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/joda-time-2.2.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/log4j-1.2.17.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/org.restlet-2.3.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/org.restlet.ext.servlet-2.3.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/presto-parser-0.122.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/protobuf-java-2.5.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/slf4j-log4j12-1.7.7.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/slice-0.10.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/spatial4j-0.6.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/lib/t-digest-3.1.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/javax.servlet-api-3.1.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-continuation-9.3.8.v20160314.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-deploy-9.3.8.v20160314.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-http-9.3.8.v20160314.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-io-9.3.8.v20160314.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-jmx-9.3.8.v20160314.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-rewrite-9.3.8.v20160314.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-security-9.3.8.v20160314.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-server-9.3.8.v20160314.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-servlet-9.3.8.v20160314.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-servlets-9.3.8.v20160314.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-util-9.3.8.v20160314.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-webapp-9.3.8.v20160314.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/server/lib/jetty-xml-9.3.8.v20160314.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/classes/java:/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/example/resources:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.3.0.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-testutil.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-netrexx.jar:/home/jenkins/tools/java/64bit/jdk1.8.0_102/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.3.4.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/temp/junit4-J1-20161003_052806_137.events @/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/temp/junit4-J1-20161003_052806_137.suites -stdin
   [junit4] ERROR: JVM J1 ended with an exception: Forked JVM ran out of memory. See process stdout at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/temp/junit4-J1-20161003_052806_137.sysout See process stderr at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/temp/junit4-J1-20161003_052806_137.syserr
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1481)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:121)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:955)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:952)
   [junit4] 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4] 	at java.lang.Thread.run(Thread.java:745)

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:763: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:707: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:59: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build.xml:265: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/common-build.xml:536: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1443: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:984: At least one slave process threw an exception, first: Forked JVM ran out of memory. See process stdout at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/temp/junit4-J1-20161003_052806_137.sysout See process stderr at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/temp/junit4-J1-20161003_052806_137.syserr

Total time: 59 minutes 56 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS-EA] Lucene-Solr-master-Linux (32bit/jdk-9-ea+136) - Build # 17958 - Still unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/17958/
Java: 32bit/jdk-9-ea+136 -server -XX:+UseSerialGC

1 tests failed.
FAILED:  org.apache.solr.cloud.TestSolrCloudWithDelegationTokens.testDelegationTokenRenew

Error Message:
expected:<200> but was:<403>

Stack Trace:
java.lang.AssertionError: expected:<200> but was:<403>
	at __randomizedtesting.SeedInfo.seed([838F48D068278884:B414BCCE50EB5520]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.cloud.TestSolrCloudWithDelegationTokens.renewDelegationToken(TestSolrCloudWithDelegationTokens.java:127)
	at org.apache.solr.cloud.TestSolrCloudWithDelegationTokens.verifyDelegationTokenRenew(TestSolrCloudWithDelegationTokens.java:303)
	at org.apache.solr.cloud.TestSolrCloudWithDelegationTokens.testDelegationTokenRenew(TestSolrCloudWithDelegationTokens.java:320)
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(java.base@9-ea/Native Method)
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(java.base@9-ea/NativeMethodAccessorImpl.java:62)
	at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(java.base@9-ea/DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(java.base@9-ea/Method.java:535)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(java.base@9-ea/Thread.java:843)




Build Log:
[...truncated 12119 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestSolrCloudWithDelegationTokens
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithDelegationTokens_838F48D068278884-001/init-core-data-001
   [junit4]   2> 1796982 INFO  (SUITE-TestSolrCloudWithDelegationTokens-seed#[838F48D068278884]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 1796984 INFO  (SUITE-TestSolrCloudWithDelegationTokens-seed#[838F48D068278884]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1796984 INFO  (Thread-3673) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1796984 INFO  (Thread-3673) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1797085 INFO  (SUITE-TestSolrCloudWithDelegationTokens-seed#[838F48D068278884]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:44101
   [junit4]   2> 1797088 INFO  (jetty-launcher-2779-thread-1) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 1797088 INFO  (jetty-launcher-2779-thread-2) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 1797089 INFO  (jetty-launcher-2779-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1895f56{/solr,null,AVAILABLE}
   [junit4]   2> 1797089 INFO  (jetty-launcher-2779-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@10c1c1b{/solr,null,AVAILABLE}
   [junit4]   2> 1797090 INFO  (jetty-launcher-2779-thread-1) [    ] o.e.j.s.ServerConnector Started ServerConnector@894ec0{HTTP/1.1,[http/1.1]}{127.0.0.1:38575}
   [junit4]   2> 1797090 INFO  (jetty-launcher-2779-thread-2) [    ] o.e.j.s.ServerConnector Started ServerConnector@5649dd{HTTP/1.1,[http/1.1]}{127.0.0.1:34563}
   [junit4]   2> 1797090 INFO  (jetty-launcher-2779-thread-1) [    ] o.e.j.s.Server Started @1799262ms
   [junit4]   2> 1797091 INFO  (jetty-launcher-2779-thread-2) [    ] o.e.j.s.Server Started @1799262ms
   [junit4]   2> 1797091 INFO  (jetty-launcher-2779-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38575}
   [junit4]   2> 1797091 INFO  (jetty-launcher-2779-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34563}
   [junit4]   2> 1797091 INFO  (jetty-launcher-2779-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.0.0
   [junit4]   2> 1797091 INFO  (jetty-launcher-2779-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 7.0.0
   [junit4]   2> 1797091 INFO  (jetty-launcher-2779-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1797091 INFO  (jetty-launcher-2779-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1797091 INFO  (jetty-launcher-2779-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1797091 INFO  (jetty-launcher-2779-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1797091 INFO  (jetty-launcher-2779-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2016-10-03T08:25:52.442531Z
   [junit4]   2> 1797091 INFO  (jetty-launcher-2779-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2016-10-03T08:25:52.442575Z
   [junit4]   2> 1797092 INFO  (jetty-launcher-2779-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1797092 INFO  (jetty-launcher-2779-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1797096 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15789a62fd00001, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(java.base@9-ea/Thread.java:843)
   [junit4]   2> 1797097 INFO  (jetty-launcher-2779-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44101/solr
   [junit4]   2> 1797097 INFO  (jetty-launcher-2779-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44101/solr
   [junit4]   2> 1797108 INFO  (jetty-launcher-2779-thread-2) [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:34563_solr
   [junit4]   2> 1797108 INFO  (jetty-launcher-2779-thread-1) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38575_solr
   [junit4]   2> 1797109 INFO  (jetty-launcher-2779-thread-2) [    ] o.a.s.c.Overseer Overseer (id=96697263871492101-127.0.0.1:34563_solr-n_0000000000) starting
   [junit4]   2> 1797109 INFO  (zkCallback-2790-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1797110 INFO  (zkCallback-2789-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1797114 INFO  (jetty-launcher-2779-thread-2) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34563_solr
   [junit4]   2> 1797115 INFO  (zkCallback-2790-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1797115 INFO  (zkCallback-2789-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1797133 INFO  (jetty-launcher-2779-thread-2) [    ] o.a.s.c.CoreContainer Authentication plugin class obtained from system property 'authenticationPlugin': org.apache.solr.security.HttpParamDelegationTokenPlugin
   [junit4]   2> 1797137 INFO  (jetty-launcher-2779-thread-1) [    ] o.a.s.c.CoreContainer Authentication plugin class obtained from system property 'authenticationPlugin': org.apache.solr.security.HttpParamDelegationTokenPlugin
   [junit4]   2> 1797154 INFO  (jetty-launcher-2779-thread-1) [    ] o.a.s.s.KerberosPlugin Params: {token.valid=30, delegation-token.token-kind=solr-dt, cookie.domain=127.0.0.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, token.validity=36000, signer.secret.provider.zookeeper.path=/token, type=kerberos, zk-dt-secret-manager.enable=true, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper}
   [junit4]   2> 1797154 INFO  (jetty-launcher-2779-thread-2) [    ] o.a.s.s.KerberosPlugin Params: {token.valid=30, delegation-token.token-kind=solr-dt, cookie.domain=127.0.0.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, token.validity=36000, signer.secret.provider.zookeeper.path=/token, type=kerberos, zk-dt-secret-manager.enable=true, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper}
   [junit4]   2> 1797243 INFO  (jetty-launcher-2779-thread-1) [    ] o.a.c.f.i.CuratorFrameworkImpl Starting
   [junit4]   2> 1797243 INFO  (jetty-launcher-2779-thread-2) [    ] o.a.c.f.i.CuratorFrameworkImpl Starting
   [junit4]   2> 1797258 INFO  (jetty-launcher-2779-thread-1-EventThread) [    ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
   [junit4]   2> 1797258 INFO  (jetty-launcher-2779-thread-2-EventThread) [    ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
   [junit4]   2> 1797415 INFO  (jetty-launcher-2779-thread-2) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithDelegationTokens_838F48D068278884-001/tempDir-001/node2/.
   [junit4]   2> 1797415 INFO  (jetty-launcher-2779-thread-1) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithDelegationTokens_838F48D068278884-001/tempDir-001/node1/.
   [junit4]   2> 1797439 INFO  (TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenCancel-seed#[838F48D068278884]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationTokenCancel
   [junit4]   2> 1797847 ERROR (qtp2259171-15982) [    ] o.a.h.s.t.d.ZKDelegationTokenSecretManager No node in path [/ZKDTSMTokensRoot/DT_1]
   [junit4]   2> 1797877 WARN  (TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenCancel-seed#[838F48D068278884]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Path=/; Domain=127.0.0.1; Expires=quinta, 01-jan-1970 00:00:00 GMT; HttpOnly". Invalid 'expires' attribute: quinta, 01-jan-1970 00:00:00 GMT
   [junit4]   2> 1797880 WARN  (TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenCancel-seed#[838F48D068278884]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Path=/; Domain=127.0.0.1; Expires=quinta, 01-jan-1970 00:00:00 GMT; HttpOnly". Invalid 'expires' attribute: quinta, 01-jan-1970 00:00:00 GMT
   [junit4]   2> 1797893 ERROR (qtp5472696-15997) [    ] o.a.h.s.t.d.ZKDelegationTokenSecretManager No node in path [/ZKDTSMTokensRoot/DT_2]
   [junit4]   2> 1797898 WARN  (TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenCancel-seed#[838F48D068278884]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Path=/; Domain=127.0.0.1; Expires=quinta, 01-jan-1970 00:00:00 GMT; HttpOnly". Invalid 'expires' attribute: quinta, 01-jan-1970 00:00:00 GMT
   [junit4]   2> 1797900 WARN  (TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenCancel-seed#[838F48D068278884]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Path=/; Domain=127.0.0.1; Expires=quinta, 01-jan-1970 00:00:00 GMT; HttpOnly". Invalid 'expires' attribute: quinta, 01-jan-1970 00:00:00 GMT
   [junit4]   2> 1797900 INFO  (TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenCancel-seed#[838F48D068278884]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationTokenCancel
   [junit4]   2> 1797919 INFO  (TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenRenew-seed#[838F48D068278884]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationTokenRenew
   [junit4]   2> 1797930 WARN  (qtp2259171-15992) [    ] o.a.h.s.a.s.AuthenticationFilter Authentication exception: org.apache.hadoop.security.AccessControlException: bar is trying to renew a token with wrong password
   [junit4]   2> 1797931 WARN  (qtp2259171-15992) [    ] o.a.s.s.KerberosPlugin Could not find org.apache.solr.security.kerberosplugin.requestcontinues
   [junit4]   2> 1797931 WARN  (TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenRenew-seed#[838F48D068278884]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Path=/; Domain=127.0.0.1; Expires=quinta, 01-jan-1970 00:00:00 GMT; HttpOnly". Invalid 'expires' attribute: quinta, 01-jan-1970 00:00:00 GMT
   [junit4]   2> 1797932 INFO  (TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenRenew-seed#[838F48D068278884]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationTokenRenew
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSolrCloudWithDelegationTokens -Dtests.method=testDelegationTokenRenew -Dtests.seed=838F48D068278884 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=pt-AO -Dtests.timezone=Asia/Dubai -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 0.03s J0 | TestSolrCloudWithDelegationTokens.testDelegationTokenRenew <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: expected:<200> but was:<403>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([838F48D068278884:B414BCCE50EB5520]:0)
   [junit4]    > 	at org.apache.solr.cloud.TestSolrCloudWithDelegationTokens.renewDelegationToken(TestSolrCloudWithDelegationTokens.java:127)
   [junit4]    > 	at org.apache.solr.cloud.TestSolrCloudWithDelegationTokens.verifyDelegationTokenRenew(TestSolrCloudWithDelegationTokens.java:303)
   [junit4]    > 	at org.apache.solr.cloud.TestSolrCloudWithDelegationTokens.testDelegationTokenRenew(TestSolrCloudWithDelegationTokens.java:320)
   [junit4]    > 	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(java.base@9-ea/Native Method)
   [junit4]    > 	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(java.base@9-ea/NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(java.base@9-ea/DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.lang.Thread.run(java.base@9-ea/Thread.java:843)
   [junit4]   2> 1797947 INFO  (TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenSolrClient-seed#[838F48D068278884]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationTokenSolrClient
   [junit4]   2> 1797957 WARN  (TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenSolrClient-seed#[838F48D068278884]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Path=/; Domain=127.0.0.1; Expires=quinta, 01-jan-1970 00:00:00 GMT; HttpOnly". Invalid 'expires' attribute: quinta, 01-jan-1970 00:00:00 GMT
   [junit4]   2> 1797966 INFO  (qtp2259171-15986) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&delegation=GgADYmFyA2JhcgCKAVeJpjOTigFXrbK3kwQEFGc17h0BIGzzYOjfCg_X3fSI_QiZB3NvbHItZHQA&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1797967 INFO  (qtp2259171-15986) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&delegation=GgADYmFyA2JhcgCKAVeJpjOTigFXrbK3kwQEFGc17h0BIGzzYOjfCg_X3fSI_QiZB3NvbHItZHQA&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1797967 INFO  (TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenSolrClient-seed#[838F48D068278884]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationTokenSolrClient
   [junit4]   2> 1797984 INFO  (TEST-TestSolrCloudWithDelegationTokens.testZNodePaths-seed#[838F48D068278884]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testZNodePaths
   [junit4]   2> 1797993 INFO  (TEST-TestSolrCloudWithDelegationTokens.testZNodePaths-seed#[838F48D068278884]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testZNodePaths
   [junit4]   2> 1798008 INFO  (TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenCancelFail-seed#[838F48D068278884]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationTokenCancelFail
   [junit4]   2> 1798020 ERROR (qtp5472696-15993) [    ] o.a.h.s.t.d.ZKDelegationTokenSecretManager No node in path [/ZKDTSMTokensRoot/DT_6]
   [junit4]   2> 1798021 ERROR (qtp2259171-15996) [    ] o.a.h.s.t.d.ZKDelegationTokenSecretManager No node in path [/ZKDTSMTokensRoot/DT_6]
   [junit4]   2> 1798030 ERROR (qtp5472696-15997) [    ] o.a.h.s.t.d.ZKDelegationTokenSecretManager No node in path [/ZKDTSMTokensRoot/DT_7]
   [junit4]   2> 1798031 ERROR (qtp2259171-15982) [    ] o.a.h.s.t.d.ZKDelegationTokenSecretManager No node in path [/ZKDTSMTokensRoot/DT_7]
   [junit4]   2> 1798031 INFO  (TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenCancelFail-seed#[838F48D068278884]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationTokenCancelFail
   [junit4]   2> 1798046 INFO  (TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenVerify-seed#[838F48D068278884]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationTokenVerify
   [junit4]   2> 1798056 INFO  (qtp2259171-15986) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&delegation=GgADYmFyA2JhcgCKAVeJpjP2igFXrbK39ggEFMZ_78HLi1QgKQC72VZ-HUtWimPsB3NvbHItZHQA&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1798056 INFO  (qtp2259171-15986) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&delegation=GgADYmFyA2JhcgCKAVeJpjP2igFXrbK39ggEFMZ_78HLi1QgKQC72VZ-HUtWimPsB3NvbHItZHQA&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1798058 WARN  (TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenVerify-seed#[838F48D068278884]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Path=/; Domain=127.0.0.1; Expires=quinta, 01-jan-1970 00:00:00 GMT; HttpOnly". Invalid 'expires' attribute: quinta, 01-jan-1970 00:00:00 GMT
   [junit4]   2> 1798059 INFO  (qtp5472696-15993) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&delegation=GgADYmFyA2JhcgCKAVeJpjP2igFXrbK39ggEFMZ_78HLi1QgKQC72VZ-HUtWimPsB3NvbHItZHQA&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1798060 INFO  (qtp5472696-15993) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&delegation=GgADYmFyA2JhcgCKAVeJpjP2igFXrbK39ggEFMZ_78HLi1QgKQC72VZ-HUtWimPsB3NvbHItZHQA&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1798062 WARN  (TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenVerify-seed#[838F48D068278884]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Path=/; Domain=127.0.0.1; Expires=quinta, 01-jan-1970 00:00:00 GMT; HttpOnly". Invalid 'expires' attribute: quinta, 01-jan-1970 00:00:00 GMT
   [junit4]   2> 1798063 INFO  (TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenVerify-seed#[838F48D068278884]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationTokenVerify
   [junit4]   2> 1798078 INFO  (TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenRenewFail-seed#[838F48D068278884]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationTokenRenewFail
   [junit4]   2> 1798086 WARN  (qtp2259171-15986) [    ] o.a.h.s.a.s.AuthenticationFilter Authentication exception: org.apache.hadoop.security.AccessControlException: foo tries to renew a token with renewer bar
   [junit4]   2> 1798087 WARN  (qtp2259171-15986) [    ] o.a.s.s.KerberosPlugin Could not find org.apache.solr.security.kerberosplugin.requestcontinues
   [junit4]   2> 1798087 WARN  (TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenRenewFail-seed#[838F48D068278884]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Path=/; Domain=127.0.0.1; Expires=quinta, 01-jan-1970 00:00:00 GMT; HttpOnly". Invalid 'expires' attribute: quinta, 01-jan-1970 00:00:00 GMT
   [junit4]   2> 1798088 WARN  (qtp5472696-15997) [    ] o.a.h.s.a.s.AuthenticationFilter Authentication exception: org.apache.hadoop.security.AccessControlException: foo tries to renew a token with renewer bar
   [junit4]   2> 1798088 WARN  (qtp5472696-15997) [    ] o.a.s.s.KerberosPlugin Could not find org.apache.solr.security.kerberosplugin.requestcontinues
   [junit4]   2> 1798089 WARN  (TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenRenewFail-seed#[838F48D068278884]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Path=/; Domain=127.0.0.1; Expires=quinta, 01-jan-1970 00:00:00 GMT; HttpOnly". Invalid 'expires' attribute: quinta, 01-jan-1970 00:00:00 GMT
   [junit4]   2> 1798094 WARN  (qtp2259171-15994) [    ] o.a.h.s.a.s.AuthenticationFilter Authentication exception: org.apache.hadoop.security.AccessControlException: notRenewUser tries to renew a token with renewer renewUser
   [junit4]   2> 1798095 WARN  (qtp2259171-15994) [    ] o.a.s.s.KerberosPlugin Could not find org.apache.solr.security.kerberosplugin.requestcontinues
   [junit4]   2> 1798095 WARN  (TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenRenewFail-seed#[838F48D068278884]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Path=/; Domain=127.0.0.1; Expires=quinta, 01-jan-1970 00:00:00 GMT; HttpOnly". Invalid 'expires' attribute: quinta, 01-jan-1970 00:00:00 GMT
   [junit4]   2> 1798096 WARN  (qtp5472696-15995) [    ] o.a.h.s.a.s.AuthenticationFilter Authentication exception: org.apache.hadoop.security.AccessControlException: notRenewUser tries to renew a token with renewer renewUser
   [junit4]   2> 1798096 WARN  (qtp5472696-15995) [    ] o.a.s.s.KerberosPlugin Could not find org.apache.solr.security.kerberosplugin.requestcontinues
   [junit4]   2> 1798096 WARN  (TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenRenewFail-seed#[838F48D068278884]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth=; Path=/; Domain=127.0.0.1; Expires=quinta, 01-jan-1970 00:00:00 GMT; HttpOnly". Invalid 'expires' attribute: quinta, 01-jan-1970 00:00:00 GMT
   [junit4]   2> 1798096 INFO  (TEST-TestSolrCloudWithDelegationTokens.testDelegationTokenRenewFail-seed#[838F48D068278884]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationTokenRenewFail
   [junit4]   2> 1798112 INFO  (TEST-TestSolrCloudWithDelegationTokens.testDelegationOtherOp-seed#[838F48D068278884]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testDelegationOtherOp
   [junit4]   2> 1798115 INFO  (qtp2259171-15986) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params op=someSolrOperation&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1798115 INFO  (qtp2259171-15986) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={op=someSolrOperation&action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1798115 WARN  (TEST-TestSolrCloudWithDelegationTokens.testDelegationOtherOp-seed#[838F48D068278884]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bar&p=bar&t=test&e=1475519153465&s=Rupru6Zfx5COkO/BA1LHzPzAY/U="; Path=/; Domain=127.0.0.1; Expires=segunda, 03-out-2016 18:25:53 GMT; HttpOnly". Invalid 'expires' attribute: segunda, 03-out-2016 18:25:53 GMT
   [junit4]   2> 1798116 INFO  (TEST-TestSolrCloudWithDelegationTokens.testDelegationOtherOp-seed#[838F48D068278884]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testDelegationOtherOp
   [junit4]   2> 1798116 INFO  (jetty-launcher-2779-thread-2) [    ] o.e.j.s.ServerConnector Stopped ServerConnector@5649dd{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1798116 INFO  (jetty-launcher-2779-thread-1) [    ] o.e.j.s.ServerConnector Stopped ServerConnector@894ec0{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1798116 INFO  (jetty-launcher-2779-thread-2) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2534108
   [junit4]   2> 1798116 INFO  (jetty-launcher-2779-thread-1) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=7941692
   [junit4]   2> 1798118 INFO  (jetty-launcher-2779-thread-2) [    ] o.a.s.c.Overseer Overseer (id=96697263871492101-127.0.0.1:34563_solr-n_0000000000) closing
   [junit4]   2> 1798118 INFO  (OverseerStateUpdate-96697263871492101-127.0.0.1:34563_solr-n_0000000000) [    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:34563_solr
   [junit4]   2> 1798118 WARN  (zkCallback-2790-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1798118 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15789a62fd00005, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(java.base@9-ea/Thread.java:843)
   [junit4]   2> 1798118 ERROR (Thread[Thread-3692,5,TGRP-TestSolrCloudWithDelegationTokens]) [    ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 1798126 INFO  (jetty-launcher-2779-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@10c1c1b{/solr,null,UNAVAILABLE}
   [junit4]   2> 1799618 WARN  (zkCallback-2789-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1799618 ERROR (Thread[Thread-3691,5,TGRP-TestSolrCloudWithDelegationTokens]) [    ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 1799619 INFO  (jetty-launcher-2779-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1895f56{/solr,null,UNAVAILABLE}
   [junit4]   2> 1799620 INFO  (SUITE-TestSolrCloudWithDelegationTokens-seed#[838F48D068278884]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:44101 44101
   [junit4]   2> 1799775 INFO  (Thread-3673) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:44101 44101
   [junit4]   2> 1799775 WARN  (Thread-3673) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	2	/solr/aliases.json
   [junit4]   2> 	2	/solr/security.json
   [junit4]   2> 	2	/solr/clusterprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	4	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMKeyIdRoot
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_7
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_6
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_9
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_8
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_1
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_1
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_3
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_2
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_2
   [junit4]   2> 	2	/solr/clusterstate.json
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_5
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_4
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_4
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMSeqNumRoot
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot/DT_10
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	2	/solr/overseer/queue
   [junit4]   2> 	2	/solr/live_nodes
   [junit4]   2> 	2	/solr/collections
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot
   [junit4]   2> 	2	/solr/overseer/queue-work
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot
   [junit4]   2> 
   [junit4]   2> 1799775 INFO  (SUITE-TestSolrCloudWithDelegationTokens-seed#[838F48D068278884]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithDelegationTokens_838F48D068278884-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene62): {}, docValues:{}, maxPointsInLeafNode=1612, maxMBSortInHeap=6.371556367550253, sim=RandomSimilarity(queryNorm=false): {}, locale=pt-AO, timezone=Asia/Dubai
   [junit4]   2> NOTE: Linux 4.4.0-36-generic i386/Oracle Corporation 9-ea (32-bit)/cpus=12,threads=1,free=85955904,total=422641664
   [junit4]   2> NOTE: All tests run in this JVM: [VMParamsZkACLAndCredentialsProvidersTest, SpatialRPTFieldTypeTest, SolrCLIZkUtilsTest, SolrRequestParserTest, ActionThrottleTest, TestFieldCacheReopen, TestReqParamsAPI, TestCSVLoader, TestAddFieldRealTimeGet, DocumentAnalysisRequestHandlerTest, SharedFSAutoReplicaFailoverTest, TestSolrDeletionPolicy2, TestBackupRepositoryFactory, TestFreeTextSuggestions, SmileWriterTest, ClusterStateTest, TestLFUCache, CdcrRequestHandlerTest, BasicZkTest, HdfsRestartWhileUpdatingTest, TestJoin, AsyncCallRequestStatusResponseTest, XsltUpdateRequestHandlerTest, TestRangeQuery, TestStressLucene, TestSolrCoreProperties, TestSolrConfigHandlerCloud, TestOrdValues, TestImplicitCoreProperties, CollectionsAPISolrJTest, ConnectionManagerTest, TestExclusionRuleCollectionAccess, TestUniqueKeyFieldResource, UniqFieldsUpdateProcessorFactoryTest, TestPerFieldSimilarityWithDefaultOverride, TestRandomFlRTGCloud, OverseerCollectionConfigSetProcessorTest, TestLMJelinekMercerSimilarityFactory, TestSolrCoreSnapshots, TestQueryWrapperFilter, CoreAdminRequestStatusTest, TestLRUStatsCache, HdfsChaosMonkeyNothingIsSafeTest, TestLocalFSCloudBackupRestore, TestSolrConfigHandler, ParsingFieldUpdateProcessorsTest, TestFastWriter, ZkStateWriterTest, TestFoldingMultitermQuery, PluginInfoTest, GraphQueryTest, CopyFieldTest, TestRemoteStreaming, TestUninvertingReader, TestSchemaResource, MultiThreadedOCPTest, BlockDirectoryTest, TestLeaderElectionZkExpiry, PingRequestHandlerTest, HdfsNNFailoverTest, TestReplicationHandler, CachingDirectoryFactoryTest, TolerantUpdateProcessorTest, UUIDFieldTest, TestLRUCache, TestDFRSimilarityFactory, PolyFieldTest, TestFaceting, DateMathParserTest, AnalyticsMergeStrategyTest, QueryElevationComponentTest, TestObjectReleaseTracker, TestHighlightDedupGrouping, TestSearcherReuse, SpatialHeatmapFacetsTest, LeaderElectionIntegrationTest, TestRTGBase, ZkNodePropsTest, TestRawTransformer, TestRealTimeGet, SearchHandlerTest, TestSlowCompositeReaderWrapper, TestCopyFieldCollectionResource, TestComplexPhraseQParserPlugin, SpellPossibilityIteratorTest, ReturnFieldsTest, TestLazyCores, SecurityConfHandlerTest, TestCodecSupport, DistributedFacetPivotSmallTest, FileBasedSpellCheckerTest, SSLMigrationTest, TestAnalyzedSuggestions, TestMacroExpander, MinimalSchemaTest, TestJmxIntegration, RecoveryAfterSoftCommitTest, DistributedQueryComponentOptimizationTest, BasicDistributedZkTest, CdcrUpdateLogTest, DateRangeFieldTest, CurrencyFieldOpenExchangeTest, SyncSliceTest, TestRandomDVFaceting, DistributedSpellCheckComponentTest, TestReload, DistributedTermsComponentTest, SolrCoreTest, PeerSyncTest, ConvertedLegacyTest, TestFiltering, TestTrie, SuggesterWFSTTest, SchemaVersionSpecificBehaviorTest, SolrCoreCheckLockOnStartupTest, TestPseudoReturnFields, TestUpdate, TestAtomicUpdateErrorCases, QueryEqualityTest, StatelessScriptUpdateProcessorFactoryTest, DisMaxRequestHandlerTest, TestQueryTypes, TestOmitPositions, DocumentBuilderTest, TermVectorComponentTest, FastVectorHighlighterTest, TestQuerySenderListener, TestQuerySenderNoQuery, ResponseLogComponentTest, MultiTermTest, TestDocSet, TestPhraseSuggestions, TestSuggestSpellingConverter, SpellingQueryConverterTest, SliceStateTest, DistributedIntervalFacetingTest, TestTolerantSearch, ConnectionReuseTest, CdcrReplicationHandlerTest, CleanupOldIndexTest, CloudExitableDirectoryReaderTest, CollectionTooManyReplicasTest, DeleteInactiveReplicaTest, DeleteLastCustomShardedReplicaTest, DeleteReplicaTest, DeleteStatusTest, DistribCursorPagingTest, DistributedVersionInfoTest, LeaderFailureAfterFreshStartTest, LeaderInitiatedRecoveryOnCommitTest, LeaderInitiatedRecoveryOnShardRestartTest, MigrateRouteKeyTest, OverseerStatusTest, SharedFSAutoReplicaFailoverUtilsTest, SolrCloudExampleTest, TestCloudPivotFacet, TestConfigSetsAPIZkFailure, TestCryptoKeys, TestLeaderRecoverFromLogOnStartup, TestMiniSolrCloudClusterSSL, TestRandomRequestDistribution, TestReplicaProperties, TestSizeLimitedDistributedMap, TestSolrCloudWithDelegationTokens]
   [junit4] Completed [495/636 (1!)] on J0 in 2.81s, 8 tests, 1 failure <<< FAILURES!

[...truncated 50285 lines...]