You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2017/01/08 13:59:06 UTC

[JENKINS] Lucene-Solr-6.x-MacOSX (64bit/jdk1.8.0) - Build # 630 - Failure!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-6.x-MacOSX/630/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseSerialGC

All tests passed

Build Log:
[...truncated 13426 lines...]
   [junit4] JVM J1: stdout was not empty, see: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-solrj/test/temp/junit4-J1-20170108_135210_592.sysout
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] #
   [junit4] # A fatal error has been detected by the Java Runtime Environment:
   [junit4] #
   [junit4] #  Internal Error (sharedRuntime.cpp:873), pid=40282, tid=0x0000000000004b37
   [junit4] #  guarantee(nm != NULL) failed: must have containing nmethod for implicit division-by-zero exceptions
   [junit4] #
   [junit4] # JRE version: Java(TM) SE Runtime Environment (8.0_102-b14) (build 1.8.0_102-b14)
   [junit4] # Java VM: Java HotSpot(TM) 64-Bit Server VM (25.102-b14 mixed mode bsd-amd64 compressed oops)
   [junit4] # Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
   [junit4] #
   [junit4] # An error report file with more information is saved as:
   [junit4] # /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-solrj/test/J1/hs_err_pid40282.log
   [junit4] #
   [junit4] # If you would like to submit a bug report, please visit:
   [junit4] #   http://bugreport.java.com/bugreport/crash.jsp
   [junit4] #
   [junit4] <<< JVM J1: EOF ----

[...truncated 169 lines...]
   [junit4] ERROR: JVM J1 ended with an exception, command line: /Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/jre/bin/java -XX:+UseCompressedOops -XX:+UseSerialGC -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/heapdumps -ea -esa -Dtests.prefix=tests -Dtests.seed=207B1C87B2E7C17E -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=6.4.0 -Dtests.cleanthreads=perClass -Djava.util.logging.config.file=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/tools/junit4/logging.properties -Dtests.nightly=false -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=1 -DtempDir=./temp -Djava.io.tmpdir=./temp -Djunit4.tempDir=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-solrj/test/temp -Dcommon.dir=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene -Dclover.db.dir=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/build/clover/db -Djava.security.policy=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/tools/junit4/solr-tests.policy -Dtests.LUCENE_VERSION=6.4.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Djunit4.childvm.cwd=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-solrj/test/J1 -Djunit4.childvm.id=1 -Djunit4.childvm.count=2 -Dtests.leaveTemporary=false -Dtests.filterstacks=true -Dtests.disableHdfs=true -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -classpath /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-solrj/classes/test:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/solrj/test-lib/cglib-nodep-2.2.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/solrj/test-lib/easymock-3.0.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/solrj/test-lib/objenesis-1.2.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/solrj/test-lib/slf4j-log4j12-1.7.7.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-test-framework/classes/java:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/solrj/src/test-files:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/build/test-framework/classes/java:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/build/codecs/classes/java:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/solrj/lib/commons-io-2.5.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/solrj/lib/httpclient-4.4.1.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/solrj/lib/httpcore-4.4.1.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/solrj/lib/httpmime-4.4.1.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/solrj/lib/jcl-over-slf4j-1.7.7.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/solrj/lib/noggit-0.6.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/solrj/lib/slf4j-api-1.7.7.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/solrj/lib/stax2-api-3.1.4.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/solrj/lib/woodstox-core-asl-4.4.1.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/solrj/lib/zookeeper-3.4.6.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/test-framework/lib/junit-4.10.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/test-framework/lib/randomizedtesting-runner-2.4.0.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-solrj/classes/java:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/classes/java:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/build/analysis/common/lucene-analyzers-common-6.4.0-SNAPSHOT.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-6.4.0-SNAPSHOT.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-6.4.0-SNAPSHOT.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/build/codecs/lucene-codecs-6.4.0-SNAPSHOT.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/build/backward-codecs/lucene-backward-codecs-6.4.0-SNAPSHOT.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/build/highlighter/lucene-highlighter-6.4.0-SNAPSHOT.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/build/memory/lucene-memory-6.4.0-SNAPSHOT.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/build/misc/lucene-misc-6.4.0-SNAPSHOT.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/build/spatial-extras/lucene-spatial-extras-6.4.0-SNAPSHOT.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/build/expressions/lucene-expressions-6.4.0-SNAPSHOT.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/build/suggest/lucene-suggest-6.4.0-SNAPSHOT.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/build/grouping/lucene-grouping-6.4.0-SNAPSHOT.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/build/queries/lucene-queries-6.4.0-SNAPSHOT.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/build/queryparser/lucene-queryparser-6.4.0-SNAPSHOT.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/build/join/lucene-join-6.4.0-SNAPSHOT.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/build/sandbox/lucene-sandbox-6.4.0-SNAPSHOT.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/build/classification/lucene-classification-6.4.0-SNAPSHOT.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/antlr4-runtime-4.5.1-1.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/asm-5.1.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/asm-commons-5.1.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/caffeine-1.0.1.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/commons-cli-1.2.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/commons-codec-1.10.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/commons-collections-3.2.2.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/commons-configuration-1.6.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/commons-exec-1.3.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/commons-fileupload-1.3.2.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/commons-io-2.5.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/commons-lang-2.6.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/curator-client-2.8.0.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/curator-framework-2.8.0.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/curator-recipes-2.8.0.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/dom4j-1.6.1.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/guava-14.0.1.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/hadoop-annotations-2.7.2.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/hadoop-auth-2.7.2.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/hadoop-common-2.7.2.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/hadoop-hdfs-2.7.2.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/hppc-0.7.1.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/htrace-core-3.2.0-incubating.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/jackson-core-2.5.4.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/jackson-core-asl-1.9.13.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/jackson-dataformat-smile-2.5.4.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/jackson-mapper-asl-1.9.13.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/jcl-over-slf4j-1.7.7.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/joda-time-2.2.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/log4j-1.2.17.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/org.restlet-2.3.0.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/org.restlet.ext.servlet-2.3.0.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/presto-parser-0.122.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/protobuf-java-2.5.0.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/slf4j-log4j12-1.7.7.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/slice-0.10.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/spatial4j-0.6.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/lib/t-digest-3.1.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/server/lib/gmetric4j-1.0.7.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/server/lib/javax.servlet-api-3.1.0.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/server/lib/jetty-continuation-9.3.14.v20161028.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/server/lib/jetty-deploy-9.3.14.v20161028.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/server/lib/jetty-http-9.3.14.v20161028.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/server/lib/jetty-io-9.3.14.v20161028.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/server/lib/jetty-jmx-9.3.14.v20161028.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/server/lib/jetty-rewrite-9.3.14.v20161028.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/server/lib/jetty-security-9.3.14.v20161028.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/server/lib/jetty-server-9.3.14.v20161028.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/server/lib/jetty-servlet-9.3.14.v20161028.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/server/lib/jetty-servlets-9.3.14.v20161028.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/server/lib/jetty-util-9.3.14.v20161028.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/server/lib/jetty-webapp-9.3.14.v20161028.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/server/lib/jetty-xml-9.3.14.v20161028.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/server/lib/metrics-core-3.1.2.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/server/lib/metrics-ganglia-3.1.2.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/server/lib/metrics-graphite-3.1.2.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/server/lib/metrics-jetty9-3.1.2.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/server/lib/metrics-jvm-3.1.2.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/build/core/classes/java:/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/example/resources:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-launcher.jar:/Users/jenkins/.ant/lib/ivy-2.3.0.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-antlr.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bcel.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bsf.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-log4j.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-oro.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-regexp.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-resolver.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-xalan2.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-logging.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-net.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jai.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-javamail.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jdepend.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jmf.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jsch.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit4.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-netrexx.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-swing.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-testutil.jar:/Users/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_102.jdk/Contents/Home/lib/tools.jar:/Users/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.4.0.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-solrj/test/temp/junit4-J1-20170108_135210_592.events @/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-solrj/test/temp/junit4-J1-20170108_135210_592.suites -stdin
   [junit4] ERROR: JVM J1 ended with an exception: Forked process returned with error code: 134. Very likely a JVM crash.  See process stdout at: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-solrj/test/temp/junit4-J1-20170108_135210_592.sysout
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1481)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:121)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:955)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:952)
   [junit4] 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4] 	at java.lang.Thread.run(Thread.java:745)

BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/build.xml:775: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/build.xml:719: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/build.xml:59: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build.xml:265: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/common-build.xml:536: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/common-build.xml:1443: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/common-build.xml:984: At least one slave process threw an exception, first: Forked process returned with error code: 134. Very likely a JVM crash.  See process stdout at: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-solrj/test/temp/junit4-J1-20170108_135210_592.sysout

Total time: 97 minutes 46 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-6.x-MacOSX (64bit/jdk1.8.0) - Build # 632 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-6.x-MacOSX/632/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigAliasReplication

Error Message:
expected:<1> but was:<0>

Stack Trace:
java.lang.AssertionError: expected:<1> but was:<0>
	at __randomizedtesting.SeedInfo.seed([A76B92EAD53F91C9:50187CB213D73E2F]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigAliasReplication(TestReplicationHandler.java:1347)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:811)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:462)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11757 lines...]
   [junit4] Suite: org.apache.solr.handler.TestReplicationHandler
   [junit4]   2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/init-core-data-001
   [junit4]   2> 1656173 INFO  (SUITE-TestReplicationHandler-seed#[A76B92EAD53F91C9]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=None) w/ MAC_OS_X supressed clientAuth
   [junit4]   2> 1656175 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.SolrTestCaseJ4 ###Starting doTestDetails
   [junit4]   2> 1656175 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-001/collection1
   [junit4]   2> 1656184 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1656186 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1cb61c11{/solr,null,AVAILABLE}
   [junit4]   2> 1656186 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@4e09a984{HTTP/1.1,[http/1.1]}{127.0.0.1:६४७७४}
   [junit4]   2> 1656187 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.Server Started @१६६९८४५ms
   [junit4]   2> 1656187 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-001/collection1/data, hostContext=/solr, hostPort=64774}
   [junit4]   2> 1656187 ERROR (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1656188 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 6.4.0
   [junit4]   2> 1656188 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 1656188 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1656188 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-01-09T08:52:35.596Z
   [junit4]   2> 1656189 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-001/solr.xml
   [junit4]   2> 1656205 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1656213 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-001/.
   [junit4]   2> 1656213 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 1656236 WARN  (coreLoadExecutor-5780-thread-1) [    x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 1656237 INFO  (coreLoadExecutor-5780-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.4.0
   [junit4]   2> 1656248 INFO  (coreLoadExecutor-5780-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1656253 INFO  (coreLoadExecutor-5780-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
   [junit4]   2> 1656257 INFO  (coreLoadExecutor-5780-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-001/./collection1
   [junit4]   2> 1656258 INFO  (coreLoadExecutor-5780-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-001/collection1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-001/./collection1/data/]
   [junit4]   2> 1656259 INFO  (coreLoadExecutor-5780-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=9.78515625, floorSegmentMB=1.0078125, forceMergeDeletesPctAllowed=8.42751490474457, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.23494825197180358
   [junit4]   2> 1656277 INFO  (coreLoadExecutor-5780-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1656277 INFO  (coreLoadExecutor-5780-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1656278 INFO  (coreLoadExecutor-5780-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=48, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 1656279 INFO  (coreLoadExecutor-5780-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@71d3ae79[collection1] main]
   [junit4]   2> 1656279 INFO  (coreLoadExecutor-5780-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-001/collection1/conf
   [junit4]   2> 1656280 INFO  (coreLoadExecutor-5780-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml,xslt/dummy.xsl
   [junit4]   2> 1656280 INFO  (coreLoadExecutor-5780-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1656280 INFO  (searcherExecutor-5781-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@71d3ae79[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1657040 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-002/collection1
   [junit4]   2> 1657045 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1657048 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@58a0b3d{/solr,null,AVAILABLE}
   [junit4]   2> 1657048 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@42424339{HTTP/1.1,[http/1.1]}{127.0.0.1:६४७७५}
   [junit4]   2> 1657048 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.Server Started @१६७०७०६ms
   [junit4]   2> 1657048 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-002/collection1/data, hostContext=/solr, hostPort=64775}
   [junit4]   2> 1657049 ERROR (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1657049 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 6.4.0
   [junit4]   2> 1657049 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 1657050 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1657050 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-01-09T08:52:36.458Z
   [junit4]   2> 1657050 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-002/solr.xml
   [junit4]   2> 1657057 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1657065 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-002/.
   [junit4]   2> 1657065 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 1657076 WARN  (coreLoadExecutor-5790-thread-1) [    x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 1657077 INFO  (coreLoadExecutor-5790-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.4.0
   [junit4]   2> 1657087 INFO  (coreLoadExecutor-5790-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1657090 INFO  (coreLoadExecutor-5790-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
   [junit4]   2> 1657092 INFO  (coreLoadExecutor-5790-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-002/./collection1
   [junit4]   2> 1657092 INFO  (coreLoadExecutor-5790-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-002/collection1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-002/./collection1/data/]
   [junit4]   2> 1657095 INFO  (coreLoadExecutor-5790-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=9.78515625, floorSegmentMB=1.0078125, forceMergeDeletesPctAllowed=8.42751490474457, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.23494825197180358
   [junit4]   2> 1657118 INFO  (coreLoadExecutor-5790-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1657118 INFO  (coreLoadExecutor-5790-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1657127 INFO  (coreLoadExecutor-5790-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=48, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 1657151 INFO  (coreLoadExecutor-5790-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@311b6863[collection1] main]
   [junit4]   2> 1657151 INFO  (coreLoadExecutor-5790-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-002/collection1/conf
   [junit4]   2> 1657155 INFO  (coreLoadExecutor-5790-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms
   [junit4]   2> 1657155 INFO  (searcherExecutor-5791-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@311b6863[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1657160 INFO  (qtp2124696920-13258) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1657160 INFO  (indexFetcher-5795-thread-1) [    x:collection1] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 1657160 INFO  (indexFetcher-5795-thread-1) [    x:collection1] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 1657160 INFO  (indexFetcher-5795-thread-1) [    x:collection1] o.a.s.h.IndexFetcher Slave's generation: 1
   [junit4]   2> 1657981 INFO  (qtp2124696920-13260) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/select params={q=*:*&sort=id+desc&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1657985 INFO  (qtp2124696920-13261) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1657991 INFO  (qtp2124696920-13262) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={slave=false&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1657992 INFO  (qtp1426845294-13275) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=3
   [junit4]   2> 1657995 INFO  (qtp2124696920-13263) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[0]} 0 0
   [junit4]   2> 1657997 INFO  (qtp2124696920-13256) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1657997 INFO  (qtp2124696920-13256) [    x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@3396207e
   [junit4]   2> 1658002 INFO  (qtp2124696920-13256) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@73619ca6[collection1] main]
   [junit4]   2> 1658002 INFO  (qtp2124696920-13256) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1658003 INFO  (searcherExecutor-5781-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@73619ca6[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.4.0):C1)))}
   [junit4]   2> 1658003 INFO  (qtp2124696920-13256) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 5
   [junit4]   2> 1658010 WARN  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher 'masterUrl' must be specified without the /replication suffix
   [junit4]   2> 1658014 INFO  (qtp2124696920-13258) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1658014 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Master's generation: 2
   [junit4]   2> 1658014 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Master's version: 1483951957405
   [junit4]   2> 1658014 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Slave's generation: 1
   [junit4]   2> 1658014 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Starting replication process
   [junit4]   2> 1658022 INFO  (qtp2124696920-13259) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=2&qt=/replication&wt=javabin&version=2&command=filelist} status=0 QTime=5
   [junit4]   2> 1658022 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Number of files in latest index in master: 8
   [junit4]   2> 1658032 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=35, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5890267681016564]
   [junit4]   2> 1658033 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1658033 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Starting download (fullCopy=false) to MetricsDirectory(MockDirectoryWrapper(RAMDirectory@633256dd lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@787bcdd4))
   [junit4]   2> 1658035 INFO  (qtp2124696920-13260) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.si&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1658039 INFO  (qtp2124696920-13261) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.nvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1658042 INFO  (qtp2124696920-13262) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdx&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1658045 INFO  (qtp2124696920-13263) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Memory_0.ram&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1658048 INFO  (qtp2124696920-13256) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdt&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1658051 INFO  (qtp2124696920-13256) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fnm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1658054 INFO  (qtp2124696920-13259) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.nvm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1658058 INFO  (qtp2124696920-13260) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=segments_2&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1658058 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Total time taken for download (fullCopy=false,bytesDownloaded=1269) : 0 secs (null bytes/sec) to MetricsDirectory(MockDirectoryWrapper(RAMDirectory@633256dd lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@787bcdd4))
   [junit4]   2> 1658063 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=28.0908203125, floorSegmentMB=0.8017578125, forceMergeDeletesPctAllowed=12.73638595779812, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1658066 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1658068 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@5cdf2906[collection1] main]
   [junit4]   2> 1658068 INFO  (searcherExecutor-5791-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5cdf2906[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.4.0):C1)))}
   [junit4]   2> 1658069 INFO  (qtp1426845294-13276) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={wait=true&masterUrl=http://127.0.0.1:64774/solr/collection1/replication&command=fetchindex} status=0 QTime=61
   [junit4]   2> 1658076 INFO  (qtp2124696920-13261) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={slave=false&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1658076 INFO  (qtp1426845294-13278) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=3
   [junit4]   2> 1658079 INFO  (qtp2124696920-13262) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[1]} 0 0
   [junit4]   2> 1658081 INFO  (qtp2124696920-13263) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1658081 INFO  (qtp2124696920-13263) [    x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@3396207e
   [junit4]   2> 1658104 INFO  (qtp2124696920-13263) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@5d448280[collection1] main]
   [junit4]   2> 1658104 INFO  (qtp2124696920-13263) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1658104 INFO  (searcherExecutor-5781-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5d448280[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.4.0):C1) Uninverting(_1(6.4.0):C1)))}
   [junit4]   2> 1658104 INFO  (qtp2124696920-13263) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 23
   [junit4]   2> 1658106 WARN  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher 'masterUrl' must be specified without the /replication suffix
   [junit4]   2> 1658109 INFO  (qtp2124696920-13258) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1658110 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Master's generation: 3
   [junit4]   2> 1658110 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Master's version: 1483951957489
   [junit4]   2> 1658110 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Slave's generation: 2
   [junit4]   2> 1658110 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Starting replication process
   [junit4]   2> 1658121 INFO  (qtp2124696920-13256) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=3&qt=/replication&wt=javabin&version=2&command=filelist} status=0 QTime=8
   [junit4]   2> 1658121 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Number of files in latest index in master: 15
   [junit4]   2> 1658123 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=35, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5890267681016564]
   [junit4]   2> 1658125 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1658126 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Starting download (fullCopy=false) to MetricsDirectory(MockDirectoryWrapper(RAMDirectory@d9783c5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@42fa3991))
   [junit4]   2> 1658126 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Skipping download for _0.si because it already exists
   [junit4]   2> 1658126 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Skipping download for _0.nvd because it already exists
   [junit4]   2> 1658127 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Skipping download for _0.fdx because it already exists
   [junit4]   2> 1658127 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Skipping download for _0_Memory_0.ram because it already exists
   [junit4]   2> 1658128 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Skipping download for _0.fdt because it already exists
   [junit4]   2> 1658128 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Skipping download for _0.fnm because it already exists
   [junit4]   2> 1658128 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Skipping download for _0.nvm because it already exists
   [junit4]   2> 1658130 INFO  (qtp2124696920-13259) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=3&qt=/replication&file=_1.si&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1658134 INFO  (qtp2124696920-13260) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=3&qt=/replication&file=_1.nvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1658138 INFO  (qtp2124696920-13261) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=3&qt=/replication&file=_1_Memory_0.ram&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1658144 INFO  (qtp2124696920-13262) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=3&qt=/replication&file=_1.fdx&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1658147 INFO  (qtp2124696920-13263) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=3&qt=/replication&file=_1.fnm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1658151 INFO  (qtp2124696920-13258) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=3&qt=/replication&file=_1.nvm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1658156 INFO  (qtp2124696920-13256) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=3&qt=/replication&file=_1.fdt&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1658158 INFO  (qtp2124696920-13259) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=3&qt=/replication&file=segments_3&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1658160 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Total time taken for download (fullCopy=false,bytesDownloaded=1332) : 0 secs (null bytes/sec) to MetricsDirectory(MockDirectoryWrapper(RAMDirectory@d9783c5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@42fa3991))
   [junit4]   2> 1658176 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=28.0908203125, floorSegmentMB=0.8017578125, forceMergeDeletesPctAllowed=12.73638595779812, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1658181 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1658184 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7bd1e9b4[collection1] main]
   [junit4]   2> 1658184 INFO  (searcherExecutor-5791-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7bd1e9b4[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.4.0):C1) Uninverting(_1(6.4.0):C1)))}
   [junit4]   2> 1658184 INFO  (qtp1426845294-13279) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={wait=true&masterUrl=http://127.0.0.1:64774/solr/collection1/replication&command=fetchindex} status=0 QTime=78
   [junit4]   2> 1658190 INFO  (qtp2124696920-13260) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={slave=false&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1658190 INFO  (qtp1426845294-13280) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=3
   [junit4]   2> 1658192 INFO  (qtp2124696920-13261) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[2]} 0 0
   [junit4]   2> 1658194 INFO  (qtp2124696920-13262) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1658194 INFO  (qtp2124696920-13262) [    x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@3396207e
   [junit4]   2> 1658199 INFO  (qtp2124696920-13262) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@dd925d3[collection1] main]
   [junit4]   2> 1658199 INFO  (qtp2124696920-13262) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1658200 INFO  (searcherExecutor-5781-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@dd925d3[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.4.0):C1) Uninverting(_1(6.4.0):C1) Uninverting(_2(6.4.0):C1)))}
   [junit4]   2> 1658200 INFO  (qtp2124696920-13262) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 5
   [junit4]   2> 1658201 WARN  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher 'masterUrl' must be specified without the /replication suffix
   [junit4]   2> 1658204 INFO  (qtp2124696920-13263) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1658205 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Master's generation: 4
   [junit4]   2> 1658205 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Master's version: 1483951957602
   [junit4]   2> 1658205 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Slave's generation: 3
   [junit4]   2> 1658205 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Starting replication process
   [junit4]   2> 1658209 INFO  (qtp2124696920-13258) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=4&qt=/replication&wt=javabin&version=2&command=filelist} status=0 QTime=3
   [junit4]   2> 1658210 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Number of files in latest index in master: 22
   [junit4]   2> 1658211 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=35, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5890267681016564]
   [junit4]   2> 1658213 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1658214 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Starting download (fullCopy=false) to MetricsDirectory(MockDirectoryWrapper(RAMDirectory@d5a20b8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4c6bbae1))
   [junit4]   2> 1658214 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Skipping download for _0.si because it already exists
   [junit4]   2> 1658215 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Skipping download for _0.nvd because it already exists
   [junit4]   2> 1658215 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Skipping download for _0.fdx because it already exists
   [junit4]   2> 1658215 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Skipping download for _0_Memory_0.ram because it already exists
   [junit4]   2> 1658215 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Skipping download for _0.fdt because it already exists
   [junit4]   2> 1658215 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Skipping download for _0.fnm because it already exists
   [junit4]   2> 1658215 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Skipping download for _0.nvm because it already exists
   [junit4]   2> 1658215 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Skipping download for _1.si because it already exists
   [junit4]   2> 1658216 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Skipping download for _1.nvd because it already exists
   [junit4]   2> 1658216 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Skipping download for _1_Memory_0.ram because it already exists
   [junit4]   2> 1658216 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Skipping download for _1.fdx because it already exists
   [junit4]   2> 1658216 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Skipping download for _1.fnm because it already exists
   [junit4]   2> 1658216 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Skipping download for _1.nvm because it already exists
   [junit4]   2> 1658216 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Skipping download for _1.fdt because it already exists
   [junit4]   2> 1658219 INFO  (qtp2124696920-13256) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=4&qt=/replication&file=_2.nvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1658222 INFO  (qtp2124696920-13259) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=4&qt=/replication&file=_2.si&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1658231 INFO  (qtp2124696920-13260) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=4&qt=/replication&file=_2.fdt&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1658233 INFO  (qtp2124696920-13261) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=4&qt=/replication&file=_2.fnm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1658236 INFO  (qtp2124696920-13262) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=4&qt=/replication&file=_2.nvm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1658238 INFO  (qtp2124696920-13263) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=4&qt=/replication&file=_2_Memory_0.ram&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1658241 INFO  (qtp2124696920-13258) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=4&qt=/replication&file=_2.fdx&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1658244 INFO  (qtp2124696920-13256) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=4&qt=/replication&file=segments_4&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1658245 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Total time taken for download (fullCopy=false,bytesDownloaded=1395) : 0 secs (null bytes/sec) to MetricsDirectory(MockDirectoryWrapper(RAMDirectory@d5a20b8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4c6bbae1))
   [junit4]   2> 1658247 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=28.0908203125, floorSegmentMB=0.8017578125, forceMergeDeletesPctAllowed=12.73638595779812, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1658251 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1658254 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1a72213e[collection1] main]
   [junit4]   2> 1658254 INFO  (searcherExecutor-5791-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1a72213e[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.4.0):C1) Uninverting(_1(6.4.0):C1) Uninverting(_2(6.4.0):C1)))}
   [junit4]   2> 1658254 INFO  (qtp1426845294-13273) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={wait=true&masterUrl=http://127.0.0.1:64774/solr/collection1/replication&command=fetchindex} status=0 QTime=53
   [junit4]   2> 1658256 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-003/collection1
   [junit4]   2> 1658264 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1658266 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2b52e951{/solr,null,AVAILABLE}
   [junit4]   2> 1658267 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@19dfb0fa{HTTP/1.1,[http/1.1]}{127.0.0.1:६४७८४}
   [junit4]   2> 1658267 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.Server Started @१६७१९२४ms
   [junit4]   2> 1658267 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-003/collection1/data, hostContext=/solr, hostPort=64784}
   [junit4]   2> 1658267 ERROR (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1658268 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 6.4.0
   [junit4]   2> 1658268 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 1658268 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1658268 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-01-09T08:52:37.676Z
   [junit4]   2> 1658269 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-003/solr.xml
   [junit4]   2> 1658275 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1658280 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-003/.
   [junit4]   2> 1658281 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 1658298 WARN  (coreLoadExecutor-5804-thread-1) [    x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 1658300 INFO  (coreLoadExecutor-5804-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.4.0
   [junit4]   2> 1658309 INFO  (coreLoadExecutor-5804-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1658312 INFO  (coreLoadExecutor-5804-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
   [junit4]   2> 1658313 INFO  (coreLoadExecutor-5804-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-003/./collection1
   [junit4]   2> 1658313 INFO  (coreLoadExecutor-5804-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-003/collection1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-003/./collection1/data/]
   [junit4]   2> 1658337 INFO  (coreLoadExecutor-5804-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=9.78515625, floorSegmentMB=1.0078125, forceMergeDeletesPctAllowed=8.42751490474457, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.23494825197180358
   [junit4]   2> 1658407 INFO  (coreLoadExecutor-5804-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1658407 INFO  (coreLoadExecutor-5804-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1658417 INFO  (coreLoadExecutor-5804-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=48, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 1658449 INFO  (coreLoadExecutor-5804-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@567b56ff[collection1] main]
   [junit4]   2> 1658449 INFO  (coreLoadExecutor-5804-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-003/collection1/conf
   [junit4]   2> 1658450 WARN  (coreLoadExecutor-5804-thread-1) [    x:collection1] o.a.s.h.IndexFetcher 'masterUrl' must be specified without the /replication suffix
   [junit4]   2> 1658452 INFO  (coreLoadExecutor-5804-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler  No value set for 'pollInterval'. Timer Task not started.
   [junit4]   2> 1658452 INFO  (coreLoadExecutor-5804-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml
   [junit4]   2> 1658452 INFO  (coreLoadExecutor-5804-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1658452 INFO  (searcherExecutor-5805-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@567b56ff[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1659161 INFO  (qtp2124696920-13259) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1659161 INFO  (indexFetcher-5795-thread-1) [    x:collection1] o.a.s.h.IndexFetcher Master's generation: 4
   [junit4]   2> 1659161 INFO  (indexFetcher-5795-thread-1) [    x:collection1] o.a.s.h.IndexFetcher Master's version: 1483951957602
   [junit4]   2> 1659161 INFO  (indexFetcher-5795-thread-1) [    x:collection1] o.a.s.h.IndexFetcher Slave's generation: 4
   [junit4]   2> 1659161 INFO  (indexFetcher-5795-thread-1) [    x:collection1] o.a.s.h.IndexFetcher Slave in sync with master.
   [junit4]   2> 1659163 WARN  (qtp1105222228-13302) [    x:collection1] o.a.s.h.ReplicationHandler Exception while invoking 'details' method for replication on master 
   [junit4]   2> org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:64774/solr: Expected mime type application/octet-stream but got text/html. <html>
   [junit4]   2> <head>
   [junit4]   2> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
   [junit4]   2> <title>Error 404 </title>
   [junit4]   2> </head>
   [junit4]   2> <body>
   [junit4]   2> <h2>HTTP ERROR: 404</h2>
   [junit4]   2> <p>Problem accessing /solr/replication. Reason:
   [junit4]   2> <pre>    Can not find: /solr/replication</pre></p>
   [junit4]   2> <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.14.v20161028</a><hr/>
   [junit4]   2> </body>
   [junit4]   2> </html>
   [junit4]   2> 
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:578)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268)
   [junit4]   2> 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.getDetails(IndexFetcher.java:1716)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.getReplicationDetails(ReplicationHandler.java:915)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.handleRequestBody(ReplicationHandler.java:312)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:166)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:2306)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:658)
   [junit4]   2> 	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:464)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:296)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:110)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1699)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:462)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1659164 INFO  (qtp1105222228-13302) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=4
   [junit4]   2> 1659166 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@19dfb0fa{HTTP/1.1,[http/1.1]}{127.0.0.1:०}
   [junit4]   2> 1659166 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=743275854
   [junit4]   2> 1659167 INFO  (coreCloseExecutor-5809-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@f97f524
   [junit4]   2> 1659169 INFO  (coreCloseExecutor-5809-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
   [junit4]   2> 1659170 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 1659170 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2b52e951{/solr,null,UNAVAILABLE}
   [junit4]   2> 1659173 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.SolrTestCaseJ4 ###Ending doTestDetails
   [junit4]   2> 1659173 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@4e09a984{HTTP/1.1,[http/1.1]}{127.0.0.1:०}
   [junit4]   2> 1659174 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=988951661
   [junit4]   2> 1659175 INFO  (coreCloseExecutor-5811-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@2aca420a
   [junit4]   2> 1659176 INFO  (coreCloseExecutor-5811-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
   [junit4]   2> 1659176 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 1659177 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1cb61c11{/solr,null,UNAVAILABLE}
   [junit4]   2> 1659179 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@42424339{HTTP/1.1,[http/1.1]}{127.0.0.1:०}
   [junit4]   2> 1659179 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=501675961
   [junit4]   2> 1659180 INFO  (coreCloseExecutor-5813-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@20dd010b
   [junit4]   2> 1659181 INFO  (coreCloseExecutor-5813-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
   [junit4]   2> 1659186 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 1659186 INFO  (TEST-TestReplicationHandler.doTestDetails-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@58a0b3d{/solr,null,UNAVAILABLE}
   [junit4]   2> 1659191 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testEmptyCommits
   [junit4]   2> 1659192 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-004/collection1
   [junit4]   2> 1659202 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1659205 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4ca2eb58{/solr,null,AVAILABLE}
   [junit4]   2> 1659210 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@7e423d0f{HTTP/1.1,[http/1.1]}{127.0.0.1:६४७८७}
   [junit4]   2> 1659210 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.Server Started @१६७२८६८ms
   [junit4]   2> 1659210 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-004/collection1/data, hostContext=/solr, hostPort=64787}
   [junit4]   2> 1659211 ERROR (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1659211 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 6.4.0
   [junit4]   2> 1659211 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 1659211 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1659212 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-01-09T08:52:38.619Z
   [junit4]   2> 1659212 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-004/solr.xml
   [junit4]   2> 1660038 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1660079 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-004/.
   [junit4]   2> 1660079 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 1660108 WARN  (coreLoadExecutor-5820-thread-1) [    x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 1660109 INFO  (coreLoadExecutor-5820-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.4.0
   [junit4]   2> 1660123 INFO  (coreLoadExecutor-5820-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1660132 INFO  (coreLoadExecutor-5820-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
   [junit4]   2> 1660139 INFO  (coreLoadExecutor-5820-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-004/./collection1
   [junit4]   2> 1660140 INFO  (coreLoadExecutor-5820-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-004/collection1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-004/./collection1/data/]
   [junit4]   2> 1660150 INFO  (coreLoadExecutor-5820-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=9.78515625, floorSegmentMB=1.0078125, forceMergeDeletesPctAllowed=8.42751490474457, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.23494825197180358
   [junit4]   2> 1660173 INFO  (coreLoadExecutor-5820-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1660173 INFO  (coreLoadExecutor-5820-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1660184 INFO  (coreLoadExecutor-5820-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=48, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 1660208 INFO  (coreLoadExecutor-5820-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@5b71896[collection1] main]
   [junit4]   2> 1660209 INFO  (coreLoadExecutor-5820-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-004/collection1/conf
   [junit4]   2> 1660209 INFO  (coreLoadExecutor-5820-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml,xslt/dummy.xsl
   [junit4]   2> 1660210 INFO  (coreLoadExecutor-5820-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1660210 INFO  (searcherExecutor-5821-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5b71896[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1661055 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-005/collection1
   [junit4]   2> 1661063 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1661065 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5f02267e{/solr,null,AVAILABLE}
   [junit4]   2> 1661066 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@218ba137{HTTP/1.1,[http/1.1]}{127.0.0.1:६४७९२}
   [junit4]   2> 1661066 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.Server Started @१६७४७२४ms
   [junit4]   2> 1661066 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-005/collection1/data, hostContext=/solr, hostPort=64792}
   [junit4]   2> 1661067 ERROR (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1661067 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 6.4.0
   [junit4]   2> 1661067 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 1661067 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1661067 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-01-09T08:52:40.475Z
   [junit4]   2> 1661068 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-005/solr.xml
   [junit4]   2> 1661076 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1661081 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-005/.
   [junit4]   2> 1661082 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 1661092 WARN  (coreLoadExecutor-5830-thread-1) [    x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 1661093 INFO  (coreLoadExecutor-5830-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.4.0
   [junit4]   2> 1661106 INFO  (coreLoadExecutor-5830-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1661108 INFO  (coreLoadExecutor-5830-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id
   [junit4]   2> 1661110 INFO  (coreLoadExecutor-5830-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-005/./collection1
   [junit4]   2> 1661110 INFO  (coreLoadExecutor-5830-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-005/collection1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-005/./collection1/data/]
   [junit4]   2> 1661111 INFO  (coreLoadExecutor-5830-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=9.78515625, floorSegmentMB=1.0078125, forceMergeDeletesPctAllowed=8.42751490474457, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.23494825197180358
   [junit4]   2> 1661124 INFO  (coreLoadExecutor-5830-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1661124 INFO  (coreLoadExecutor-5830-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1661124 INFO  (coreLoadExecutor-5830-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=48, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 1661125 INFO  (coreLoadExecutor-5830-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@22e3133[collection1] main]
   [junit4]   2> 1661125 INFO  (coreLoadExecutor-5830-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001/solr-instance-005/collection1/conf
   [junit4]   2> 1661126 INFO  (coreLoadExecutor-5830-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms
   [junit4]   2> 1661126 INFO  (searcherExecutor-5831-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@22e3133[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1661456 INFO  (qtp1767266231-13324) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1661456 INFO  (indexFetcher-5835-thread-1) [    x:collection1] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 1661456 INFO  (indexFetcher-5835-thread-1) [    x:collection1] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 1661456 INFO  (indexFetcher-5835-thread-1) [    x:collection1] o.a.s.h.IndexFetcher Slave's generation: 1
   [junit4]   2> 1661909 INFO  (qtp1767266231-13326) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/select params={q=*:*&sort=id+desc&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1661912 INFO  (qtp1767266231-13327) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[1]} 0 0
   [junit4]   2> 1661915 INFO  (qtp1767266231-13328) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1661915 INFO  (qtp1767266231-13328) [    x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@641d3574
   [junit4]   2> 1661919 INFO  (qtp1767266231-13328) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@708635e2[collection1] main]
   [junit4]   2> 1661919 INFO  (qtp1767266231-13328) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1661919 INFO  (searcherExecutor-5821-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@708635e2[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.4.0):C1)))}
   [junit4]   2> 1661919 INFO  (qtp1767266231-13328) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={commit=true&wt=javabin&version=2}{commit=} 0 4
   [junit4]   2> 1661922 WARN  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher 'masterUrl' must be specified without the /replication suffix
   [junit4]   2> 1661925 INFO  (qtp1767266231-13329) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1661926 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Master's generation: 2
   [junit4]   2> 1661926 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Master's version: 1483951961323
   [junit4]   2> 1661926 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Slave's generation: 1
   [junit4]   2> 1661926 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Starting replication process
   [junit4]   2> 1661932 INFO  (qtp1767266231-13322) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=2&qt=/replication&wt=javabin&version=2&command=filelist} status=0 QTime=2
   [junit4]   2> 1661932 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Number of files in latest index in master: 8
   [junit4]   2> 1661933 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=35, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5890267681016564]
   [junit4]   2> 1661934 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1661934 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Starting download (fullCopy=false) to MetricsDirectory(MockDirectoryWrapper(RAMDirectory@438dd909 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5ef740a))
   [junit4]   2> 1661936 INFO  (qtp1767266231-13324) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.si&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1661939 INFO  (qtp1767266231-13325) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.nvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1661944 INFO  (qtp1767266231-13326) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdx&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1661947 INFO  (qtp1767266231-13327) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Memory_0.ram&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1661949 INFO  (qtp1767266231-13328) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdt&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1661956 INFO  (qtp1767266231-13329) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fnm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1661961 INFO  (qtp1767266231-13322) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.nvm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1661964 INFO  (qtp1767266231-13324) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={generation=2&qt=/replication&file=segments_2&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 1661965 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Total time taken for download (fullCopy=false,bytesDownloaded=1263) : 0 secs (null bytes/sec) to MetricsDirectory(MockDirectoryWrapper(RAMDirectory@438dd909 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5ef740a))
   [junit4]   2> 1661967 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=28.0908203125, floorSegmentMB=0.8017578125, forceMergeDeletesPctAllowed=12.73638595779812, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1661968 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1661969 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@24da3cd9[collection1] main]
   [junit4]   2> 1661969 INFO  (searcherExecutor-5831-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@24da3cd9[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.4.0):C1)))}
   [junit4]   2> 1661969 INFO  (qtp267056654-13341) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={wait=true&masterUrl=http://127.0.0.1:64787/solr/collection1/replication&command=fetchindex} status=0 QTime=47
   [junit4]   2> 1661972 INFO  (qtp267056654-13343) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/select params={q=name:empty1&sort=id+desc&wt=javabin&version=2} hits=1 status=0 QTime=1
   [junit4]   2> 1661973 INFO  (TEST-TestReplicationHandler.testEmptyCommits-seed#[A76B92EAD53F91C9]) [    ] o.a.s.h.TestReplicationHandler Waited for 0ms and found 1 docs
   [junit4]   2> 1661976 INFO  (qtp1767266231-13325) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1661978 INFO  (qtp1767266231-13326) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1661985 INFO  (qtp1767266231-13327) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={slave=false&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1661986 INFO  (qtp267056654-13344) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=4
   [junit4]   2> 1661988 INFO  (qtp1767266231-13328) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={_trace=assertVersions&qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1661991 INFO  (qtp267056654-13345) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={_trace=assertVersions&qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1661996 INFO  (qtp1767266231-13329) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1661996 INFO  (qtp1767266231-13329) [    x:collection1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 1661996 INFO  (qtp1767266231-13329) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1661997 INFO  (qtp1767266231-13329) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={commit=true&wt=javabin&version=2}{commit=} 0 0
   [junit4]   2> 1661998 WARN  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher 'masterUrl' must be specified without the /replication suffix
   [junit4]   2> 1662002 INFO  (qtp1767266231-13322) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1662002 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Master's generation: 2
   [junit4]   2> 1662002 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Master's version: 1483951961323
   [junit4]   2> 1662002 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Slave's generation: 2
   [junit4]   2> 1662002 INFO  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher Slave in sync with master.
   [junit4]   2> 1662003 INFO  (qtp267056654-13346) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={wait=true&masterUrl=http://127.0.0.1:64787/solr/collection1/replication&command=fetchindex} status=0 QTime=4
   [junit4]   2> 1662007 INFO  (qtp1767266231-13324) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[2]} 0 1
   [junit4]   2> 1662011 INFO  (qtp1767266231-13325) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1662011 INFO  (qtp1767266231-13325) [    x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@641d3574
   [junit4]   2> 1662015 INFO  (qtp1767266231-13325) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7fc88a29[collection1] main]
   [junit4]   2> 1662015 INFO  (qtp1767266231-13325) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1662015 INFO  (searcherExecutor-5821-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7fc88a29[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.4.0):C1) Uninverting(_1(6.4.0):C1)))}
   [junit4]   2> 1662015 INFO  (qtp1767266231-13325) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={commit=true&wt=javabin&version=2}{commit=} 0 4
   [junit4]   2> 1662017 WARN  (explicit-fetchindex-cmd) [    x:collection1] o.a.s.h.IndexFetcher 'masterU

[...truncated too long message...]

replication params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=7
   [junit4]   2> 1795906 INFO  (qtp1042315678-14283) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={slave=false&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1795906 INFO  (qtp619554250-14245) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=4
   [junit4]   2> 1795913 INFO  (qtp619554250-14246) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={slave=false&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1795913 INFO  (qtp1042315678-14285) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=4
   [junit4]   2> 1795916 INFO  (qtp619554250-14247) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={_trace=assertVersions&qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1795919 INFO  (qtp1042315678-14284) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={_trace=assertVersions&qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1795924 INFO  (qtp1042315678-14284) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={slave=false&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1795925 INFO  (qtp619554250-14247) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=4
   [junit4]   2> 1795932 INFO  (qtp619554250-14242) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={slave=false&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=1
   [junit4]   2> 1795932 INFO  (qtp1042315678-14281) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=4
   [junit4]   2> 1795932 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[A76B92EAD53F91C9]) [    ] o.a.s.SolrTestCaseJ4 ###Ending doTestIndexFetchWithMasterUrl
   [junit4]   2> 1795934 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@3d1dad3f{HTTP/1.1,[http/1.1]}{127.0.0.1:०}
   [junit4]   2> 1795934 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[A76B92EAD53F91C9]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1530321060
   [junit4]   2> 1795935 INFO  (coreCloseExecutor-6431-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@34027e3
   [junit4]   2> 1795936 INFO  (coreCloseExecutor-6431-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
   [junit4]   2> 1795936 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[A76B92EAD53F91C9]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 1795937 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7306f5f7{/solr,null,UNAVAILABLE}
   [junit4]   2> 1795940 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@2a1ee5a4{HTTP/1.1,[http/1.1]}{127.0.0.1:०}
   [junit4]   2> 1795940 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[A76B92EAD53F91C9]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1075555231
   [junit4]   2> 1795941 INFO  (coreCloseExecutor-6433-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@4cc106ad
   [junit4]   2> 1795942 INFO  (coreCloseExecutor-6433-thread-1) [    x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
   [junit4]   2> 1795942 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[A76B92EAD53F91C9]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 1795943 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[A76B92EAD53F91C9]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2c2b0e98{/solr,null,UNAVAILABLE}
   [junit4]   2> 1795946 INFO  (SUITE-TestReplicationHandler-seed#[A76B92EAD53F91C9]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_A76B92EAD53F91C9-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene62): {name=PostingsFormat(name=Memory doPackFST= false), id=PostingsFormat(name=Memory doPackFST= false), newname=PostingsFormat(name=Memory doPackFST= false)}, docValues:{}, maxPointsInLeafNode=584, maxMBSortInHeap=6.833850380381212, sim=RandomSimilarity(queryNorm=true,coord=yes): {}, locale=hi-IN, timezone=PNT
   [junit4]   2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 1.8.0_102 (64-bit)/cpus=3,threads=1,free=308652856,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [TestNumericTerms64, HLLUtilTest, TestDeleteCollectionOnDownNodes, DebugComponentTest, TestStressUserVersions, BadIndexSchemaTest, CdcrReplicationHandlerTest, SaslZkACLProviderTest, OverseerModifyCollectionTest, ClassificationUpdateProcessorFactoryTest, TestDFRSimilarityFactory, TestJsonFacetRefinement, RequestHandlersTest, TestDistributedStatsComponentCardinality, TestZkChroot, StatsReloadRaceTest, CdcrVersionReplicationTest, SortSpecParsingTest, RulesTest, TestMiniSolrCloudClusterSSL, TestSerializedLuceneMatchVersion, DistributedTermsComponentTest, EchoParamsTest, TestUseDocValuesAsStored2, TestRecoveryHdfs, TestQuerySenderNoQuery, TestSearcherReuse, DocExpirationUpdateProcessorFactoryTest, HdfsUnloadDistributedZkTest, SearchHandlerTest, TestStressLiveNodes, DeleteInactiveReplicaTest, UpdateParamsTest, TolerantUpdateProcessorTest, ScriptEngineTest, TestSchemaSimilarityResource, SuggesterTSTTest, TestJoin, ParsingFieldUpdateProcessorsTest, ResponseHeaderTest, SuggestComponentContextFilterQueryTest, ConvertedLegacyTest, MinimalSchemaTest, DateMathParserTest, TestFileDictionaryLookup, TestDelegationWithHadoopAuth, LoggingHandlerTest, TestSolrCloudWithHadoopAuthPlugin, DefaultValueUpdateProcessorTest, JavabinLoaderTest, SolrIndexSplitterTest, RegexBoostProcessorTest, TestDocSet, TestSolrCoreProperties, ShufflingReplicaListTransformerTest, RAMDirectoryFactoryTest, TestBulkSchemaAPI, StatsComponentTest, TestSearchPerf, CopyFieldTest, TestDFISimilarityFactory, TestRealTimeGet, QueryParsingTest, TestSSLRandomization, TestCoreDiscovery, OpenCloseCoreStressTest, TestHdfsCloudBackupRestore, TestRTimerTree, TestPerFieldSimilarityClassic, CollectionsAPIDistributedZkTest, DistributedFacetPivotLargeTest, TestMinMaxOnMultiValuedField, FacetPivotSmallTest, TestAuthenticationFramework, TestSolrDeletionPolicy2, CSVRequestHandlerTest, TestDocTermOrds, CurrencyFieldOpenExchangeTest, SuggesterTest, BlockDirectoryTest, TemplateUpdateProcessorTest, DeleteShardTest, InfoHandlerTest, TestFuzzyAnalyzedSuggestions, TestSolrFieldCacheMBean, AliasIntegrationTest, RequestLoggingTest, CleanupOldIndexTest, CdcrBootstrapTest, TestConfigSetProperties, TestHashQParserPlugin, TestXmlQParser, FullHLLTest, ExternalFileFieldSortTest, SolrCoreCheckLockOnStartupTest, TestCustomSort, DistributedIntervalFacetingTest, TestCopyFieldCollectionResource, DistributedFacetPivotSmallAdvancedTest, ExitableDirectoryReaderTest, CreateCollectionCleanupTest, TestRawResponseWriter, BasicZkTest, DirectUpdateHandlerOptimizeTest, TestCloudPseudoReturnFields, TestSolrCloudWithSecureImpersonation, DistributedFacetPivotWhiteBoxTest, TestAuthorizationFramework, TestManagedSchemaThreadSafety, FileBasedSpellCheckerTest, ClusterStateTest, MergeStrategyTest, TestSolrQueryResponse, TestHdfsUpdateLog, BinaryUpdateRequestHandlerTest, UpdateRequestProcessorFactoryTest, TestPHPSerializedResponseWriter, SuggesterWFSTTest, TestSuggestSpellingConverter, AnalyticsQueryTest, TestDownShardTolerantSearch, TestDynamicLoading, SpellPossibilityIteratorTest, CoreSorterTest, TestDynamicFieldCollectionResource, ConnectionReuseTest, TestValueSourceCache, DistanceFunctionTest, TestMacros, TestLMJelinekMercerSimilarityFactory, HdfsDirectoryTest, TestQuerySenderListener, SolrCmdDistributorTest, TestCrossCoreJoin, TestConfig, TestAnalyzeInfixSuggestions, SolrJmxReporterTest, ForceLeaderTest, TestRandomFaceting, PeerSyncWithIndexFingerprintCachingTest, NoCacheHeaderTest, TestRuleBasedAuthorizationPlugin, TestManagedResourceStorage, UUIDFieldTest, TestManagedStopFilterFactory, DocValuesMissingTest, TestReplicationHandlerBackup, AsyncCallRequestStatusResponseTest, TestManagedSchema, TestRecovery, TestGeoJSONResponseWriter, TestSchemalessBufferedUpdates, CacheHeaderTest, TestIndexSearcher, CircularListTest, TestOmitPositions, TestTrie, HdfsRecoverLeaseTest, HighlighterConfigTest, TestRangeQuery, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, SyncSliceTest, OverseerTest, LeaderElectionIntegrationTest, ShardRoutingTest, FullSolrCloudDistribCmdsTest, TestReplicationHandler]
   [junit4] Completed [332/678 (1!)] on J1 in 139.81s, 15 tests, 1 failure, 1 skipped <<< FAILURES!

[...truncated 63642 lines...]


[JENKINS] Lucene-Solr-6.x-MacOSX (64bit/jdk1.8.0) - Build # 631 - Still unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-6.x-MacOSX/631/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseSerialGC

2 tests failed.
FAILED:  org.apache.solr.cloud.HttpPartitionTest.test

Error Message:
Doc with id=2 not found in http://127.0.0.1:58637/c8n_1x2_leader_session_loss due to: Path not found: /id; rsp={doc=null}

Stack Trace:
java.lang.AssertionError: Doc with id=2 not found in http://127.0.0.1:58637/c8n_1x2_leader_session_loss due to: Path not found: /id; rsp={doc=null}
	at __randomizedtesting.SeedInfo.seed([168A5458188EA161:9EDE6B82B672CC99]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:620)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:575)
	at org.apache.solr.cloud.HttpPartitionTest.testLeaderZkSessionLoss(HttpPartitionTest.java:523)
	at org.apache.solr.cloud.HttpPartitionTest.test(HttpPartitionTest.java:136)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:811)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:462)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.TestRandomRequestDistribution.test

Error Message:
Shard a1x2_shard1_replica1 received all 10 requests

Stack Trace:
java.lang.AssertionError: Shard a1x2_shard1_replica1 received all 10 requests
	at __randomizedtesting.SeedInfo.seed([168A5458188EA161:9EDE6B82B672CC99]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.TestRandomRequestDistribution.testRequestTracking(TestRandomRequestDistribution.java:121)
	at org.apache.solr.cloud.TestRandomRequestDistribution.test(TestRandomRequestDistribution.java:65)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:811)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:462)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 10897 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestRandomRequestDistribution
   [junit4]   2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/init-core-data-001
   [junit4]   2> 241660 INFO  (SUITE-TestRandomRequestDistribution-seed#[168A5458188EA161]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=None) w/ MAC_OS_X supressed clientAuth
   [junit4]   2> 241661 INFO  (SUITE-TestRandomRequestDistribution-seed#[168A5458188EA161]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /gy_/d
   [junit4]   2> 241665 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 241665 INFO  (Thread-177) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 241665 INFO  (Thread-177) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 241773 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.ZkTestServer start zk server on port:54696
   [junit4]   2> 241846 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 241851 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 241855 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 241858 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 241862 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 241866 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 241869 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 241873 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 241876 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 241880 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 241884 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 242331 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/control-001/cores/collection1
   [junit4]   2> 242337 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 242343 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5f30a4d6{/gy_/d,null,AVAILABLE}
   [junit4]   2> 242345 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@4cceae7c{HTTP/1.1,[http/1.1]}{127.0.0.1:54699}
   [junit4]   2> 242345 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.e.j.s.Server Started @248474ms
   [junit4]   2> 242345 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/tempDir-001/control/data, hostContext=/gy_/d, hostPort=54699, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/control-001/cores}
   [junit4]   2> 242348 ERROR (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 242348 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 6.4.0
   [junit4]   2> 242348 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 242348 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 242348 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-01-08T22:37:26.641Z
   [junit4]   2> 242358 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 242358 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/control-001/solr.xml
   [junit4]   2> 242372 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 242373 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54696/solr
   [junit4]   2> 242461 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [n:127.0.0.1:54699_gy_%2Fd    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:54699_gy_%2Fd
   [junit4]   2> 242465 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [n:127.0.0.1:54699_gy_%2Fd    ] o.a.s.c.Overseer Overseer (id=97249856452165636-127.0.0.1:54699_gy_%2Fd-n_0000000000) starting
   [junit4]   2> 242490 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [n:127.0.0.1:54699_gy_%2Fd    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54699_gy_%2Fd
   [junit4]   2> 242497 INFO  (zkCallback-130-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd) [n:127.0.0.1:54699_gy_%2Fd    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 242587 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [n:127.0.0.1:54699_gy_%2Fd    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/control-001/cores
   [junit4]   2> 242587 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [n:127.0.0.1:54699_gy_%2Fd    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 242597 INFO  (OverseerStateUpdate-97249856452165636-127.0.0.1:54699_gy_%2Fd-n_0000000000) [n:127.0.0.1:54699_gy_%2Fd    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 243636 WARN  (coreLoadExecutor-350-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd) [n:127.0.0.1:54699_gy_%2Fd c:control_collection   x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 243637 INFO  (coreLoadExecutor-350-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd) [n:127.0.0.1:54699_gy_%2Fd c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.4.0
   [junit4]   2> 243665 INFO  (coreLoadExecutor-350-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd) [n:127.0.0.1:54699_gy_%2Fd c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 243778 WARN  (coreLoadExecutor-350-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd) [n:127.0.0.1:54699_gy_%2Fd c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 243781 INFO  (coreLoadExecutor-350-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd) [n:127.0.0.1:54699_gy_%2Fd c:control_collection   x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 243810 INFO  (coreLoadExecutor-350-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd) [n:127.0.0.1:54699_gy_%2Fd c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 243811 INFO  (coreLoadExecutor-350-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd) [n:127.0.0.1:54699_gy_%2Fd c:control_collection   x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/control-001/cores/collection1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/control-001/cores/collection1/data/]
   [junit4]   2> 243811 INFO  (coreLoadExecutor-350-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd) [n:127.0.0.1:54699_gy_%2Fd c:control_collection   x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4a8d6812
   [junit4]   2> 243813 INFO  (coreLoadExecutor-350-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd) [n:127.0.0.1:54699_gy_%2Fd c:control_collection   x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=61.6806640625, floorSegmentMB=2.0263671875, forceMergeDeletesPctAllowed=11.958108650832173, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 243823 WARN  (coreLoadExecutor-350-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd) [n:127.0.0.1:54699_gy_%2Fd c:control_collection   x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 243847 INFO  (coreLoadExecutor-350-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd) [n:127.0.0.1:54699_gy_%2Fd c:control_collection   x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 243847 INFO  (coreLoadExecutor-350-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd) [n:127.0.0.1:54699_gy_%2Fd c:control_collection   x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 243856 INFO  (coreLoadExecutor-350-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd) [n:127.0.0.1:54699_gy_%2Fd c:control_collection   x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 243856 INFO  (coreLoadExecutor-350-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd) [n:127.0.0.1:54699_gy_%2Fd c:control_collection   x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 243858 INFO  (coreLoadExecutor-350-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd) [n:127.0.0.1:54699_gy_%2Fd c:control_collection   x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=201311254, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 243861 INFO  (coreLoadExecutor-350-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd) [n:127.0.0.1:54699_gy_%2Fd c:control_collection   x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2af2254a[collection1] main]
   [junit4]   2> 243863 INFO  (coreLoadExecutor-350-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd) [n:127.0.0.1:54699_gy_%2Fd c:control_collection   x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 243864 INFO  (coreLoadExecutor-350-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd) [n:127.0.0.1:54699_gy_%2Fd c:control_collection   x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 243865 INFO  (coreLoadExecutor-350-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd) [n:127.0.0.1:54699_gy_%2Fd c:control_collection   x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 243866 INFO  (searcherExecutor-351-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd x:collection1 c:control_collection) [n:127.0.0.1:54699_gy_%2Fd c:control_collection   x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@2af2254a[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 243867 INFO  (coreLoadExecutor-350-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd) [n:127.0.0.1:54699_gy_%2Fd c:control_collection   x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1555997705539420160
   [junit4]   2> 243882 INFO  (coreZkRegister-343-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd x:collection1 c:control_collection) [n:127.0.0.1:54699_gy_%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 243883 INFO  (coreZkRegister-343-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd x:collection1 c:control_collection) [n:127.0.0.1:54699_gy_%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 243883 INFO  (coreZkRegister-343-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd x:collection1 c:control_collection) [n:127.0.0.1:54699_gy_%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:54699/gy_/d/collection1/
   [junit4]   2> 243883 INFO  (coreZkRegister-343-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd x:collection1 c:control_collection) [n:127.0.0.1:54699_gy_%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 243883 INFO  (coreZkRegister-343-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd x:collection1 c:control_collection) [n:127.0.0.1:54699_gy_%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:54699/gy_/d/collection1/ has no replicas
   [junit4]   2> 243893 INFO  (coreZkRegister-343-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd x:collection1 c:control_collection) [n:127.0.0.1:54699_gy_%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:54699/gy_/d/collection1/ shard1
   [junit4]   2> 244062 INFO  (coreZkRegister-343-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd x:collection1 c:control_collection) [n:127.0.0.1:54699_gy_%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 244243 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 244246 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:54696/solr ready
   [junit4]   2> 244246 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 244637 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/shard-1-001/cores/collection1
   [junit4]   2> 244638 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/shard-1-001
   [junit4]   2> 244639 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 244642 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6ffb8752{/gy_/d,null,AVAILABLE}
   [junit4]   2> 244644 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@48b4cdb1{HTTP/1.1,[http/1.1]}{127.0.0.1:54704}
   [junit4]   2> 244644 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.e.j.s.Server Started @250772ms
   [junit4]   2> 244644 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/gy_/d, hostPort=54704, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/shard-1-001/cores}
   [junit4]   2> 244644 ERROR (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 244645 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 6.4.0
   [junit4]   2> 244645 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 244645 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 244645 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-01-08T22:37:28.938Z
   [junit4]   2> 244654 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 244654 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/shard-1-001/solr.xml
   [junit4]   2> 244681 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 244682 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54696/solr
   [junit4]   2> 244740 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [n:127.0.0.1:54704_gy_%2Fd    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 244752 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [n:127.0.0.1:54704_gy_%2Fd    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54704_gy_%2Fd
   [junit4]   2> 244757 INFO  (zkCallback-130-thread-2-processing-n:127.0.0.1:54699_gy_%2Fd) [n:127.0.0.1:54699_gy_%2Fd    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 244758 INFO  (zkCallback-139-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd) [n:127.0.0.1:54704_gy_%2Fd    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 244758 INFO  (zkCallback-134-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 244813 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [n:127.0.0.1:54704_gy_%2Fd    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/shard-1-001/cores
   [junit4]   2> 244813 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [n:127.0.0.1:54704_gy_%2Fd    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 244818 INFO  (OverseerStateUpdate-97249856452165636-127.0.0.1:54699_gy_%2Fd-n_0000000000) [n:127.0.0.1:54699_gy_%2Fd    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
   [junit4]   2> 245844 WARN  (coreLoadExecutor-361-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd) [n:127.0.0.1:54704_gy_%2Fd c:collection1   x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 245845 INFO  (coreLoadExecutor-361-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd) [n:127.0.0.1:54704_gy_%2Fd c:collection1   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.4.0
   [junit4]   2> 245883 INFO  (coreLoadExecutor-361-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd) [n:127.0.0.1:54704_gy_%2Fd c:collection1   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 246067 WARN  (coreLoadExecutor-361-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd) [n:127.0.0.1:54704_gy_%2Fd c:collection1   x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 246073 INFO  (coreLoadExecutor-361-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd) [n:127.0.0.1:54704_gy_%2Fd c:collection1   x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 246108 INFO  (coreLoadExecutor-361-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd) [n:127.0.0.1:54704_gy_%2Fd c:collection1   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 246109 INFO  (coreLoadExecutor-361-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd) [n:127.0.0.1:54704_gy_%2Fd c:collection1   x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/shard-1-001/cores/collection1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/shard-1-001/cores/collection1/data/]
   [junit4]   2> 246110 INFO  (coreLoadExecutor-361-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd) [n:127.0.0.1:54704_gy_%2Fd c:collection1   x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4a8d6812
   [junit4]   2> 246112 INFO  (coreLoadExecutor-361-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd) [n:127.0.0.1:54704_gy_%2Fd c:collection1   x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=61.6806640625, floorSegmentMB=2.0263671875, forceMergeDeletesPctAllowed=11.958108650832173, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 246122 WARN  (coreLoadExecutor-361-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd) [n:127.0.0.1:54704_gy_%2Fd c:collection1   x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 246149 INFO  (coreLoadExecutor-361-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd) [n:127.0.0.1:54704_gy_%2Fd c:collection1   x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 246149 INFO  (coreLoadExecutor-361-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd) [n:127.0.0.1:54704_gy_%2Fd c:collection1   x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 246151 INFO  (coreLoadExecutor-361-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd) [n:127.0.0.1:54704_gy_%2Fd c:collection1   x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 246151 INFO  (coreLoadExecutor-361-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd) [n:127.0.0.1:54704_gy_%2Fd c:collection1   x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 246154 INFO  (coreLoadExecutor-361-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd) [n:127.0.0.1:54704_gy_%2Fd c:collection1   x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=201311254, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 246155 INFO  (coreLoadExecutor-361-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd) [n:127.0.0.1:54704_gy_%2Fd c:collection1   x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@24efde91[collection1] main]
   [junit4]   2> 246158 INFO  (coreLoadExecutor-361-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd) [n:127.0.0.1:54704_gy_%2Fd c:collection1   x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 246159 INFO  (coreLoadExecutor-361-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd) [n:127.0.0.1:54704_gy_%2Fd c:collection1   x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 246159 INFO  (coreLoadExecutor-361-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd) [n:127.0.0.1:54704_gy_%2Fd c:collection1   x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 246160 INFO  (searcherExecutor-362-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd x:collection1 c:collection1) [n:127.0.0.1:54704_gy_%2Fd c:collection1   x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@24efde91[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 246161 INFO  (coreLoadExecutor-361-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd) [n:127.0.0.1:54704_gy_%2Fd c:collection1   x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1555997707944853504
   [junit4]   2> 246175 INFO  (coreZkRegister-356-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd x:collection1 c:collection1) [n:127.0.0.1:54704_gy_%2Fd c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 246176 INFO  (coreZkRegister-356-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd x:collection1 c:collection1) [n:127.0.0.1:54704_gy_%2Fd c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 246176 INFO  (coreZkRegister-356-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd x:collection1 c:collection1) [n:127.0.0.1:54704_gy_%2Fd c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:54704/gy_/d/collection1/
   [junit4]   2> 246176 INFO  (coreZkRegister-356-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd x:collection1 c:collection1) [n:127.0.0.1:54704_gy_%2Fd c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 246176 INFO  (coreZkRegister-356-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd x:collection1 c:collection1) [n:127.0.0.1:54704_gy_%2Fd c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:54704/gy_/d/collection1/ has no replicas
   [junit4]   2> 246186 INFO  (coreZkRegister-356-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd x:collection1 c:collection1) [n:127.0.0.1:54704_gy_%2Fd c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:54704/gy_/d/collection1/ shard2
   [junit4]   2> 246349 INFO  (coreZkRegister-356-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd x:collection1 c:collection1) [n:127.0.0.1:54704_gy_%2Fd c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 246896 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/shard-2-001/cores/collection1
   [junit4]   2> 246899 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/shard-2-001
   [junit4]   2> 246901 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 246918 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@29b84008{/gy_/d,null,AVAILABLE}
   [junit4]   2> 246920 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@19bcf1bb{HTTP/1.1,[http/1.1]}{127.0.0.1:54708}
   [junit4]   2> 246920 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.e.j.s.Server Started @253048ms
   [junit4]   2> 246920 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/tempDir-001/jetty2, solrconfig=solrconfig.xml, hostContext=/gy_/d, hostPort=54708, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/shard-2-001/cores}
   [junit4]   2> 246920 ERROR (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 246921 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 6.4.0
   [junit4]   2> 246921 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 246921 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 246921 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-01-08T22:37:31.214Z
   [junit4]   2> 246932 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 246932 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/shard-2-001/solr.xml
   [junit4]   2> 246951 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 246952 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54696/solr
   [junit4]   2> 246986 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [n:127.0.0.1:54708_gy_%2Fd    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 247002 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [n:127.0.0.1:54708_gy_%2Fd    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54708_gy_%2Fd
   [junit4]   2> 247010 INFO  (zkCallback-139-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd) [n:127.0.0.1:54704_gy_%2Fd    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 247011 INFO  (zkCallback-145-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd) [n:127.0.0.1:54708_gy_%2Fd    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 247010 INFO  (zkCallback-130-thread-2-processing-n:127.0.0.1:54699_gy_%2Fd) [n:127.0.0.1:54699_gy_%2Fd    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 247010 INFO  (zkCallback-134-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 247093 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [n:127.0.0.1:54708_gy_%2Fd    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/shard-2-001/cores
   [junit4]   2> 247093 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [n:127.0.0.1:54708_gy_%2Fd    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 247100 INFO  (OverseerStateUpdate-97249856452165636-127.0.0.1:54699_gy_%2Fd-n_0000000000) [n:127.0.0.1:54699_gy_%2Fd    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 248134 WARN  (coreLoadExecutor-372-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd) [n:127.0.0.1:54708_gy_%2Fd c:collection1   x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 248136 INFO  (coreLoadExecutor-372-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd) [n:127.0.0.1:54708_gy_%2Fd c:collection1   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.4.0
   [junit4]   2> 248155 INFO  (coreLoadExecutor-372-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd) [n:127.0.0.1:54708_gy_%2Fd c:collection1   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 248296 WARN  (coreLoadExecutor-372-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd) [n:127.0.0.1:54708_gy_%2Fd c:collection1   x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 248302 INFO  (coreLoadExecutor-372-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd) [n:127.0.0.1:54708_gy_%2Fd c:collection1   x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 248351 INFO  (coreLoadExecutor-372-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd) [n:127.0.0.1:54708_gy_%2Fd c:collection1   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 248352 INFO  (coreLoadExecutor-372-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd) [n:127.0.0.1:54708_gy_%2Fd c:collection1   x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/shard-2-001/cores/collection1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/shard-2-001/cores/collection1/data/]
   [junit4]   2> 248352 INFO  (coreLoadExecutor-372-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd) [n:127.0.0.1:54708_gy_%2Fd c:collection1   x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4a8d6812
   [junit4]   2> 248355 INFO  (coreLoadExecutor-372-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd) [n:127.0.0.1:54708_gy_%2Fd c:collection1   x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=61.6806640625, floorSegmentMB=2.0263671875, forceMergeDeletesPctAllowed=11.958108650832173, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 248367 WARN  (coreLoadExecutor-372-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd) [n:127.0.0.1:54708_gy_%2Fd c:collection1   x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 248398 INFO  (coreLoadExecutor-372-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd) [n:127.0.0.1:54708_gy_%2Fd c:collection1   x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 248398 INFO  (coreLoadExecutor-372-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd) [n:127.0.0.1:54708_gy_%2Fd c:collection1   x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 248400 INFO  (coreLoadExecutor-372-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd) [n:127.0.0.1:54708_gy_%2Fd c:collection1   x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 248400 INFO  (coreLoadExecutor-372-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd) [n:127.0.0.1:54708_gy_%2Fd c:collection1   x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 248402 INFO  (coreLoadExecutor-372-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd) [n:127.0.0.1:54708_gy_%2Fd c:collection1   x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=201311254, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 248405 INFO  (coreLoadExecutor-372-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd) [n:127.0.0.1:54708_gy_%2Fd c:collection1   x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@32716e60[collection1] main]
   [junit4]   2> 248406 INFO  (coreLoadExecutor-372-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd) [n:127.0.0.1:54708_gy_%2Fd c:collection1   x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 248407 INFO  (coreLoadExecutor-372-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd) [n:127.0.0.1:54708_gy_%2Fd c:collection1   x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 248407 INFO  (coreLoadExecutor-372-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd) [n:127.0.0.1:54708_gy_%2Fd c:collection1   x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 248409 INFO  (searcherExecutor-373-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd x:collection1 c:collection1) [n:127.0.0.1:54708_gy_%2Fd c:collection1   x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@32716e60[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 248410 INFO  (coreLoadExecutor-372-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd) [n:127.0.0.1:54708_gy_%2Fd c:collection1   x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1555997710303100928
   [junit4]   2> 248424 INFO  (coreZkRegister-367-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd x:collection1 c:collection1) [n:127.0.0.1:54708_gy_%2Fd c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 248424 INFO  (coreZkRegister-367-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd x:collection1 c:collection1) [n:127.0.0.1:54708_gy_%2Fd c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 248424 INFO  (coreZkRegister-367-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd x:collection1 c:collection1) [n:127.0.0.1:54708_gy_%2Fd c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:54708/gy_/d/collection1/
   [junit4]   2> 248424 INFO  (coreZkRegister-367-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd x:collection1 c:collection1) [n:127.0.0.1:54708_gy_%2Fd c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 248424 INFO  (coreZkRegister-367-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd x:collection1 c:collection1) [n:127.0.0.1:54708_gy_%2Fd c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:54708/gy_/d/collection1/ has no replicas
   [junit4]   2> 248433 INFO  (coreZkRegister-367-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd x:collection1 c:collection1) [n:127.0.0.1:54708_gy_%2Fd c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:54708/gy_/d/collection1/ shard1
   [junit4]   2> 248589 INFO  (coreZkRegister-367-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd x:collection1 c:collection1) [n:127.0.0.1:54708_gy_%2Fd c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 249090 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/shard-3-001/cores/collection1
   [junit4]   2> 249091 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/shard-3-001
   [junit4]   2> 249092 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 249096 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@643fc2d8{/gy_/d,null,AVAILABLE}
   [junit4]   2> 249099 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@49fb9884{HTTP/1.1,[http/1.1]}{127.0.0.1:54712}
   [junit4]   2> 249099 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.e.j.s.Server Started @255227ms
   [junit4]   2> 249099 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/tempDir-001/jetty3, solrconfig=solrconfig.xml, hostContext=/gy_/d, hostPort=54712, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/shard-3-001/cores}
   [junit4]   2> 249099 ERROR (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 249099 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 6.4.0
   [junit4]   2> 249099 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 249099 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 249100 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-01-08T22:37:33.393Z
   [junit4]   2> 249108 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 249108 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/shard-3-001/solr.xml
   [junit4]   2> 249123 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 249125 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54696/solr
   [junit4]   2> 249157 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [n:127.0.0.1:54712_gy_%2Fd    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 249172 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [n:127.0.0.1:54712_gy_%2Fd    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54712_gy_%2Fd
   [junit4]   2> 249177 INFO  (zkCallback-130-thread-2-processing-n:127.0.0.1:54699_gy_%2Fd) [n:127.0.0.1:54699_gy_%2Fd    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 249178 INFO  (zkCallback-145-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd) [n:127.0.0.1:54708_gy_%2Fd    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 249180 INFO  (zkCallback-134-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 249180 INFO  (zkCallback-139-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd) [n:127.0.0.1:54704_gy_%2Fd    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 249182 INFO  (zkCallback-151-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd) [n:127.0.0.1:54712_gy_%2Fd    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 249348 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [n:127.0.0.1:54712_gy_%2Fd    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/shard-3-001/cores
   [junit4]   2> 249348 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [n:127.0.0.1:54712_gy_%2Fd    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 249357 INFO  (OverseerStateUpdate-97249856452165636-127.0.0.1:54699_gy_%2Fd-n_0000000000) [n:127.0.0.1:54699_gy_%2Fd    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
   [junit4]   2> 250388 WARN  (coreLoadExecutor-383-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd) [n:127.0.0.1:54712_gy_%2Fd c:collection1   x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 250389 INFO  (coreLoadExecutor-383-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd) [n:127.0.0.1:54712_gy_%2Fd c:collection1   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.4.0
   [junit4]   2> 250430 INFO  (coreLoadExecutor-383-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd) [n:127.0.0.1:54712_gy_%2Fd c:collection1   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 250605 WARN  (coreLoadExecutor-383-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd) [n:127.0.0.1:54712_gy_%2Fd c:collection1   x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 250610 INFO  (coreLoadExecutor-383-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd) [n:127.0.0.1:54712_gy_%2Fd c:collection1   x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 250655 INFO  (coreLoadExecutor-383-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd) [n:127.0.0.1:54712_gy_%2Fd c:collection1   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 250656 INFO  (coreLoadExecutor-383-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd) [n:127.0.0.1:54712_gy_%2Fd c:collection1   x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/shard-3-001/cores/collection1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/shard-3-001/cores/collection1/data/]
   [junit4]   2> 250656 INFO  (coreLoadExecutor-383-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd) [n:127.0.0.1:54712_gy_%2Fd c:collection1   x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4a8d6812
   [junit4]   2> 250659 INFO  (coreLoadExecutor-383-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd) [n:127.0.0.1:54712_gy_%2Fd c:collection1   x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=61.6806640625, floorSegmentMB=2.0263671875, forceMergeDeletesPctAllowed=11.958108650832173, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 250667 WARN  (coreLoadExecutor-383-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd) [n:127.0.0.1:54712_gy_%2Fd c:collection1   x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 250704 INFO  (coreLoadExecutor-383-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd) [n:127.0.0.1:54712_gy_%2Fd c:collection1   x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 250704 INFO  (coreLoadExecutor-383-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd) [n:127.0.0.1:54712_gy_%2Fd c:collection1   x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 250706 INFO  (coreLoadExecutor-383-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd) [n:127.0.0.1:54712_gy_%2Fd c:collection1   x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 250706 INFO  (coreLoadExecutor-383-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd) [n:127.0.0.1:54712_gy_%2Fd c:collection1   x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 250709 INFO  (coreLoadExecutor-383-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd) [n:127.0.0.1:54712_gy_%2Fd c:collection1   x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=201311254, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 250711 INFO  (coreLoadExecutor-383-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd) [n:127.0.0.1:54712_gy_%2Fd c:collection1   x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@22b4d4ef[collection1] main]
   [junit4]   2> 250713 INFO  (coreLoadExecutor-383-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd) [n:127.0.0.1:54712_gy_%2Fd c:collection1   x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 250715 INFO  (coreLoadExecutor-383-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd) [n:127.0.0.1:54712_gy_%2Fd c:collection1   x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 250716 INFO  (coreLoadExecutor-383-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd) [n:127.0.0.1:54712_gy_%2Fd c:collection1   x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 250717 INFO  (searcherExecutor-384-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd x:collection1 c:collection1) [n:127.0.0.1:54712_gy_%2Fd c:collection1   x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@22b4d4ef[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 250749 INFO  (coreLoadExecutor-383-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd) [n:127.0.0.1:54712_gy_%2Fd c:collection1   x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1555997712755720192
   [junit4]   2> 250758 INFO  (coreZkRegister-378-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd x:collection1 c:collection1) [n:127.0.0.1:54712_gy_%2Fd c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.ZkController Core needs to recover:collection1
   [junit4]   2> 250759 INFO  (updateExecutor-148-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:54712_gy_%2Fd c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 250760 INFO  (recoveryExecutor-149-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:54712_gy_%2Fd c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
   [junit4]   2> 250761 INFO  (recoveryExecutor-149-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:54712_gy_%2Fd c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
   [junit4]   2> 250761 INFO  (recoveryExecutor-149-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:54712_gy_%2Fd c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1]
   [junit4]   2> 250761 INFO  (recoveryExecutor-149-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:54712_gy_%2Fd c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
   [junit4]   2> 250761 INFO  (recoveryExecutor-149-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:54712_gy_%2Fd c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Publishing state of core [collection1] as recovering, leader is [http://127.0.0.1:54704/gy_/d/collection1/] and I am [http://127.0.0.1:54712/gy_/d/collection1/]
   [junit4]   2> 250765 INFO  (recoveryExecutor-149-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:54712_gy_%2Fd c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:54704/gy_/d]; [WaitForState: action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1:54712_gy_%252Fd&coreNodeName=core_node3&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
   [junit4]   2> 250773 INFO  (qtp919953601-847) [n:127.0.0.1:54704_gy_%2Fd    ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true
   [junit4]   2> 250774 INFO  (qtp919953601-847) [n:127.0.0.1:54704_gy_%2Fd    ] o.a.s.h.a.PrepRecoveryOp Will wait a max of 183 seconds to see collection1 (shard2 of collection1) have state: recovering
   [junit4]   2> 250774 INFO  (qtp919953601-847) [n:127.0.0.1:54704_gy_%2Fd    ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:54712_gy_%2Fd, coreNodeName=core_node3, onlyIfActiveCheckResult=false, nodeProps: core_node3:{"core":"collection1","base_url":"http://127.0.0.1:54712/gy_/d","node_name":"127.0.0.1:54712_gy_%2Fd","state":"down"}
   [junit4]   2> 250956 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.SolrTestCaseJ4 ###Starting test
   [junit4]   2> 250956 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Wait for recoveries to finish - wait 30 for each attempt
   [junit4]   2> 250956 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):30
   [junit4]   2> 251777 INFO  (qtp919953601-847) [n:127.0.0.1:54704_gy_%2Fd    ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:54712_gy_%2Fd, coreNodeName=core_node3, onlyIfActiveCheckResult=false, nodeProps: core_node3:{"core":"collection1","base_url":"http://127.0.0.1:54712/gy_/d","node_name":"127.0.0.1:54712_gy_%2Fd","state":"recovering"}
   [junit4]   2> 251777 INFO  (qtp919953601-847) [n:127.0.0.1:54704_gy_%2Fd    ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
   [junit4]   2> 251777 INFO  (qtp919953601-847) [n:127.0.0.1:54704_gy_%2Fd    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:54712_gy_%252Fd&onlyIfLeaderActive=true&core=collection1&coreNodeName=core_node3&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=1004
   [junit4]   2> 258782 INFO  (recoveryExecutor-149-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:54712_gy_%2Fd c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Attempting to PeerSync from [http://127.0.0.1:54704/gy_/d/collection1/] - recoveringAfterStartup=[true]
   [junit4]   2> 258782 INFO  (recoveryExecutor-149-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:54712_gy_%2Fd c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.PeerSync PeerSync: core=collection1 url=http://127.0.0.1:54712/gy_/d START replicas=[http://127.0.0.1:54704/gy_/d/collection1/] nUpdates=100
   [junit4]   2> 258788 INFO  (qtp919953601-849) [n:127.0.0.1:54704_gy_%2Fd c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.IndexFingerprint IndexFingerprint millis:1.0 result:{maxVersionSpecified=9223372036854775807, maxVersionEncountered=0, maxInHash=0, versionsHash=0, numVersions=0, numDocs=0, maxDoc=0}
   [junit4]   2> 258788 INFO  (qtp919953601-849) [n:127.0.0.1:54704_gy_%2Fd c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.S.Request [collection1]  webapp=/gy_/d path=/get params={distrib=false&qt=/get&getFingerprint=9223372036854775807&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 258790 INFO  (recoveryExecutor-149-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:54712_gy_%2Fd c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.IndexFingerprint IndexFingerprint millis:1.0 result:{maxVersionSpecified=9223372036854775807, maxVersionEncountered=0, maxInHash=0, versionsHash=0, numVersions=0, numDocs=0, maxDoc=0}
   [junit4]   2> 258791 INFO  (recoveryExecutor-149-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:54712_gy_%2Fd c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.PeerSync We are already in sync. No need to do a PeerSync 
   [junit4]   2> 258791 INFO  (recoveryExecutor-149-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:54712_gy_%2Fd c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 258791 INFO  (recoveryExecutor-149-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:54712_gy_%2Fd c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 258792 INFO  (recoveryExecutor-149-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:54712_gy_%2Fd c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 258792 INFO  (recoveryExecutor-149-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:54712_gy_%2Fd c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy PeerSync stage of recovery was successful.
   [junit4]   2> 258792 INFO  (recoveryExecutor-149-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:54712_gy_%2Fd c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Replaying updates buffered during PeerSync.
   [junit4]   2> 258792 INFO  (recoveryExecutor-149-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:54712_gy_%2Fd c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy No replay needed.
   [junit4]   2> 258792 INFO  (recoveryExecutor-149-thread-1-processing-n:127.0.0.1:54712_gy_%2Fd x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:54712_gy_%2Fd c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Registering as Active after recovery.
   [junit4]   2> 258974 INFO  (TEST-TestRandomRequestDistribution.test-seed#[168A5458188EA161]) [    ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: collection1
   [junit4]   2> 258979 INFO  (qtp1869461186-811) [n:127.0.0.1:54699_gy_%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 258980 INFO  (qtp1869461186-811) [n:127.0.0.1:54699_gy_%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 258980 INFO  (qtp1869461186-811) [n:127.0.0.1:54699_gy_%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 258981 INFO  (qtp1869461186-811) [n:127.0.0.1:54699_gy_%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/gy_/d path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 2
   [junit4]   2> 258992 INFO  (qtp919953601-845) [n:127.0.0.1:54704_gy_%2Fd c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 258992 INFO  (qtp919953601-845) [n:127.0.0.1:54704_gy_%2Fd c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 258993 INFO  (qtp919953601-845) [n:127.0.0.1:54704_gy_%2Fd c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 258995 INFO  (qtp919953601-845) [n:127.0.0.1:54704_gy_%2Fd c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/gy_/d path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:54704/gy_/d/collection1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 3
   [junit4]   2> 258997 INFO  (qtp580771573-903) [n:127.0.0.1:54712_gy_%2Fd c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 258997 INFO  (qtp687748861-875) [n:127.0.0.1:54708_gy_%2Fd c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 258998 INFO  (qtp687748861-875) [n:127.0.0.1:54708_gy_%2Fd c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 258999 INFO  (qtp687748861-875) [n:127.0.0.1:54708_gy_%2Fd c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 258999 INFO  (qtp580771573-903) [n:127.0.0.1:54712_gy_%2Fd c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 258999 INFO  (qtp687748861-875) [n:127.0.0.1:54708_gy_%2Fd c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/gy_/d path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:54704/gy_/d/collection1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 2
   [junit4]   2> 259001 INFO  (qtp580771573-903) [n:127.0.0.1:54712_gy_%2Fd c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 259001 INFO  (qtp580771573-903) [n:127.0.0.1:54712_gy_%2Fd c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/gy_/d path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:54704/gy_/d/collection1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 4
   [junit4]   2> 259004 INFO  (qtp919953601-852) [n:127.0.0.1:54704_gy_%2Fd c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/gy_/d path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 19
   [junit4]   2> 259010 INFO  (qtp919953601-848) [n:127.0.0.1:54704_gy_%2Fd c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.S.Request [collection1]  webapp=/gy_/d path=/select params={q=*:*&distrib=false&tests=checkShardConsistency&rows=0&wt=javabin&version=2} hits=0 status=0 QTime=2
   [junit4]   2> 259012 INFO  (qtp580771573-904) [n:127.0.0.1:54712_gy_%2Fd c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.S.Request [collection1]  webapp=/gy_/d path=/select params={q=*:*&distrib=false&tests=checkShardConsistency&rows=0&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 259014 INFO  (qtp687748861-877) [n:127.0.0.1:54708_gy_%2Fd c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.S.Request [collection1]  webapp=/gy_/d path=/select params={q=*:*&distrib=false&tests=checkShardConsistency&rows=0&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 261017 INFO  (qtp919953601-850) [n:127.0.0.1:54704_gy_%2Fd    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&name=a1x2&action=CREATE&numShards=1&createNodeSet=127.0.0.1:54704_gy_%252Fd,127.0.0.1:54708_gy_%252Fd&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 261024 INFO  (OverseerThreadFactory-348-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd) [n:127.0.0.1:54699_gy_%2Fd    ] o.a.s.c.CreateCollectionCmd Create collection a1x2
   [junit4]   2> 261024 INFO  (OverseerThreadFactory-348-thread-1-processing-n:127.0.0.1:54699_gy_%2Fd) [n:127.0.0.1:54699_gy_%2Fd    ] o.a.s.c.CreateCollectionCmd Only one config set found in zk - using it:conf1
   [junit4]   2> 261138 INFO  (qtp687748861-878) [n:127.0.0.1:54708_gy_%2Fd    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=a1x2_shard1_replica1&action=CREATE&numShards=1&collection=a1x2&shard=shard1&wt=javabin&version=2
   [junit4]   2> 261138 INFO  (qtp919953601-851) [n:127.0.0.1:54704_gy_%2Fd    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=a1x2_shard1_replica2&action=CREATE&numShards=1&collection=a1x2&shard=shard1&wt=javabin&version=2
   [junit4]   2> 261256 INFO  (zkCallback-139-thread-1-processing-n:127.0.0.1:54704_gy_%2Fd) [n:127.0.0.1:54704_gy_%2Fd    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/a1x2/state.json] for collection [a1x2] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 261256 INFO  (zkCallback-145-thread-1-processing-n:127.0.0.1:54708_gy_%2Fd) [n:127.0.0.1:54708_gy_%2Fd    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/a1x2/state.json] for collection [a1x2] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 262174 WARN  (qtp687748861-878) [n:127.0.0.1:54708_gy_%2Fd c:a1x2 s:shard1  x:a1x2_shard1_replica1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 262176 INFO  (qtp687748861-878) [n:127.0.0.1:54708_gy_%2Fd c:a1x2 s:shard1  x:a1x2_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.4.0
   [junit4]   2> 262195 WARN  (qtp919953601-851) [n:127.0.0.1:54704_gy_%2Fd c:a1x2 s:shard1  x:a1x2_shard1_replica2] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 262196 INFO  (qtp919953601-851) [n:127.0.0.1:54704_gy_%2Fd c:a1x2 s:shard1  x:a1x2_shard1_replica2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.4.0
   [junit4]   2> 262214 INFO  (qtp687748861-878) [n:127.0.0.1:54708_gy_%2Fd c:a1x2 s:shard1  x:a1x2_shard1_replica1] o.a.s.s.IndexSchema [a1x2_shard1_replica1] Schema name=test
   [junit4]   2> 262220 INFO  (qtp919953601-851) [n:127.0.0.1:54704_gy_%2Fd c:a1x2 s:shard1  x:a1x2_shard1_replica2] o.a.s.s.IndexSchema [a1x2_shard1_replica2] Schema name=test
   [junit4]   2> 262350 WARN  (qtp687748861-878) [n:127.0.0.1:54708_gy_%2Fd c:a1x2 s:shard1  x:a1x2_shard1_replica1] o.a.s.s.IndexSchema [a1x2_shard1_replica1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 262352 INFO  (qtp687748861-878) [n:127.0.0.1:54708_gy_%2Fd c:a1x2 s:shard1  x:a1x2_shard1_replica1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 262375 WARN  (qtp919953601-851) [n:127.0.0.1:54704_gy_%2Fd c:a1x2 s:shard1  x:a1x2_shard1_replica2] o.a.s.s.IndexSchema [a1x2_shard1_replica2] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 262378 INFO  (qtp919953601-851) [n:127.0.0.1:54704_gy_%2Fd c:a1x2 s:shard1  x:a1x2_shard1_replica2] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 262394 INFO  (qtp687748861-878) [n:127.0.0.1:54708_gy_%2Fd c:a1x2 s:shard1  x:a1x2_shard1_replica1] o.a.s.c.CoreContainer Creating SolrCore 'a1x2_shard1_replica1' using configuration from collection a1x2
   [junit4]   2> 262394 INFO  (qtp687748861-878) [n:127.0.0.1:54708_gy_%2Fd c:a1x2 s:shard1  x:a1x2_shard1_replica1] o.a.s.c.SolrCore [[a1x2_shard1_replica1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/shard-2-001/cores/a1x2_shard1_replica1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestDistribution_168A5458188EA161-001/shard-2-001/cores/a1x2_shard1_replica1/data/]
   [junit4]   2> 262395 INFO  (qtp687748861-878) [n:127.0.0.1:54708_gy_%2Fd c:a1x2 s:shard1  x:a1x2_shard1_replica1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4a8d6812
   [junit4]   2> 262397 INFO  (qtp687748861-878) [n:127.0.0.1:54708_gy_%2Fd c:a1x2 s:shard1  x:a1x2_shard1_replica1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=61.6806640625, floorSegmentMB=2.0263671875, forceMergeDeletesPctAllowed=11.958108650832173, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 262407 WARN  (qtp687748861-878) [n:127.0.0.1:54708_gy_%2Fd c:a1x2 s:shard1  x:a1x2_shard1_replica1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 262410 INFO  (qtp919953601-851) [n:127.0.0.1:54704_gy_%2Fd c:a1x2 s:shard1  x:a1x2_shard1_replica2] o.a.s.c.CoreContainer Creating SolrCore 'a1x2_shard1_replica2' using configuration from collection a1x2
   [junit4]   2> 262411 INFO  (qtp919953601-851) [n:127.0.0.1:54704_gy_%2Fd c:a1x2 s:shard1  x:a1x2_shard1_replica2] o.a.s.c.SolrCore [[a1x2_shard1_replica2] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRandomRequestD

[...truncated too long message...]

 1789106 INFO  (zkCallback-1671-thread-2-processing-n:127.0.0.1:58669_) [n:127.0.0.1:58669_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@3c3168e8
   [junit4]   2> 1789120 INFO  (zkCallback-1671-thread-2-processing-n:127.0.0.1:58669_) [n:127.0.0.1:58669_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
   [junit4]   2> 1789121 INFO  (TEST-HttpPartitionTest.test-seed#[168A5458188EA161]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 1789122 INFO  (TEST-HttpPartitionTest.test-seed#[168A5458188EA161]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@50bf9b49{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1789123 INFO  (TEST-HttpPartitionTest.test-seed#[168A5458188EA161]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@50f2bae4{/,null,UNAVAILABLE}
   [junit4]   2> 1789125 INFO  (TEST-HttpPartitionTest.test-seed#[168A5458188EA161]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:58634 58634
   [junit4]   2> 1789229 INFO  (Thread-2241) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:58634 58634
   [junit4]   2> 1790704 WARN  (Thread-2241) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/clusterprops.json
   [junit4]   2> 	5	/solr/aliases.json
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 	4	/solr/configs/conf1
   [junit4]   2> 	3	/solr/collections/collection1/state.json
   [junit4]   2> 	3	/solr/collections/c8n_1x3/state.json
   [junit4]   2> 	3	/solr/collections/collMinRf_1x3/state.json
   [junit4]   2> 	2	/solr/collections/c8n_1x2/state.json
   [junit4]   2> 	2	/solr/collections/c8n_crud_1x2/state.json
   [junit4]   2> 	2	/solr/collections/c8n_1x2_leader_session_loss/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/clusterstate.json
   [junit4]   2> 	2	/solr/collections/collMinRf_1x3/leader_elect/shard1/election/97249949613293579-core_node2-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	107	/solr/overseer/queue
   [junit4]   2> 	107	/solr/overseer/collection-queue-work
   [junit4]   2> 	19	/solr/overseer/queue-work
   [junit4]   2> 	5	/solr/live_nodes
   [junit4]   2> 	5	/solr/collections
   [junit4]   2> 
   [junit4]   2> 1790704 WARN  (TEST-HttpPartitionTest.test-seed#[168A5458188EA161]) [    ] o.a.s.c.SocketProxy Closing 3 connections to: http://127.0.0.1:58649/, target: http://127.0.0.1:58650/
   [junit4]   2> 1790705 WARN  (TEST-HttpPartitionTest.test-seed#[168A5458188EA161]) [    ] o.a.s.c.SocketProxy Closing 12 connections to: http://127.0.0.1:58669/, target: http://127.0.0.1:58670/
   [junit4]   2> 1790705 WARN  (TEST-HttpPartitionTest.test-seed#[168A5458188EA161]) [    ] o.a.s.c.SocketProxy Closing 7 connections to: http://127.0.0.1:58637/, target: http://127.0.0.1:58638/
   [junit4]   2> 1790705 WARN  (TEST-HttpPartitionTest.test-seed#[168A5458188EA161]) [    ] o.a.s.c.SocketProxy Closing 25 connections to: http://127.0.0.1:58663/, target: http://127.0.0.1:58664/
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=HttpPartitionTest -Dtests.method=test -Dtests.seed=168A5458188EA161 -Dtests.slow=true -Dtests.locale=ar-AE -Dtests.timezone=Pacific/Nauru -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE  128s J0 | HttpPartitionTest.test <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Doc with id=2 not found in http://127.0.0.1:58637/c8n_1x2_leader_session_loss due to: Path not found: /id; rsp={doc=null}
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([168A5458188EA161:9EDE6B82B672CC99]:0)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:620)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:575)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.testLeaderZkSessionLoss(HttpPartitionTest.java:523)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.test(HttpPartitionTest.java:136)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1790708 INFO  (SUITE-HttpPartitionTest-seed#[168A5458188EA161]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_168A5458188EA161-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene62): {range_facet_l_dv=PostingsFormat(name=Memory doPackFST= false), _version_=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), multiDefault=PostingsFormat(name=LuceneVarGapFixedInterval), a_t=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), intDefault=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), id=PostingsFormat(name=Memory doPackFST= false), range_facet_i_dv=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), text=PostingsFormat(name=Direct), range_facet_l=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), timestamp=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128)))}, docValues:{range_facet_l_dv=DocValuesFormat(name=Lucene54), range_facet_i_dv=DocValuesFormat(name=Direct), timestamp=DocValuesFormat(name=Direct)}, maxPointsInLeafNode=1885, maxMBSortInHeap=6.522055368069985, sim=RandomSimilarity(queryNorm=true,coord=crazy): {}, locale=ar-AE, timezone=Pacific/Nauru
   [junit4]   2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 1.8.0_102 (64-bit)/cpus=3,threads=1,free=125404064,total=495603712
   [junit4]   2> NOTE: All tests run in this JVM: [DistributedDebugComponentTest, ChaosMonkeyNothingIsSafeTest, TestFunctionQuery, TestWordDelimiterFilterFactory, SolrTestCaseJ4Test, DistributedQueryElevationComponentTest, DateRangeFieldTest, TestElisionMultitermQuery, TestManagedResource, CursorPagingTest, TermsComponentTest, XsltUpdateRequestHandlerTest, CollectionStateFormat2Test, DocValuesMultiTest, DistributedQueueTest, TestRandomRequestDistribution, HdfsWriteToMultipleCollectionsTest, DistributedFacetPivotLongTailTest, HdfsChaosMonkeySafeLeaderTest, ZkControllerTest, HLLSerializationTest, TestConfigSetsAPIExclusivity, TestSchemaVersionResource, TestCSVResponseWriter, TestFieldCacheSortRandom, SSLMigrationTest, BaseCdcrDistributedZkTest, HighlighterMaxOffsetTest, TestPushWriter, TestPseudoReturnFields, LeaderFailoverAfterPartitionTest, DocumentAnalysisRequestHandlerTest, TestCloudDeleteByQuery, GraphQueryTest, DistribDocExpirationUpdateProcessorTest, RuleEngineTest, TestXmlQParserPlugin, ExplicitHLLTest, TestOrdValues, IndexBasedSpellCheckerTest, TestCSVLoader, TestStressRecovery, SpatialHeatmapFacetsTest, BadComponentTest, OverseerCollectionConfigSetProcessorTest, TestFreeTextSuggestions, TestRandomCollapseQParserPlugin, SolrRequestParserTest, TestOverriddenPrefixQueryForCustomFieldType, TestSort, OutOfBoxZkACLAndCredentialsProvidersTest, TestMissingGroups, TestUniqueKeyFieldResource, TestUninvertingReader, TestSchemaResource, ZkCLITest, TestManagedSchemaAPI, TestScoreJoinQPScore, TestCloudRecovery, TestRequestStatusCollectionAPI, SolrMetricManagerTest, TestCursorMarkWithoutUniqueKey, BooleanFieldTest, HighlighterTest, TestDefaultSearchFieldResource, TestSolrCLIRunExample, TestDocumentBuilder, TestUpdate, MigrateRouteKeyTest, HdfsBasicDistributedZkTest, TestSolrJ, TestSchemaManager, SOLR749Test, TestSolrQueryParserDefaultOperatorResource, DateFieldTest, DOMUtilTest, TestConfigSets, TestObjectReleaseTracker, HdfsTlogReplayBufferedWhileIndexingTest, TestNumericTerms32, AlternateDirectoryTest, TestLeaderElectionWithEmptyReplica, TestExactSharedStatsCache, BlockCacheTest, TestReplicaProperties, TestFieldTypeResource, CollectionsAPIAsyncDistributedZkTest, OverseerTest, ClassificationUpdateProcessorIntegrationTest, SystemInfoHandlerTest, CachingDirectoryFactoryTest, LeaderElectionTest, TestBinaryField, TestCollapseQParserPlugin, TestReRankQParserPlugin, UtilsToolTest, TestDynamicFieldResource, VersionInfoTest, TestSolrConfigHandler, ReplaceNodeTest, OverseerTaskQueueTest, ShardRoutingTest, SolrMetricsIntegrationTest, BasicDistributedZkTest, TestStandardQParsers, TestJettySolrRunner, DirectUpdateHandlerTest, TestOnReconnectListenerSupport, TestBinaryResponseWriter, SparseHLLTest, PreAnalyzedFieldManagedSchemaCloudTest, SpatialFilterTest, PrimitiveFieldTypeTest, HdfsNNFailoverTest, ShardSplitTest, SolrSlf4jReporterTest, OpenExchangeRatesOrgProviderTest, StatelessScriptUpdateProcessorFactoryTest, TestGraphMLResponseWriter, TestClusterStateMutator, TestPostingsSolrHighlighter, DistributedSpellCheckComponentTest, JSONWriterTest, SolrXmlInZkTest, OutputWriterTest, RequiredFieldsTest, TestBlendedInfixSuggestions, TestInitParams, QueryElevationComponentTest, JSONWriterTest, CursorMarkTest, ConjunctionSolrSpellCheckerTest, TestChildDocTransformer, TestHdfsBackupRestoreCore, TestGraphTermsQParserPlugin, ActionThrottleTest, TestPKIAuthenticationPlugin, SuggesterFSTTest, TlogReplayBufferedWhileIndexingTest, RankQueryTest, TestLRUStatsCache, HttpPartitionTest]
   [junit4] Completed [318/678 (2!)] on J0 in 127.54s, 1 test, 1 failure <<< FAILURES!

[...truncated 63637 lines...]