You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/03/23 10:42:50 UTC

[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0-ea-b82) - Build # 4834 - Still Failing!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/4834/
Java: 32bit/jdk1.8.0-ea-b82 -server -XX:+UseConcMarkSweepGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
Server at http://127.0.0.1:41861/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update

Stack Trace:
org.apache.solr.common.SolrException: Server at http://127.0.0.1:41861/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
	at __randomizedtesting.SeedInfo.seed([6D674C5FAC30E796:EC81C247DB6F87AA]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:197)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:487)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 8902 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4]   2> 1 T19 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4]   2> 8 T19 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1364030820762
[junit4:junit4]   2> 11 T19 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 13 T20 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 34 T20 oaz.Environment.logEnv Server environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 35 T20 oaz.Environment.logEnv Server environment:host.name=serv1
[junit4:junit4]   2> 35 T20 oaz.Environment.logEnv Server environment:java.version=1.8.0-ea
[junit4:junit4]   2> 35 T20 oaz.Environment.logEnv Server environment:java.vendor=Oracle Corporation
[junit4:junit4]   2> 36 T20 oaz.Environment.logEnv Server environment:java.home=/var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b82/jre
[junit4:junit4]   2> 36 T20 oaz.Environment.logEnv Server environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/analysis/common/lucene-analyzers-common-5.0-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-5.0-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-5.0-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/codecs/lucene-codecs-5.0-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/highlighter/lucene-highlighter-5.0-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/memory/lucene-memory-5.0-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/misc/lucene-misc-5.0-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/spatial/lucene-spatial-5.0-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/suggest/lucene-suggest-5.0-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/grouping/lucene-grouping-5.0-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/queries/lucene-queries-5.0-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/queryparser/lucene-queryparser-5.0-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/lib/org.restlet-2.1.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/lib/org.restlet.ext.servlet-2.1.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/lib/httpclient-4.2.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/lib/httpcore-4.2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/lib/httpmime-4.2.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/lib/noggit-0.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.8.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.3.0.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-testutil.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b82/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.8.jar
[junit4:junit4]   2> 37 T20 oaz.Environment.logEnv Server environment:java.library.path=/usr/java/packages/lib/i386:/lib:/usr/lib
[junit4:junit4]   2> 38 T20 oaz.Environment.logEnv Server environment:java.io.tmpdir=.
[junit4:junit4]   2> 38 T20 oaz.Environment.logEnv Server environment:java.compiler=<NA>
[junit4:junit4]   2> 38 T20 oaz.Environment.logEnv Server environment:os.name=Linux
[junit4:junit4]   2> 39 T20 oaz.Environment.logEnv Server environment:os.arch=i386
[junit4:junit4]   2> 39 T20 oaz.Environment.logEnv Server environment:os.version=3.2.0-39-generic
[junit4:junit4]   2> 39 T20 oaz.Environment.logEnv Server environment:user.name=jenkins
[junit4:junit4]   2> 39 T20 oaz.Environment.logEnv Server environment:user.home=/var/lib/jenkins
[junit4:junit4]   2> 40 T20 oaz.Environment.logEnv Server environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 56 T20 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 56 T20 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 57 T20 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 68 T20 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 92 T20 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 113 T19 oasc.ZkTestServer.run start zk server on port:56831
[junit4:junit4]   2> 133 T19 oaz.Environment.logEnv Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 134 T19 oaz.Environment.logEnv Client environment:host.name=serv1
[junit4:junit4]   2> 134 T19 oaz.Environment.logEnv Client environment:java.version=1.8.0-ea
[junit4:junit4]   2> 134 T19 oaz.Environment.logEnv Client environment:java.vendor=Oracle Corporation
[junit4:junit4]   2> 135 T19 oaz.Environment.logEnv Client environment:java.home=/var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b82/jre
[junit4:junit4]   2> 135 T19 oaz.Environment.logEnv Client environment:java.class.path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/classes/test:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/test-framework/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/codecs/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/analysis/common/lucene-analyzers-common-5.0-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-5.0-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-5.0-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/codecs/lucene-codecs-5.0-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/highlighter/lucene-highlighter-5.0-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/memory/lucene-memory-5.0-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/misc/lucene-misc-5.0-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/spatial/lucene-spatial-5.0-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/suggest/lucene-suggest-5.0-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/grouping/lucene-grouping-5.0-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/queries/lucene-queries-5.0-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/queryparser/lucene-queryparser-5.0-SNAPSHOT.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/lib/cglib-nodep-2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/lib/commons-cli-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/lib/commons-codec-1.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/lib/commons-fileupload-1.2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/lib/commons-lang-2.6.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/lib/easymock-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/lib/guava-13.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/lib/javax.servlet-api-3.0.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/lib/objenesis-1.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/lib/org.restlet-2.1.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/lib/org.restlet.ext.servlet-2.1.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/lib/spatial4j-0.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/lib/commons-io-2.1.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/lib/httpclient-4.2.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/lib/httpcore-4.2.2.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/lib/httpmime-4.2.3.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/lib/noggit-0.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/lib/slf4j-api-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/lib/wstx-asl-3.2.7.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/lib/zookeeper-3.4.5.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/lib/servlet-api-3.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/core/classes/java:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/test-framework/lib/junit-4.10.jar:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/test-framework/lib/randomizedtesting-runner-2.0.8.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-launcher.jar:/var/lib/jenkins/.ant/lib/ivy-2.3.0.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jai.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-swing.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-oro.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jmf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-xalan2.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-javamail.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-resolver.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-testutil.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-logging.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-log4j.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jsch.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-net.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bsf.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jdepend.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-netrexx.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-regexp.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit4.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bcel.jar:/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-antlr.jar:/var/lib/jenkins/tools/java/32bit/jdk1.8.0-ea-b82/lib/tools.jar:/var/lib/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.8.jar
[junit4:junit4]   2> 136 T19 oaz.Environment.logEnv Client environment:java.library.path=/usr/java/packages/lib/i386:/lib:/usr/lib
[junit4:junit4]   2> 137 T19 oaz.Environment.logEnv Client environment:java.io.tmpdir=.
[junit4:junit4]   2> 137 T19 oaz.Environment.logEnv Client environment:java.compiler=<NA>
[junit4:junit4]   2> 137 T19 oaz.Environment.logEnv Client environment:os.name=Linux
[junit4:junit4]   2> 138 T19 oaz.Environment.logEnv Client environment:os.arch=i386
[junit4:junit4]   2> 141 T19 oaz.Environment.logEnv Client environment:os.version=3.2.0-39-generic
[junit4:junit4]   2> 141 T19 oaz.Environment.logEnv Client environment:user.name=jenkins
[junit4:junit4]   2> 142 T19 oaz.Environment.logEnv Client environment:user.home=/var/lib/jenkins
[junit4:junit4]   2> 142 T19 oaz.Environment.logEnv Client environment:user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 144 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56831 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1aedbca
[junit4:junit4]   2> 168 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 171 T25 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56831. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 172 T25 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56831, initiating session
[junit4:junit4]   2> 510 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38205
[junit4:junit4]   2> 524 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38205
[junit4:junit4]   2> 530 T23 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 585 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d969291fc0000 with negotiated timeout 10000 for client /127.0.0.1:38205
[junit4:junit4]   2> 585 T25 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56831, sessionid = 0x13d969291fc0000, negotiated timeout = 10000
[junit4:junit4]   2> 590 T26 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1aedbca name:ZooKeeperConnection Watcher:127.0.0.1:56831 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 591 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 593 T19 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 618 T24 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d969291fc0000
[junit4:junit4]   2> 619 T26 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 619 T19 oaz.ZooKeeper.close Session: 0x13d969291fc0000 closed
[junit4:junit4]   2> 620 T21 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:38205 which had sessionid 0x13d969291fc0000
[junit4:junit4]   2> 620 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56831/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ff647e
[junit4:junit4]   2> 621 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 622 T27 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56831. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 623 T27 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56831, initiating session
[junit4:junit4]   2> 623 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38206
[junit4:junit4]   2> 624 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38206
[junit4:junit4]   2> 625 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d969291fc0001 with negotiated timeout 10000 for client /127.0.0.1:38206
[junit4:junit4]   2> 625 T27 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56831, sessionid = 0x13d969291fc0001, negotiated timeout = 10000
[junit4:junit4]   2> 626 T28 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ff647e name:ZooKeeperConnection Watcher:127.0.0.1:56831/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 627 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 636 T19 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 644 T19 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 651 T19 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 657 T19 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 662 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 673 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 680 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 681 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 687 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 687 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 692 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 692 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 697 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 698 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 705 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 706 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 712 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 713 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 721 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 722 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 730 T19 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 731 T19 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 740 T24 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d969291fc0001
[junit4:junit4]   2> 741 T28 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 741 T21 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:38206 which had sessionid 0x13d969291fc0001
[junit4:junit4]   2> 741 T19 oaz.ZooKeeper.close Session: 0x13d969291fc0001 closed
[junit4:junit4]   2> 969 T19 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 1062 T19 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:40793
[junit4:junit4]   2> 1077 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 1077 T19 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1078 T19 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1364030821497
[junit4:junit4]   2> 1078 T19 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1364030821497/solr.xml
[junit4:junit4]   2> 1079 T19 oasc.CoreContainer.<init> New CoreContainer 31641155
[junit4:junit4]   2> 1080 T19 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1364030821497/'
[junit4:junit4]   2> 1080 T19 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1364030821497/'
[junit4:junit4]   2> 1131 T19 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 1132 T19 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 1133 T19 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 1133 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 1134 T19 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 1135 T19 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 1136 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 1137 T19 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 1137 T19 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 1159 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 1435 T19 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 1451 T19 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:56831/solr
[junit4:junit4]   2> 1460 T19 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 1461 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56831 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@109dad9
[junit4:junit4]   2> 1462 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1463 T39 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56831. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 1464 T39 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56831, initiating session
[junit4:junit4]   2> 1464 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38207
[junit4:junit4]   2> 1465 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38207
[junit4:junit4]   2> 1467 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d969291fc0002 with negotiated timeout 20000 for client /127.0.0.1:38207
[junit4:junit4]   2> 1467 T39 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56831, sessionid = 0x13d969291fc0002, negotiated timeout = 20000
[junit4:junit4]   2> 1467 T40 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@109dad9 name:ZooKeeperConnection Watcher:127.0.0.1:56831 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1468 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1470 T24 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d969291fc0002
[junit4:junit4]   2> 1471 T21 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:38207 which had sessionid 0x13d969291fc0002
[junit4:junit4]   2> 1471 T40 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 1471 T19 oaz.ZooKeeper.close Session: 0x13d969291fc0002 closed
[junit4:junit4]   2> 1473 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 1483 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56831/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@6afed0
[junit4:junit4]   2> 1485 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1485 T41 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56831. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 1486 T41 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56831, initiating session
[junit4:junit4]   2> 1486 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38208
[junit4:junit4]   2> 1486 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38208
[junit4:junit4]   2> 1487 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d969291fc0003 with negotiated timeout 20000 for client /127.0.0.1:38208
[junit4:junit4]   2> 1487 T41 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56831, sessionid = 0x13d969291fc0003, negotiated timeout = 20000
[junit4:junit4]   2> 1488 T42 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6afed0 name:ZooKeeperConnection Watcher:127.0.0.1:56831/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1489 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1504 T19 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4]   2> 1510 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc0003 type:create cxid:0x7 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1513 T19 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4]   2> 1523 T19 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 1526 T19 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40793_
[junit4:junit4]   2> 1530 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc0003 type:delete cxid:0x12 zxid:0x1e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:40793_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:40793_
[junit4:junit4]   2> 1531 T19 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40793_
[junit4:junit4]   2> 1536 T19 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 1635 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc0003 type:delete cxid:0x20 zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 1636 T19 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 1640 T19 oasc.Overseer.start Overseer (id=89393123875880963-127.0.0.1:40793_-n_0000000000) starting
[junit4:junit4]   2> 1641 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc0003 type:create cxid:0x25 zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1648 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc0003 type:create cxid:0x26 zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1651 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc0003 type:create cxid:0x28 zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1653 T19 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4]   2> 1661 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc0003 type:create cxid:0x2e zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1664 T44 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 1664 T19 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 1669 T19 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4]   2> 1673 T19 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 1684 T43 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 1707 T45 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1364030821497/collection1
[junit4:junit4]   2> 1708 T45 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 1710 T45 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 1711 T45 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 1718 T45 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1364030821497/collection1/'
[junit4:junit4]   2> 1719 T45 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1364030821497/collection1/lib/README' to classloader
[junit4:junit4]   2> 1719 T45 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1364030821497/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 1768 T45 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 1847 T45 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1849 T45 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 1885 T45 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 2348 T45 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 2358 T45 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 2361 T45 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 2390 T45 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2396 T45 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 2401 T45 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2403 T45 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 2403 T45 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 2404 T45 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 2406 T45 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 2406 T45 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 2407 T45 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 2407 T45 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1364030821497/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/control/data/
[junit4:junit4]   2> 2408 T45 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@150274
[junit4:junit4]   2> 2409 T45 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 2410 T45 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/control/data
[junit4:junit4]   2> 2410 T45 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/control/data/index/
[junit4:junit4]   2> 2410 T45 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 2411 T45 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/control/data/index
[junit4:junit4]   2> 2413 T45 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@17e0e5d lockFactory=org.apache.lucene.store.NativeFSLockFactory@54b93f)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 2413 T45 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 2424 T45 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 2425 T45 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 2425 T45 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 2426 T45 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 2427 T45 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 2427 T45 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 2427 T45 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 2428 T45 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 2428 T45 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 2431 T45 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 2436 T45 oass.SolrIndexSearcher.<init> Opening Searcher@72307e main
[junit4:junit4]   2> 2440 T45 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/control/data/tlog
[junit4:junit4]   2> 2447 T45 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 2447 T45 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 2455 T46 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@72307e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 2459 T45 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 2459 T45 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3193 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3195 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:40793",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:40793_",
[junit4:junit4]   2> 	  "core_node_name":"1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "shard":null}
[junit4:junit4]   2> 3195 T43 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 3206 T43 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 3218 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 3462 T45 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 3462 T45 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40793 collection:control_collection shard:shard1
[junit4:junit4]   2> 3468 T45 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 3478 T45 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 3489 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc0003 type:delete cxid:0x82 zxid:0x35 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 3489 T45 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 3490 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc0003 type:create cxid:0x83 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3493 T45 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 3494 T45 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 3496 T45 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40793/collection1/
[junit4:junit4]   2> 3496 T45 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 3496 T45 oasc.SyncStrategy.syncToMe http://127.0.0.1:40793/collection1/ has no replicas
[junit4:junit4]   2> 3497 T45 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40793/collection1/
[junit4:junit4]   2> 3497 T45 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 3503 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc0003 type:create cxid:0x8e zxid:0x3a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4725 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4793 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 4809 T45 oasc.ZkController.register We are http://127.0.0.1:40793/collection1/ and leader is http://127.0.0.1:40793/collection1/
[junit4:junit4]   2> 4811 T45 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40793
[junit4:junit4]   2> 4811 T45 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 4811 T45 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 4811 T45 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4814 T45 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4816 T19 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 4817 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 4832 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 4838 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 4840 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56831/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@c6066c
[junit4:junit4]   2> 4841 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4841 T48 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56831. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 4842 T48 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56831, initiating session
[junit4:junit4]   2> 4842 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38212
[junit4:junit4]   2> 4842 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38212
[junit4:junit4]   2> 4843 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d969291fc0004 with negotiated timeout 10000 for client /127.0.0.1:38212
[junit4:junit4]   2> 4843 T48 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56831, sessionid = 0x13d969291fc0004, negotiated timeout = 10000
[junit4:junit4]   2> 4844 T49 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c6066c name:ZooKeeperConnection Watcher:127.0.0.1:56831/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4844 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4846 T19 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4851 T19 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 4914 T19 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 4916 T19 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50808
[junit4:junit4]   2> 4917 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 4917 T19 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4918 T19 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1364030825605
[junit4:junit4]   2> 4918 T19 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1364030825605/solr.xml
[junit4:junit4]   2> 4919 T19 oasc.CoreContainer.<init> New CoreContainer 412172
[junit4:junit4]   2> 4919 T19 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1364030825605/'
[junit4:junit4]   2> 4919 T19 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1364030825605/'
[junit4:junit4]   2> 4940 T19 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 4940 T19 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 4941 T19 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 4941 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 4941 T19 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 4942 T19 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 4942 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 4943 T19 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 4943 T19 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 4943 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 4951 T19 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 4965 T19 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:56831/solr
[junit4:junit4]   2> 4966 T19 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 4966 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56831 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@db0f6a
[junit4:junit4]   2> 4968 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4968 T59 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56831. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 4969 T59 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56831, initiating session
[junit4:junit4]   2> 4969 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38213
[junit4:junit4]   2> 4970 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38213
[junit4:junit4]   2> 4971 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d969291fc0005 with negotiated timeout 20000 for client /127.0.0.1:38213
[junit4:junit4]   2> 4971 T59 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56831, sessionid = 0x13d969291fc0005, negotiated timeout = 20000
[junit4:junit4]   2> 4971 T60 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@db0f6a name:ZooKeeperConnection Watcher:127.0.0.1:56831 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4971 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4973 T24 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d969291fc0005
[junit4:junit4]   2> 4974 T60 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4974 T19 oaz.ZooKeeper.close Session: 0x13d969291fc0005 closed
[junit4:junit4]   2> 4974 T21 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:38213 which had sessionid 0x13d969291fc0005
[junit4:junit4]   2> 4975 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 4978 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56831/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1219972
[junit4:junit4]   2> 4979 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4979 T61 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56831. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 4980 T61 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56831, initiating session
[junit4:junit4]   2> 4980 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38214
[junit4:junit4]   2> 4981 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38214
[junit4:junit4]   2> 4982 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d969291fc0006 with negotiated timeout 20000 for client /127.0.0.1:38214
[junit4:junit4]   2> 4982 T61 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56831, sessionid = 0x13d969291fc0006, negotiated timeout = 20000
[junit4:junit4]   2> 4983 T62 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1219972 name:ZooKeeperConnection Watcher:127.0.0.1:56831/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4983 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4984 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc0006 type:create cxid:0x1 zxid:0x48 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4986 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc0006 type:create cxid:0x3 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4989 T19 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 5993 T19 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50808_
[junit4:junit4]   2> 5994 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc0006 type:delete cxid:0xd zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:50808_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:50808_
[junit4:junit4]   2> 5996 T19 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50808_
[junit4:junit4]   2> 6000 T49 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 6000 T62 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 6001 T42 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 6001 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6010 T63 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1364030825605/collection1
[junit4:junit4]   2> 6011 T63 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 6012 T63 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 6012 T63 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 6014 T63 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1364030825605/collection1/'
[junit4:junit4]   2> 6014 T63 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1364030825605/collection1/lib/README' to classloader
[junit4:junit4]   2> 6015 T63 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1364030825605/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 6048 T63 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 6087 T63 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 6089 T63 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 6118 T63 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 6302 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6303 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:40793",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:40793_",
[junit4:junit4]   2> 	  "core_node_name":"1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "shard":"shard1"}
[junit4:junit4]   2> 6309 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6309 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6309 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6507 T63 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 6517 T63 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 6522 T63 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 6548 T63 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6553 T63 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 6557 T63 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6558 T63 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 6559 T63 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 6559 T63 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 6561 T63 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 6561 T63 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 6561 T63 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 6562 T63 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1364030825605/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/jetty1/
[junit4:junit4]   2> 6562 T63 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@150274
[junit4:junit4]   2> 6562 T63 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 6563 T63 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/jetty1
[junit4:junit4]   2> 6563 T63 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/jetty1/index/
[junit4:junit4]   2> 6563 T63 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 6564 T63 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/jetty1/index
[junit4:junit4]   2> 6565 T63 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1373fda lockFactory=org.apache.lucene.store.NativeFSLockFactory@124d304)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 6566 T63 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 6568 T63 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 6568 T63 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 6570 T63 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 6571 T63 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 6571 T63 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 6572 T63 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 6572 T63 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 6573 T63 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 6573 T63 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 6576 T63 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 6579 T63 oass.SolrIndexSearcher.<init> Opening Searcher@c51a60 main
[junit4:junit4]   2> 6579 T63 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/jetty1/tlog
[junit4:junit4]   2> 6580 T63 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 6580 T63 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 6589 T64 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c51a60 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 6594 T63 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 6594 T63 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7817 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7820 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50808",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50808_",
[junit4:junit4]   2> 	  "core_node_name":"2",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "shard":null}
[junit4:junit4]   2> 7821 T43 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 7822 T43 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 7885 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7885 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7885 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8598 T63 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 8599 T63 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50808 collection:collection1 shard:shard1
[junit4:junit4]   2> 8600 T63 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 8611 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc0006 type:delete cxid:0x4a zxid:0x5a txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 8612 T63 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 8612 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc0006 type:create cxid:0x4b zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8616 T63 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 8616 T63 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 8616 T63 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50808/collection1/
[junit4:junit4]   2> 8616 T63 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 8617 T63 oasc.SyncStrategy.syncToMe http://127.0.0.1:50808/collection1/ has no replicas
[junit4:junit4]   2> 8617 T63 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50808/collection1/
[junit4:junit4]   2> 8617 T63 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 8623 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc0006 type:create cxid:0x56 zxid:0x5f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9395 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9416 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9416 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9416 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9429 T63 oasc.ZkController.register We are http://127.0.0.1:50808/collection1/ and leader is http://127.0.0.1:50808/collection1/
[junit4:junit4]   2> 9429 T63 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50808
[junit4:junit4]   2> 9430 T63 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 9430 T63 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 9431 T63 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9435 T63 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9438 T19 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 9439 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 9440 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9511 T19 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 9513 T19 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:41861
[junit4:junit4]   2> 9514 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 9514 T19 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 9515 T19 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1364030830202
[junit4:junit4]   2> 9515 T19 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1364030830202/solr.xml
[junit4:junit4]   2> 9516 T19 oasc.CoreContainer.<init> New CoreContainer 5665360
[junit4:junit4]   2> 9516 T19 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1364030830202/'
[junit4:junit4]   2> 9516 T19 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1364030830202/'
[junit4:junit4]   2> 9541 T19 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 9542 T19 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 9542 T19 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 9543 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 9543 T19 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 9543 T19 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 9544 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 9544 T19 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 9544 T19 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 9545 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 9552 T19 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 9563 T19 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:56831/solr
[junit4:junit4]   2> 9564 T19 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 9564 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56831 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@636b44
[junit4:junit4]   2> 9566 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 9566 T75 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56831. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 9567 T75 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56831, initiating session
[junit4:junit4]   2> 9567 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38215
[junit4:junit4]   2> 9567 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38215
[junit4:junit4]   2> 9568 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d969291fc0007 with negotiated timeout 20000 for client /127.0.0.1:38215
[junit4:junit4]   2> 9568 T75 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56831, sessionid = 0x13d969291fc0007, negotiated timeout = 20000
[junit4:junit4]   2> 9569 T76 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@636b44 name:ZooKeeperConnection Watcher:127.0.0.1:56831 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 9569 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 9571 T24 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d969291fc0007
[junit4:junit4]   2> 9572 T76 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 9572 T19 oaz.ZooKeeper.close Session: 0x13d969291fc0007 closed
[junit4:junit4]   2> 9572 T21 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:38215 which had sessionid 0x13d969291fc0007
[junit4:junit4]   2> 9573 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 9577 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56831/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@325391
[junit4:junit4]   2> 9578 T77 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56831. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 9578 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 9578 T77 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56831, initiating session
[junit4:junit4]   2> 9578 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38216
[junit4:junit4]   2> 9579 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38216
[junit4:junit4]   2> 9580 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d969291fc0008 with negotiated timeout 20000 for client /127.0.0.1:38216
[junit4:junit4]   2> 9580 T77 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56831, sessionid = 0x13d969291fc0008, negotiated timeout = 20000
[junit4:junit4]   2> 9581 T78 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@325391 name:ZooKeeperConnection Watcher:127.0.0.1:56831/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 9581 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 9582 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc0008 type:create cxid:0x1 zxid:0x6c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9584 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc0008 type:create cxid:0x3 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9587 T19 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 10593 T19 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41861_
[junit4:junit4]   2> 10594 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc0008 type:delete cxid:0xd zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:41861_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:41861_
[junit4:junit4]   2> 10596 T19 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41861_
[junit4:junit4]   2> 10601 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 10601 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 10603 T42 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 10604 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10604 T78 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 10608 T49 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 10608 T62 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 10618 T79 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1364030830202/collection1
[junit4:junit4]   2> 10618 T79 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 10620 T79 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 10621 T79 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 10624 T79 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1364030830202/collection1/'
[junit4:junit4]   2> 10625 T79 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1364030830202/collection1/lib/README' to classloader
[junit4:junit4]   2> 10626 T79 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1364030830202/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 10670 T79 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 10714 T79 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 10716 T79 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 10738 T79 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 10930 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10932 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50808",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50808_",
[junit4:junit4]   2> 	  "core_node_name":"2",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "shard":"shard1"}
[junit4:junit4]   2> 10950 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10950 T78 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10950 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10950 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11167 T79 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 11177 T79 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 11180 T79 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 11213 T79 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 11219 T79 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 11223 T79 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 11224 T79 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 11225 T79 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 11225 T79 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 11227 T79 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 11227 T79 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 11227 T79 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 11227 T79 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1364030830202/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/jetty2/
[junit4:junit4]   2> 11228 T79 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@150274
[junit4:junit4]   2> 11228 T79 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 11229 T79 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/jetty2
[junit4:junit4]   2> 11229 T79 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/jetty2/index/
[junit4:junit4]   2> 11229 T79 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 11230 T79 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/jetty2/index
[junit4:junit4]   2> 11231 T79 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@f27f5d lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ea7c6e)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 11232 T79 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 11234 T79 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 11234 T79 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 11235 T79 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 11236 T79 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 11237 T79 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 11237 T79 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 11238 T79 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 11238 T79 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 11239 T79 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 11241 T79 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 11244 T79 oass.SolrIndexSearcher.<init> Opening Searcher@fdda71 main
[junit4:junit4]   2> 11244 T79 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/jetty2/tlog
[junit4:junit4]   2> 11245 T79 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 11245 T79 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 11254 T80 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@fdda71 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 11258 T79 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 11258 T79 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 12460 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12463 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:41861",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:41861_",
[junit4:junit4]   2> 	  "core_node_name":"3",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "shard":null}
[junit4:junit4]   2> 12464 T43 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 12464 T43 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 12565 T78 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12565 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12565 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12566 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 13293 T79 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 13293 T79 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:41861 collection:collection1 shard:shard2
[junit4:junit4]   2> 13295 T79 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 13310 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc0008 type:delete cxid:0x49 zxid:0x7d txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 13312 T79 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 13313 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc0008 type:create cxid:0x4a zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 13319 T79 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 13320 T79 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 13320 T79 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:41861/collection1/
[junit4:junit4]   2> 13321 T79 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 13321 T79 oasc.SyncStrategy.syncToMe http://127.0.0.1:41861/collection1/ has no replicas
[junit4:junit4]   2> 13322 T79 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:41861/collection1/
[junit4:junit4]   2> 13322 T79 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 13331 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc0008 type:create cxid:0x54 zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 14079 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14101 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 14101 T78 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 14101 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 14101 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 14140 T79 oasc.ZkController.register We are http://127.0.0.1:41861/collection1/ and leader is http://127.0.0.1:41861/collection1/
[junit4:junit4]   2> 14141 T79 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:41861
[junit4:junit4]   2> 14141 T79 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 14142 T79 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 14142 T79 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 14146 T79 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14149 T19 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 14150 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 14151 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 14218 T19 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 14220 T19 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:34188
[junit4:junit4]   2> 14221 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 14222 T19 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 14222 T19 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1364030834913
[junit4:junit4]   2> 14222 T19 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1364030834913/solr.xml
[junit4:junit4]   2> 14223 T19 oasc.CoreContainer.<init> New CoreContainer 28833865
[junit4:junit4]   2> 14223 T19 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1364030834913/'
[junit4:junit4]   2> 14223 T19 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1364030834913/'
[junit4:junit4]   2> 14243 T19 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 14243 T19 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 14244 T19 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 14244 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 14245 T19 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 14246 T19 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 14246 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 14247 T19 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 14247 T19 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 14248 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 14256 T19 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 14266 T19 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:56831/solr
[junit4:junit4]   2> 14267 T19 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 14267 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56831 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@91febf
[junit4:junit4]   2> 14268 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 14268 T91 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56831. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 14269 T91 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56831, initiating session
[junit4:junit4]   2> 14269 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38218
[junit4:junit4]   2> 14270 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38218
[junit4:junit4]   2> 14271 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d969291fc0009 with negotiated timeout 20000 for client /127.0.0.1:38218
[junit4:junit4]   2> 14271 T91 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56831, sessionid = 0x13d969291fc0009, negotiated timeout = 20000
[junit4:junit4]   2> 14271 T92 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@91febf name:ZooKeeperConnection Watcher:127.0.0.1:56831 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 14272 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 14274 T24 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d969291fc0009
[junit4:junit4]   2> 14276 T92 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 14276 T21 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:38218 which had sessionid 0x13d969291fc0009
[junit4:junit4]   2> 14276 T19 oaz.ZooKeeper.close Session: 0x13d969291fc0009 closed
[junit4:junit4]   2> 14277 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 14280 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56831/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ed7e70
[junit4:junit4]   2> 14281 T93 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56831. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 14281 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 14281 T93 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56831, initiating session
[junit4:junit4]   2> 14282 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38219
[junit4:junit4]   2> 14283 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38219
[junit4:junit4]   2> 14284 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d969291fc000a with negotiated timeout 20000 for client /127.0.0.1:38219
[junit4:junit4]   2> 14284 T93 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56831, sessionid = 0x13d969291fc000a, negotiated timeout = 20000
[junit4:junit4]   2> 14284 T94 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ed7e70 name:ZooKeeperConnection Watcher:127.0.0.1:56831/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 14285 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 14286 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc000a type:create cxid:0x1 zxid:0x8e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 14288 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc000a type:create cxid:0x3 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 14293 T19 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 15301 T19 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34188_
[junit4:junit4]   2> 15302 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc000a type:delete cxid:0xd zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:34188_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:34188_
[junit4:junit4]   2> 15304 T19 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34188_
[junit4:junit4]   2> 15309 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 15309 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 15310 T78 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 15310 T42 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 15310 T94 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 15310 T78 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15311 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15313 T62 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 15313 T49 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 15327 T95 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1364030834913/collection1
[junit4:junit4]   2> 15328 T95 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 15330 T95 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 15330 T95 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 15334 T95 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1364030834913/collection1/'
[junit4:junit4]   2> 15335 T95 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1364030834913/collection1/lib/README' to classloader
[junit4:junit4]   2> 15336 T95 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1364030834913/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 15373 T95 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 15407 T95 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 15409 T95 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 15423 T95 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 15617 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15618 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:41861",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:41861_",
[junit4:junit4]   2> 	  "core_node_name":"3",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "shard":"shard2"}
[junit4:junit4]   2> 15624 T78 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15625 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15624 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15625 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15624 T94 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 15799 T95 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 15808 T95 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 15810 T95 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 15844 T95 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15849 T95 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15853 T95 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15856 T95 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 15857 T95 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 15857 T95 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15860 T95 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 15861 T95 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 15861 T95 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 15862 T95 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1364030834913/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/jetty3/
[junit4:junit4]   2> 15862 T95 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@150274
[junit4:junit4]   2> 15864 T95 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 15865 T95 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/jetty3
[junit4:junit4]   2> 15865 T95 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/jetty3/index/
[junit4:junit4]   2> 15866 T95 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 15866 T95 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/jetty3/index
[junit4:junit4]   2> 15869 T95 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1bd9839 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1d4256e)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 15870 T95 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 15875 T95 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 15875 T95 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 15876 T95 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 15878 T95 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 15880 T95 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 15880 T95 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 15881 T95 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 15883 T95 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 15884 T95 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 15888 T95 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 15893 T95 oass.SolrIndexSearcher.<init> Opening Searcher@1185d9 main
[junit4:junit4]   2> 15894 T95 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/jetty3/tlog
[junit4:junit4]   2> 15894 T95 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 15894 T95 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 15905 T96 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1185d9 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 15913 T95 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 15913 T95 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 17134 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17137 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:34188",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:34188_",
[junit4:junit4]   2> 	  "core_node_name":"4",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "shard":null}
[junit4:junit4]   2> 17137 T43 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 17138 T43 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 17152 T94 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17152 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17152 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17152 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17152 T78 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 17916 T95 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 17917 T95 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:34188 collection:collection1 shard:shard1
[junit4:junit4]   2> 17925 T95 oasc.ZkController.register We are http://127.0.0.1:34188/collection1/ and leader is http://127.0.0.1:50808/collection1/
[junit4:junit4]   2> 17925 T95 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:34188
[junit4:junit4]   2> 17926 T95 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 17926 T95 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C1 name=collection1 org.apache.solr.core.SolrCore@c0b379 url=http://127.0.0.1:34188/collection1 node=127.0.0.1:34188_ C1_STATE=coll:collection1 core:collection1 props:{state=down, collection=collection1, core=collection1, base_url=http://127.0.0.1:34188, node_name=127.0.0.1:34188_}
[junit4:junit4]   2> 17933 T97 C1 P34188 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 17935 T97 C1 P34188 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 17935 T95 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17935 T97 C1 P34188 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 17936 T97 C1 P34188 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 17938 T19 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 17938 T97 C1 P34188 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 17939 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 17940 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 18023 T19 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 18025 T19 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:41291
[junit4:junit4]   2> 18025 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 18026 T19 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 18026 T19 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1364030838707
[junit4:junit4]   2> 18027 T19 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1364030838707/solr.xml
[junit4:junit4]   2> 18027 T19 oasc.CoreContainer.<init> New CoreContainer 23381670
[junit4:junit4]   2> 18027 T19 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1364030838707/'
[junit4:junit4]   2> 18028 T19 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1364030838707/'
[junit4:junit4]   2> 18045 T19 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 18046 T19 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 18046 T19 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 18047 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 18047 T19 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 18047 T19 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 18048 T19 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 18048 T19 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 18048 T19 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 18049 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 18055 T19 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 18070 T19 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:56831/solr
[junit4:junit4]   2> 18071 T19 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 18071 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56831 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1349558
[junit4:junit4]   2> 18072 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 18072 T108 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56831. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 18073 T108 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56831, initiating session
[junit4:junit4]   2> 18073 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38220
[junit4:junit4]   2> 18074 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38220
[junit4:junit4]   2> 18075 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d969291fc000b with negotiated timeout 20000 for client /127.0.0.1:38220
[junit4:junit4]   2> 18075 T108 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56831, sessionid = 0x13d969291fc000b, negotiated timeout = 20000
[junit4:junit4]   2> 18076 T109 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1349558 name:ZooKeeperConnection Watcher:127.0.0.1:56831 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 18076 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 18078 T24 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d969291fc000b
[junit4:junit4]   2> 18079 T109 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 18079 T21 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:38220 which had sessionid 0x13d969291fc000b
[junit4:junit4]   2> 18079 T19 oaz.ZooKeeper.close Session: 0x13d969291fc000b closed
[junit4:junit4]   2> 18080 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 18084 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56831/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ca0085
[junit4:junit4]   2> 18085 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 18085 T110 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56831. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 18086 T110 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56831, initiating session
[junit4:junit4]   2> 18086 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38221
[junit4:junit4]   2> 18087 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38221
[junit4:junit4]   2> 18088 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d969291fc000c with negotiated timeout 20000 for client /127.0.0.1:38221
[junit4:junit4]   2> 18088 T110 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56831, sessionid = 0x13d969291fc000c, negotiated timeout = 20000
[junit4:junit4]   2> 18088 T111 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ca0085 name:ZooKeeperConnection Watcher:127.0.0.1:56831/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 18088 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 18090 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc000c type:create cxid:0x1 zxid:0xa1 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 18092 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc000c type:create cxid:0x3 zxid:0xa2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 18095 T19 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 18661 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 18663 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:34188",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:34188_",
[junit4:junit4]   2> 	  "core_node_name":"4",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "shard":"shard1"}
[junit4:junit4]   2> 18678 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 18678 T94 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 18679 T111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 18678 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 18678 T78 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 18678 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19101 T19 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41291_
[junit4:junit4]   2> 19102 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc000c type:delete cxid:0xf zxid:0xa7 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:41291_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:41291_
[junit4:junit4]   2> 19105 T19 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41291_
[junit4:junit4]   2> 19108 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19109 T78 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19109 T94 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 19108 T111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19109 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19109 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19110 T94 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 19112 T49 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 19113 T78 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 19115 T42 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 19115 T62 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 19115 T111 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 19120 T112 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1364030838707/collection1
[junit4:junit4]   2> 19120 T112 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 19121 T112 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 19122 T112 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 19123 T112 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1364030838707/collection1/'
[junit4:junit4]   2> 19124 T112 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1364030838707/collection1/lib/README' to classloader
[junit4:junit4]   2> 19125 T112 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1364030838707/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 19159 T112 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 19200 T56 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {state=recovering&onlyIfLeader=true&version=2&nodeName=127.0.0.1:34188_&wt=javabin&core=collection1&coreNodeName=4&checkLive=true&action=PREPRECOVERY} status=0 QTime=1001 
[junit4:junit4]   2> 19207 T112 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 19208 T112 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 19223 T112 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 19664 T112 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 19673 T112 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 19676 T112 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 19702 T112 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 19707 T112 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 19712 T112 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 19715 T112 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 19715 T112 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 19716 T112 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 19717 T112 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 19718 T112 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 19718 T112 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 19718 T112 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1364030838707/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/jetty4/
[junit4:junit4]   2> 19718 T112 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@150274
[junit4:junit4]   2> 19719 T112 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 19720 T112 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/jetty4
[junit4:junit4]   2> 19720 T112 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/jetty4/index/
[junit4:junit4]   2> 19720 T112 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 19720 T112 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/jetty4/index
[junit4:junit4]   2> 19722 T112 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@37b47a lockFactory=org.apache.lucene.store.NativeFSLockFactory@20354d)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 19722 T112 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 19724 T112 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 19725 T112 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 19725 T112 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 19726 T112 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 19727 T112 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 19727 T112 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 19727 T112 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 19728 T112 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 19729 T112 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 19731 T112 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 19733 T112 oass.SolrIndexSearcher.<init> Opening Searcher@1e812cd main
[junit4:junit4]   2> 19734 T112 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/jetty4/tlog
[junit4:junit4]   2> 19734 T112 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 19734 T112 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 19745 T113 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1e812cd main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 19749 T112 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 19749 T112 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 20186 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 20188 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:41291",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:41291_",
[junit4:junit4]   2> 	  "core_node_name":"5",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "shard":null}
[junit4:junit4]   2> 20188 T43 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 20189 T43 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 20196 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20197 T78 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20197 T111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20197 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20197 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20197 T94 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20751 T112 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 20751 T112 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:41291 collection:collection1 shard:shard2
[junit4:junit4]   2> 20759 T112 oasc.ZkController.register We are http://127.0.0.1:41291/collection1/ and leader is http://127.0.0.1:41861/collection1/
[junit4:junit4]   2> 20760 T112 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:41291
[junit4:junit4]   2> 20760 T112 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 20760 T112 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C2 name=collection1 org.apache.solr.core.SolrCore@e16fe9 url=http://127.0.0.1:41291/collection1 node=127.0.0.1:41291_ C2_STATE=coll:collection1 core:collection1 props:{state=down, collection=collection1, core=collection1, base_url=http://127.0.0.1:41291, node_name=127.0.0.1:41291_}
[junit4:junit4]   2> 20762 T114 C2 P41291 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 20763 T114 C2 P41291 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 20763 T112 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 20763 T114 C2 P41291 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 20764 T114 C2 P41291 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 20766 T19 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4]   2> 20767 T114 C2 P41291 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 20767 T19 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 20769 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 20777 T19 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 20781 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 20793 T56 oasc.CoreContainer.create Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1364030825605/onenodecollectioncore
[junit4:junit4]   2> 20794 T56 oasc.ZkController.createCollectionZkNode Check for collection zkNode:onenodecollection
[junit4:junit4]   2> 20795 T56 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:onenodecollection
[junit4:junit4]   2> 20796 T56 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4]   2> 20799 T56 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4]   2> 20800 T56 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection
[junit4:junit4]   2> 20806 T56 oasc.ZkController.readConfigName Load collection config from:/collections/onenodecollection
[junit4:junit4]   2> 20810 T56 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1364030825605/onenodecollectioncore/'
[junit4:junit4]   2> 20865 T56 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 20912 T56 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 20914 T56 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 20926 T56 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2>  C1_STATE=coll:collection1 core:collection1 props:{state=recovering, collection=collection1, core=collection1, base_url=http://127.0.0.1:34188, node_name=127.0.0.1:34188_, shard=shard1}
[junit4:junit4]   2> 21243 T97 C1 P34188 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:50808/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 21248 T97 C1 P34188 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 21255 T97 C1 P34188 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:34188 START replicas=[http://127.0.0.1:50808/collection1/] nUpdates=100
[junit4:junit4]   2> 21259 T97 C1 P34188 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 21259 T97 C1 P34188 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 21260 T97 C1 P34188 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 21260 T97 C1 P34188 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 21260 T97 C1 P34188 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 21261 T97 C1 P34188 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:50808/collection1/. core=collection1
[junit4:junit4]   2> 21261 T97 C1 P34188 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C3 name=collection1 org.apache.solr.core.SolrCore@1588bd1 url=http://127.0.0.1:50808/collection1 node=127.0.0.1:50808_ C3_STATE=coll:collection1 core:collection1 props:{state=active, collection=collection1, core=collection1, base_url=http://127.0.0.1:50808, node_name=127.0.0.1:50808_, shard=shard1, leader=true}
[junit4:junit4]   2> 21282 T58 C3 P50808 REQ /get {distrib=false&version=2&wt=javabin&getVersions=100&qt=/get} status=0 QTime=2 
[junit4:junit4]   2> 21288 T57 C3 P50808 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 21291 T57 C3 P50808 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1373fda lockFactory=org.apache.lucene.store.NativeFSLockFactory@124d304)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 21291 T57 C3 P50808 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 21292 T57 C3 P50808 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1373fda lockFactory=org.apache.lucene.store.NativeFSLockFactory@124d304)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1373fda lockFactory=org.apache.lucene.store.NativeFSLockFactory@124d304)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 21293 T57 C3 P50808 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 21294 T57 C3 P50808 oass.SolrIndexSearcher.<init> Opening Searcher@9827cc realtime
[junit4:junit4]   2> 21294 T57 C3 P50808 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 21295 T57 C3 P50808 /update {version=2&waitSearcher=true&commit=true&wt=javabin&softCommit=false&openSearcher=false&commit_end_point=true} {commit=} 0 13
[junit4:junit4]   2> 21317 T97 C1 P34188 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 21318 T97 C1 P34188 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 21323 T97 C1 P34188 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 21336 T56 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 21345 T56 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 21347 T57 C3 P50808 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 21347 T56 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 21347 T57 C3 P50808 REQ /replication {version=2&wt=javabin&command=indexversion&qt=/replication} status=0 QTime=22 
[junit4:junit4]   2> 21349 T97 C1 P34188 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 21349 T97 C1 P34188 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 21349 T97 C1 P34188 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 21353 T55 C3 P50808 REQ /replication {version=2&wt=javabin&generation=2&command=filelist&qt=/replication} status=0 QTime=1 
[junit4:junit4]   2> 21354 T97 C1 P34188 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 21355 T97 C1 P34188 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/jetty3/index.20130323182722108
[junit4:junit4]   2> 21355 T97 C1 P34188 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@7cbbd1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@10a7c7d) fullCopy=false
[junit4:junit4]   2> 21363 T58 C3 P50808 REQ /replication {checksum=true&wt=filestream&generation=2&command=filecontent&qt=/replication&file=segments_2} status=0 QTime=2 
[junit4:junit4]   2> 21368 T97 C1 P34188 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 21372 T56 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 21379 T56 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 21379 T97 C1 P34188 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 21380 T97 C1 P34188 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 21386 T97 C1 P34188 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1bd9839 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1d4256e)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1bd9839 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1d4256e)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 21387 T97 C1 P34188 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 21387 T97 C1 P34188 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 21388 T97 C1 P34188 oass.SolrIndexSearcher.<init> Opening Searcher@1a6f141 main
[junit4:junit4]   2> 21388 T56 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 21390 T96 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1a6f141 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 21390 T56 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 21390 T56 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 21391 T97 C1 P34188 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 21391 T56 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 21391 T97 C1 P34188 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 21392 T97 C1 P34188 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 21392 T97 C1 P34188 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 21393 T56 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 21393 T56 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 21394 T56 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 21394 T97 C1 P34188 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 21394 T56 oasc.SolrCore.<init> [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1364030825605/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1364030820762/onenodecollection/
[junit4:junit4]   2> 21396 T56 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@150274
[junit4:junit4]   2> 21397 T56 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 21398 T56 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1364030820762/onenodecollection
[junit4:junit4]   2> 21398 T56 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1364030820762/onenodecollection/index/
[junit4:junit4]   2> 21398 T56 oasc.SolrCore.initIndex WARNING [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1364030820762/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 21399 T56 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1364030820762/onenodecollection/index
[junit4:junit4]   2> 21401 T56 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@159bc60 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6846a3)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 21401 T56 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 21404 T56 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 21404 T56 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 21405 T56 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 21406 T56 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 21406 T56 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 21407 T56 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 21407 T56 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 21408 T56 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 21409 T56 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 21411 T56 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 21414 T56 oass.SolrIndexSearcher.<init> Opening Searcher@1192da5 main
[junit4:junit4]   2> 21414 T56 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1364030820762/onenodecollection/tlog
[junit4:junit4]   2> 21415 T56 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 21415 T56 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 21421 T118 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@1192da5 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 21424 T56 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4]   2> 21706 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 21709 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:41291",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:41291_",
[junit4:junit4]   2> 	  "core_node_name":"5",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "shard":"shard2"}
[junit4:junit4]   2> 21717 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:34188",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:34188_",
[junit4:junit4]   2> 	  "core_node_name":"4",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "shard":"shard1"}
[junit4:junit4]   2> 21726 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "collection":"onenodecollection",
[junit4:junit4]   2> 	  "core":"onenodecollectioncore",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "roles":"none",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50808",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50808_",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "shard":null}
[junit4:junit4]   2> 21726 T43 oasc.Overseer$ClusterStateUpdater.createCollection Create collection onenodecollection with numShards 1
[junit4:junit4]   2> 21727 T43 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 21736 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21736 T94 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21736 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21737 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21737 T111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21736 T78 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 21779 T72 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {state=recovering&onlyIfLeader=true&version=2&nodeName=127.0.0.1:41291_&wt=javabin&core=collection1&coreNodeName=5&checkLive=true&action=PREPRECOVERY} status=0 QTime=1000 
[junit4:junit4]   2> 22429 T56 oasc.CoreContainer.registerCore registering core: onenodecollectioncore
[junit4:junit4]   2> 22430 T56 oasc.ZkController.register Register replica - core:onenodecollectioncore address:http://127.0.0.1:50808 collection:onenodecollection shard:shard1
[junit4:junit4]   2> 22432 T56 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4]   2> 22447 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc0006 type:delete cxid:0xac zxid:0xc2 txntype:-1 reqpath:n/a Error Path:/solr/collections/onenodecollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/onenodecollection/leaders
[junit4:junit4]   2> 22448 T56 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 22449 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc0006 type:create cxid:0xad zxid:0xc3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 22454 T56 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 22454 T56 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 22455 T56 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50808/onenodecollectioncore/
[junit4:junit4]   2> 22456 T56 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 22456 T56 oasc.SyncStrategy.syncToMe http://127.0.0.1:50808/onenodecollectioncore/ has no replicas
[junit4:junit4]   2> 22457 T56 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50808/onenodecollectioncore/
[junit4:junit4]   2> 22458 T56 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4]   2> 22467 T24 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d969291fc0006 type:create cxid:0xb8 zxid:0xc7 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 23263 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 23284 T78 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23285 T94 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23285 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23285 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23285 T111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23285 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23325 T56 oasc.ZkController.register We are http://127.0.0.1:50808/onenodecollectioncore/ and leader is http://127.0.0.1:50808/onenodecollectioncore/
[junit4:junit4]   2> 23326 T56 oasc.ZkController.register No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:50808
[junit4:junit4]   2> 23327 T56 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 23327 T56 oasc.ZkController.publish publishing core=onenodecollectioncore state=active
[junit4:junit4]   2> 23331 T56 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 23333 T56 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {collection=onenodecollection&dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1364030820762/onenodecollection&version=2&name=onenodecollectioncore&wt=javabin&roles=none&numShards=1&action=CREATE} status=0 QTime=2541 
[junit4:junit4]   2> 23334 T19 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4]   2> 23335 T19 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C2_STATE=coll:collection1 core:collection1 props:{state=recovering, collection=collection1, core=collection1, base_url=http://127.0.0.1:41291, node_name=127.0.0.1:41291_, shard=shard2}
[junit4:junit4]   2> 23781 T114 C2 P41291 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:41861/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 23781 T114 C2 P41291 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:41291 START replicas=[http://127.0.0.1:41861/collection1/] nUpdates=100
[junit4:junit4]   2> 23782 T114 C2 P41291 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 23783 T114 C2 P41291 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 23783 T114 C2 P41291 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 23783 T114 C2 P41291 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 23784 T114 C2 P41291 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 23784 T114 C2 P41291 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:41861/collection1/. core=collection1
[junit4:junit4]   2> 23785 T114 C2 P41291 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C4 name=collection1 org.apache.solr.core.SolrCore@51cca4 url=http://127.0.0.1:41861/collection1 node=127.0.0.1:41861_ C4_STATE=coll:collection1 core:collection1 props:{state=active, collection=collection1, core=collection1, base_url=http://127.0.0.1:41861, node_name=127.0.0.1:41861_, shard=shard2, leader=true}
[junit4:junit4]   2> 23793 T71 C4 P41861 REQ /get {distrib=false&version=2&wt=javabin&getVersions=100&qt=/get} status=0 QTime=1 
[junit4:junit4]   2> 23796 T73 C4 P41861 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 23799 T73 C4 P41861 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@f27f5d lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ea7c6e)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 23800 T73 C4 P41861 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 23801 T73 C4 P41861 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@f27f5d lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ea7c6e)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@f27f5d lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ea7c6e)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 23801 T73 C4 P41861 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 23802 T73 C4 P41861 oass.SolrIndexSearcher.<init> Opening Searcher@1d1ddfa realtime
[junit4:junit4]   2> 23803 T73 C4 P41861 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 23803 T73 C4 P41861 /update {version=2&waitSearcher=true&commit=true&wt=javabin&softCommit=false&openSearcher=false&commit_end_point=true} {commit=} 0 7
[junit4:junit4]   2> 23805 T114 C2 P41291 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 23805 T114 C2 P41291 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 23809 T71 C4 P41861 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 23809 T71 C4 P41861 REQ /replication {version=2&wt=javabin&command=indexversion&qt=/replication} status=0 QTime=1 
[junit4:junit4]   2> 23811 T114 C2 P41291 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 23811 T114 C2 P41291 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 23811 T114 C2 P41291 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 23813 T73 C4 P41861 REQ /replication {version=2&wt=javabin&generation=2&command=filelist&qt=/replication} status=0 QTime=0 
[junit4:junit4]   2> 23814 T114 C2 P41291 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 23815 T114 C2 P41291 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1364030820762/jetty4/index.20130323182724568
[junit4:junit4]   2> 23815 T114 C2 P41291 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@132ac7d lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f4095b) fullCopy=false
[junit4:junit4]   2> 23819 T72 C4 P41861 REQ /replication {checksum=true&wt=filestream&generation=2&command=filecontent&qt=/replication&file=segments_2} status=0 QTime=1 
[junit4:junit4]   2> 23820 T114 C2 P41291 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 23822 T114 C2 P41291 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 23823 T114 C2 P41291 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 23824 T114 C2 P41291 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@37b47a lockFactory=org.apache.lucene.store.NativeFSLockFactory@20354d)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@37b47a lockFactory=org.apache.lucene.store.NativeFSLockFactory@20354d)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 23825 T114 C2 P41291 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 23825 T114 C2 P41291 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 23826 T114 C2 P41291 oass.SolrIndexSearcher.<init> Opening Searcher@18760f1 main
[junit4:junit4]   2> 23827 T113 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@18760f1 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 23828 T114 C2 P41291 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 23828 T114 C2 P41291 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 23829 T114 C2 P41291 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 23829 T114 C2 P41291 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 23830 T114 C2 P41291 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 24339 T19 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 24802 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 24804 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "collection":"onenodecollection",
[junit4:junit4]   2> 	  "core":"onenodecollectioncore",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "roles":"none",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:50808",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:50808_",
[junit4:junit4]   2> 	  "core_node_name":"127.0.0.1:50808__onenodecollectioncore",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "shard":"shard1"}
[junit4:junit4]   2> 24813 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:41291",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:41291_",
[junit4:junit4]   2> 	  "core_node_name":"5",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "shard":"shard2"}
[junit4:junit4]   2> 24824 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24825 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24825 T111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24824 T49 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24824 T78 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24824 T94 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 25343 T19 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 25347 T19 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: onenodecollection
[junit4:junit4]   2> 25348 T19 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 25394 T19 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:56831 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@fc0b5
[junit4:junit4]   2> 25395 T19 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 25396 T121 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:56831. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 25397 T121 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:56831, initiating session
[junit4:junit4]   2> 25397 T21 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:38239
[junit4:junit4]   2> 25398 T21 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:38239
[junit4:junit4]   2> 25400 T23 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d969291fc000d with negotiated timeout 10000 for client /127.0.0.1:38239
[junit4:junit4]   2> 25400 T121 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:56831, sessionid = 0x13d969291fc000d, negotiated timeout = 10000
[junit4:junit4]   2> 25401 T122 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fc0b5 name:ZooKeeperConnection Watcher:127.0.0.1:56831 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 25401 T19 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 25542 T24 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d969291fc000d
[junit4:junit4]   2> 25544 T21 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:38239 which had sessionid 0x13d969291fc000d
[junit4:junit4]   2> 25544 T122 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 25544 T19 oaz.ZooKeeper.close Session: 0x13d969291fc000d closed
[junit4:junit4]   2> 25546 T24 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d969291fc0004
[junit4:junit4]   2> 25547 T49 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 25547 T21 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:38212 which had sessionid 0x13d969291fc0004
[junit4:junit4]   2> 25547 T19 oaz.ZooKeeper.close Session: 0x13d969291fc0004 closed
[junit4:junit4]   2> 25554 T19 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 40793
[junit4:junit4]   2> 25555 T19 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=31641155
[junit4:junit4]   2> 26341 T43 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 26344 T43 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:40793",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:40793_",
[junit4:junit4]   2> 	  "core_node_name":"1",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "shard":"shard1"}
[junit4:junit4]   2> 26354 T78 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 26354 T111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 26354 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 26354 T94 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 26354 T42 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 27558 T19 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 27559 T19 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 27569 T19 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@ca37e0
[junit4:junit4]   2> 27581 T19 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 27582 T19 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 27583 T19 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 27583 T19 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter 

[...truncated too long message...]

rol_collection":{
[junit4:junit4]   1>           "router":"compositeId",
[junit4:junit4]   1>           "shards":{"shard1":{
[junit4:junit4]   1>               "range":"80000000-7fffffff",
[junit4:junit4]   1>               "state":"active",
[junit4:junit4]   1>               "replicas":{"1":{
[junit4:junit4]   1>                   "state":"active",
[junit4:junit4]   1>                   "collection":"control_collection",
[junit4:junit4]   1>                   "core":"collection1",
[junit4:junit4]   1>                   "base_url":"http://127.0.0.1:40793",
[junit4:junit4]   1>                   "node_name":"127.0.0.1:40793_",
[junit4:junit4]   1>                   "shard":"shard1",
[junit4:junit4]   1>                   "leader":"true"}}}}}}
[junit4:junit4]   1>   /solr/overseer (3)
[junit4:junit4]   1>   DATA:
[junit4:junit4]   1>       
[junit4:junit4]   1>    /solr/overseer/queue (0)
[junit4:junit4]   1>    /solr/overseer/collection-queue-work (0)
[junit4:junit4]   1>    /solr/overseer/queue-work (0)
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1> 
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZk2Test -Dtests.method=testDistribSearch -Dtests.seed=6D674C5FAC30E796 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sk_SK -Dtests.timezone=Asia/Tokyo -Dtests.file.encoding=UTF-8
[junit4:junit4] ERROR   34.2s J1 | BasicDistributedZk2Test.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: org.apache.solr.common.SolrException: Server at http://127.0.0.1:41861/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([6D674C5FAC30E796:EC81C247DB6F87AA]:0)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:375)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:181)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
[junit4:junit4]    > 	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:197)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:487)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 34178 T19 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 34184 T18 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4]   2> 34246 T22 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 35336 T111 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 35336 T111 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 35336 T111 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 35337 T111 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> NOTE: test params are: codec=Asserting, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=sk_SK, timezone=Asia/Tokyo
[junit4:junit4]   2> NOTE: Linux 3.2.0-39-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=3,free=30486616,total=64880640
[junit4:junit4]   2> NOTE: All tests run in this JVM: [CurrencyFieldXmlFileTest, BasicDistributedZk2Test]
[junit4:junit4] Completed on J1 in 35.54s, 1 test, 1 error <<< FAILURES!

[...truncated 788 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:375: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:355: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1209: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:873: There were test failures: 272 suites, 1146 tests, 1 error, 13 ignored (7 assumptions)

Total time: 41 minutes 25 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.8.0-ea-b82 -server -XX:+UseConcMarkSweepGC
Email was triggered for: Failure
Sending email for trigger: Failure