You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/03/06 00:42:15 UTC

[JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.7.0_15) - Build # 2623 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/2623/
Java: 64bit/jdk1.7.0_15 -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest:     1) Thread[id=430, name=TEST-ChaosMonkeySafeLeaderTest.testDistribSearch-seed#[5F805F8FB5346F4F]-EventThread, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:428)         at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:404)         at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:833)         at org.apache.solr.cloud.ZkController.register(ZkController.java:766)         at org.apache.solr.cloud.ZkController$1.command(ZkController.java:212)         at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)         at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)         at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest: 
   1) Thread[id=430, name=TEST-ChaosMonkeySafeLeaderTest.testDistribSearch-seed#[5F805F8FB5346F4F]-EventThread, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:428)
        at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:404)
        at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:833)
        at org.apache.solr.cloud.ZkController.register(ZkController.java:766)
        at org.apache.solr.cloud.ZkController$1.command(ZkController.java:212)
        at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
        at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
        at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
        at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
	at __randomizedtesting.SeedInfo.seed([5F805F8FB5346F4F]:0)




Build Log:
[...truncated 8809 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4:junit4]   2> 0 T207 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /o_xi/
[junit4:junit4]   2> 9 T207 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-ChaosMonkeySafeLeaderTest-1362524908399
[junit4:junit4]   2> 17 T207 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 23 T208 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 100 T208 oaz.Environment.logEnv Server environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 100 T208 oaz.Environment.logEnv Server environment:host.name=JenkinsSlave-PC
[junit4:junit4]   2> 101 T208 oaz.Environment.logEnv Server environment:java.version=1.7.0_15
[junit4:junit4]   2> 101 T208 oaz.Environment.logEnv Server environment:java.vendor=Oracle Corporation
[junit4:junit4]   2> 101 T208 oaz.Environment.logEnv Server environment:java.home=C:\Users\JenkinsSlave\tools\java\64bit\jdk1.7.0_15\jre
[junit4:junit4]   2> 101 T208 oaz.Environment.logEnv Server environment:java.class.path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\classes\test;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-test-framework\classes\java;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\test-framework\classes\java;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\codecs\classes\java;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\classes\java;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\classes\java;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\analysis\common\lucene-analyzers-common-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\analysis\kuromoji\lucene-analyzers-kuromoji-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\analysis\phonetic\lucene-analyzers-phonetic-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\codecs\lucene-codecs-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\highlighter\lucene-highlighter-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\memory\lucene-memory-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\misc\lucene-misc-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\spatial\lucene-spatial-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\suggest\lucene-suggest-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\grouping\lucene-grouping-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\queries\lucene-queries-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\queryparser\lucene-queryparser-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\cglib-nodep-2.2.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\commons-cli-1.2.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\commons-codec-1.7.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\commons-fileupload-1.2.1.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\commons-lang-2.6.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\easymock-3.0.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\guava-13.0.1.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\javax.servlet-api-3.0.1.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\objenesis-1.2.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\spatial4j-0.3.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\commons-io-2.1.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\httpclient-4.2.3.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\httpcore-4.2.2.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\httpmime-4.2.3.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\jcl-over-slf4j-1.6.4.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\slf4j-api-1.6.4.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\slf4j-jdk14-1.6.4.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\wstx-asl-3.2.7.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\zookeeper-3.4.5.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-continuation-8.1.8.v20121106.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-deploy-8.1.8.v20121106.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-http-8.1.8.v20121106.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-io-8.1.8.v20121106.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-jmx-8.1.8.v20121106.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-security-8.1.8.v20121106.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-server-8.1.8.v20121106.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-servlet-8.1.8.v20121106.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-util-8.1.8.v20121106.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-webapp-8.1.8.v20121106.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-xml-8.1.8.v20121106.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\servlet-api-3.0.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\example-DIH\solr\db\lib\derby-10.9.1.0.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\example-DIH\solr\db\lib\hsqldb-1.8.0.10.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\core\classes\java;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\test-framework\lib\junit-4.10.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\test-framework\lib\randomizedtesting-runner-2.0.8.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-launcher.jar;C:\Users\JenkinsSlave\.ant\lib\ivy-2.3.0.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-antlr.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-apache-bcel.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-apache-bsf.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-apache-log4j.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-apache-oro.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-apache-regexp.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-apache-resolver.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-apache-xalan2.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-commons-logging.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-commons-net.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-jai.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-javamail.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-jdepend.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-jmf.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-jsch.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-junit.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-junit4.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-netrexx.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-swing.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-testutil.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant.jar;C:\Users\JenkinsSlave\tools\java\64bit\jdk1.7.0_15\lib\tools.jar;C:\Users\JenkinsSlave\.ivy2\cache\com.carrotsearch.randomizedtesting\junit4-ant\jars\junit4-ant-2.0.8.jar
[junit4:junit4]   2> 102 T208 oaz.Environment.logEnv Server environment:java.library.path=C:\Users\JenkinsSlave\tools\java\64bit\jdk1.7.0_15\jre\bin;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows;C:\Users\JenkinsSlave\tools\java\64bit\jdk1.7.0_15\bin;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files (x86)\Subversion\bin;.
[junit4:junit4]   2> 103 T208 oaz.Environment.logEnv Server environment:java.io.tmpdir=.
[junit4:junit4]   2> 103 T208 oaz.Environment.logEnv Server environment:java.compiler=<NA>
[junit4:junit4]   2> 108 T208 oaz.Environment.logEnv Server environment:os.name=Windows 7
[junit4:junit4]   2> 108 T208 oaz.Environment.logEnv Server environment:os.arch=amd64
[junit4:junit4]   2> 110 T208 oaz.Environment.logEnv Server environment:os.version=6.1
[junit4:junit4]   2> 110 T208 oaz.Environment.logEnv Server environment:user.name=JenkinsSlave
[junit4:junit4]   2> 110 T208 oaz.Environment.logEnv Server environment:user.home=C:\Users\JenkinsSlave
[junit4:junit4]   2> 110 T208 oaz.Environment.logEnv Server environment:user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 174 T208 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 174 T208 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 174 T208 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 180 T208 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 239 T207 oasc.ZkTestServer.run start zk server on port:64251
[junit4:junit4]   2> 268 T208 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\zookeeper\server1\data\version-2\snapshot.0
[junit4:junit4]   2> 341 T207 oaz.Environment.logEnv Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 342 T207 oaz.Environment.logEnv Client environment:host.name=JenkinsSlave-PC
[junit4:junit4]   2> 342 T207 oaz.Environment.logEnv Client environment:java.version=1.7.0_15
[junit4:junit4]   2> 347 T207 oaz.Environment.logEnv Client environment:java.vendor=Oracle Corporation
[junit4:junit4]   2> 347 T207 oaz.Environment.logEnv Client environment:java.home=C:\Users\JenkinsSlave\tools\java\64bit\jdk1.7.0_15\jre
[junit4:junit4]   2> 347 T207 oaz.Environment.logEnv Client environment:java.class.path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\classes\test;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-test-framework\classes\java;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\test-framework\classes\java;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\codecs\classes\java;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\classes\java;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\classes\java;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\analysis\common\lucene-analyzers-common-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\analysis\kuromoji\lucene-analyzers-kuromoji-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\analysis\phonetic\lucene-analyzers-phonetic-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\codecs\lucene-codecs-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\highlighter\lucene-highlighter-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\memory\lucene-memory-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\misc\lucene-misc-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\spatial\lucene-spatial-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\suggest\lucene-suggest-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\grouping\lucene-grouping-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\queries\lucene-queries-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\queryparser\lucene-queryparser-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\cglib-nodep-2.2.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\commons-cli-1.2.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\commons-codec-1.7.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\commons-fileupload-1.2.1.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\commons-lang-2.6.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\easymock-3.0.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\guava-13.0.1.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\javax.servlet-api-3.0.1.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\objenesis-1.2.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\spatial4j-0.3.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\commons-io-2.1.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\httpclient-4.2.3.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\httpcore-4.2.2.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\httpmime-4.2.3.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\jcl-over-slf4j-1.6.4.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\slf4j-api-1.6.4.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\slf4j-jdk14-1.6.4.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\wstx-asl-3.2.7.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\zookeeper-3.4.5.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-continuation-8.1.8.v20121106.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-deploy-8.1.8.v20121106.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-http-8.1.8.v20121106.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-io-8.1.8.v20121106.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-jmx-8.1.8.v20121106.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-security-8.1.8.v20121106.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-server-8.1.8.v20121106.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-servlet-8.1.8.v20121106.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-util-8.1.8.v20121106.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-webapp-8.1.8.v20121106.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-xml-8.1.8.v20121106.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\servlet-api-3.0.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\example-DIH\solr\db\lib\derby-10.9.1.0.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\example-DIH\solr\db\lib\hsqldb-1.8.0.10.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\core\classes\java;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\test-framework\lib\junit-4.10.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\test-framework\lib\randomizedtesting-runner-2.0.8.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-launcher.jar;C:\Users\JenkinsSlave\.ant\lib\ivy-2.3.0.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-antlr.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-apache-bcel.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-apache-bsf.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-apache-log4j.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-apache-oro.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-apache-regexp.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-apache-resolver.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-apache-xalan2.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-commons-logging.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-commons-net.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-jai.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-javamail.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-jdepend.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-jmf.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-jsch.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-junit.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-junit4.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-netrexx.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-swing.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-testutil.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant.jar;C:\Users\JenkinsSlave\tools\java\64bit\jdk1.7.0_15\lib\tools.jar;C:\Users\JenkinsSlave\.ivy2\cache\com.carrotsearch.randomizedtesting\junit4-ant\jars\junit4-ant-2.0.8.jar
[junit4:junit4]   2> 349 T207 oaz.Environment.logEnv Client environment:java.library.path=C:\Users\JenkinsSlave\tools\java\64bit\jdk1.7.0_15\jre\bin;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows;C:\Users\JenkinsSlave\tools\java\64bit\jdk1.7.0_15\bin;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files (x86)\Subversion\bin;.
[junit4:junit4]   2> 349 T207 oaz.Environment.logEnv Client environment:java.io.tmpdir=.
[junit4:junit4]   2> 350 T207 oaz.Environment.logEnv Client environment:java.compiler=<NA>
[junit4:junit4]   2> 351 T207 oaz.Environment.logEnv Client environment:os.name=Windows 7
[junit4:junit4]   2> 351 T207 oaz.Environment.logEnv Client environment:os.arch=amd64
[junit4:junit4]   2> 351 T207 oaz.Environment.logEnv Client environment:os.version=6.1
[junit4:junit4]   2> 351 T207 oaz.Environment.logEnv Client environment:user.name=JenkinsSlave
[junit4:junit4]   2> 352 T207 oaz.Environment.logEnv Client environment:user.home=C:\Users\JenkinsSlave
[junit4:junit4]   2> 353 T207 oaz.Environment.logEnv Client environment:user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 357 T207 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:64251 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@7848d29a
[junit4:junit4]   2> 435 T207 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 445 T213 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:64251. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 447 T209 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:64254
[junit4:junit4]   2> 457 T213 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:64251, initiating session
[junit4:junit4]   2> 476 T209 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:64254
[junit4:junit4]   2> 491 T211 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 535 T211 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3cd02c950000 with negotiated timeout 10000 for client /127.0.0.1:64254
[junit4:junit4]   2> 535 T213 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:64251, sessionid = 0x13d3cd02c950000, negotiated timeout = 10000
[junit4:junit4]   2> 546 T214 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7848d29a name:ZooKeeperConnection Watcher:127.0.0.1:64251 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 546 T207 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 550 T207 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 632 T212 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d3cd02c950000
[junit4:junit4]   2> 634 T214 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 634 T207 oaz.ZooKeeper.close Session: 0x13d3cd02c950000 closed
[junit4:junit4]   2> 635 T209 oazs.NIOServerCnxn.doIO WARNING caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13d3cd02c950000, likely client has closed socket
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 
[junit4:junit4]   2> 636 T207 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:64251/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@55a1e2c7
[junit4:junit4]   2> 638 T209 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:64254 which had sessionid 0x13d3cd02c950000
[junit4:junit4]   2> 639 T207 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 640 T215 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:64251. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 640 T215 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:64251, initiating session
[junit4:junit4]   2> 641 T209 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:64257
[junit4:junit4]   2> 641 T209 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:64257
[junit4:junit4]   2> 645 T211 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3cd02c950001 with negotiated timeout 10000 for client /127.0.0.1:64257
[junit4:junit4]   2> 645 T215 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:64251, sessionid = 0x13d3cd02c950001, negotiated timeout = 10000
[junit4:junit4]   2> 645 T216 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@55a1e2c7 name:ZooKeeperConnection Watcher:127.0.0.1:64251/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 646 T207 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 656 T207 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 668 T207 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 675 T207 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 680 T207 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 689 T207 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 709 T207 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 723 T207 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 726 T207 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 734 T207 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 735 T207 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 743 T207 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 744 T207 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 752 T207 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 753 T207 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 760 T207 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 761 T207 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 769 T207 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 770 T207 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 777 T207 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 778 T207 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 785 T207 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 787 T207 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 794 T212 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d3cd02c950001
[junit4:junit4]   2> 796 T207 oaz.ZooKeeper.close Session: 0x13d3cd02c950001 closed
[junit4:junit4]   2> 797 T209 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:64257 which had sessionid 0x13d3cd02c950001
[junit4:junit4]   2> 796 T216 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 1278 T207 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 1286 T207 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:64258
[junit4:junit4]   2> 1296 T207 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 1297 T207 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1297 T207 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1362524909186
[junit4:junit4]   2> 1297 T207 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1362524909186\solr.xml
[junit4:junit4]   2> 1299 T207 oasc.CoreContainer.<init> New CoreContainer 831578943
[junit4:junit4]   2> 1299 T207 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1362524909186\'
[junit4:junit4]   2> 1301 T207 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1362524909186\'
[junit4:junit4]   2> 1366 T207 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 1367 T207 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 1367 T207 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 1367 T207 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 1367 T207 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 1368 T207 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 1368 T207 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 1369 T207 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 1370 T207 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 1370 T207 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 1390 T207 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 1426 T207 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:64251/solr
[junit4:junit4]   2> 1450 T207 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 1450 T207 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:64251 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@786e43f2
[junit4:junit4]   2> 1452 T207 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1454 T226 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:64251. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 1455 T226 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:64251, initiating session
[junit4:junit4]   2> 1455 T209 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:64263
[junit4:junit4]   2> 1456 T209 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:64263
[junit4:junit4]   2> 1473 T211 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3cd02c950002 with negotiated timeout 20000 for client /127.0.0.1:64263
[junit4:junit4]   2> 1473 T226 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:64251, sessionid = 0x13d3cd02c950002, negotiated timeout = 20000
[junit4:junit4]   2> 1474 T227 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@786e43f2 name:ZooKeeperConnection Watcher:127.0.0.1:64251 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1474 T207 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1477 T212 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d3cd02c950002
[junit4:junit4]   2> 1483 T209 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:64263 which had sessionid 0x13d3cd02c950002
[junit4:junit4]   2> 1483 T207 oaz.ZooKeeper.close Session: 0x13d3cd02c950002 closed
[junit4:junit4]   2> 1483 T227 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 1485 T207 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 1498 T207 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:64251/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@61b84b5f
[junit4:junit4]   2> 1500 T207 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1501 T228 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:64251. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 1502 T228 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:64251, initiating session
[junit4:junit4]   2> 1502 T209 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:64266
[junit4:junit4]   2> 1502 T209 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:64266
[junit4:junit4]   2> 1507 T211 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3cd02c950003 with negotiated timeout 20000 for client /127.0.0.1:64266
[junit4:junit4]   2> 1507 T228 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:64251, sessionid = 0x13d3cd02c950003, negotiated timeout = 20000
[junit4:junit4]   2> 1513 T229 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@61b84b5f name:ZooKeeperConnection Watcher:127.0.0.1:64251/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1514 T207 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1535 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c950003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1547 T207 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 1553 T207 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64258_o_xi
[junit4:junit4]   2> 1558 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c950003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:64258_o_xi Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:64258_o_xi
[junit4:junit4]   2> 1562 T207 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64258_o_xi
[junit4:junit4]   2> 1570 T207 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 1596 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c950003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 1598 T207 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 1605 T207 oasc.Overseer.start Overseer (id=89294432416104451-127.0.0.1:64258_o_xi-n_0000000000) starting
[junit4:junit4]   2> 1606 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c950003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1624 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c950003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1627 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c950003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1638 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c950003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 1642 T231 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4]   2> 1643 T207 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 1652 T207 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 1670 T230 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 1680 T232 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1362524909186\collection1
[junit4:junit4]   2> 1680 T232 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 1682 T232 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 1683 T232 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 1687 T232 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1362524909186\collection1\'
[junit4:junit4]   2> 1689 T232 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1362524909186/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 1691 T232 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1362524909186/collection1/lib/README' to classloader
[junit4:junit4]   2> 1773 T232 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 1870 T232 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1873 T232 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 1907 T232 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 3185 T232 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 3213 T232 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 3217 T232 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 3253 T232 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3259 T232 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3266 T232 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3269 T232 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 3270 T232 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 3270 T232 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3272 T232 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 3273 T232 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 3273 T232 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1362524909186\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398/control/data\
[junit4:junit4]   2> 3273 T232 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c95648d
[junit4:junit4]   2> 3274 T232 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 3304 T232 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\control\data forceNew:false
[junit4:junit4]   2> 3305 T232 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\control\data
[junit4:junit4]   2> 3305 T232 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398/control/data\index/
[junit4:junit4]   2> 3306 T232 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\control\data\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 3306 T232 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\control\data\index forceNew:false
[junit4:junit4]   2> 3322 T232 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\control\data\index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3323 T232 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 3324 T232 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\control\data\index
[junit4:junit4]   2> 3327 T232 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 3327 T232 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 3328 T232 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 3329 T232 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 3330 T232 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 3330 T232 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 3331 T232 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 3331 T232 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 3332 T232 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 3342 T232 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 3373 T232 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\control\data
[junit4:junit4]   2> 3379 T232 oass.SolrIndexSearcher.<init> Opening Searcher@7c4f7575 main
[junit4:junit4]   2> 3381 T232 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 3382 T232 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 3386 T232 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\control\data
[junit4:junit4]   2> 3389 T232 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 3389 T232 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3396 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c950003 type:create cxid:0x53 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 3397 T233 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7c4f7575 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 4832 T230 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4834 T230 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:64258_o_xi",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:64258/o_xi"}
[junit4:junit4]   2> 4834 T230 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 4860 T230 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 4862 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c950003 type:create cxid:0x5b zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 4896 T229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 5407 T232 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 5407 T232 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:64258/o_xi collection:control_collection shard:shard1
[junit4:junit4]   2> 5420 T232 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 5430 T232 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 5452 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c950003 type:delete cxid:0x75 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 5454 T232 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 5455 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c950003 type:create cxid:0x76 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5461 T232 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 5462 T232 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 5462 T232 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:64258/o_xi/collection1/
[junit4:junit4]   2> 5462 T232 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 5463 T232 oasc.SyncStrategy.syncToMe http://127.0.0.1:64258/o_xi/collection1/ has no replicas
[junit4:junit4]   2> 5463 T232 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:64258/o_xi/collection1/
[junit4:junit4]   2> 5463 T232 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 5473 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c950003 type:create cxid:0x80 zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6410 T230 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6437 T229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 6499 T232 oasc.ZkController.register We are http://127.0.0.1:64258/o_xi/collection1/ and leader is http://127.0.0.1:64258/o_xi/collection1/
[junit4:junit4]   2> 6499 T232 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:64258/o_xi
[junit4:junit4]   2> 6499 T232 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 6500 T232 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 6500 T232 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6504 T232 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6507 T207 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 6507 T207 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 6508 T207 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 6513 T207 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 6517 T207 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:64251/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@230dddf2
[junit4:junit4]   2> 6519 T207 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6521 T235 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:64251. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 6524 T235 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:64251, initiating session
[junit4:junit4]   2> 6525 T209 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:64269
[junit4:junit4]   2> 6525 T209 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:64269
[junit4:junit4]   2> 6528 T211 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3cd02c950004 with negotiated timeout 10000 for client /127.0.0.1:64269
[junit4:junit4]   2> 6528 T235 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:64251, sessionid = 0x13d3cd02c950004, negotiated timeout = 10000
[junit4:junit4]   2> 6529 T236 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@230dddf2 name:ZooKeeperConnection Watcher:127.0.0.1:64251/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6530 T207 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6532 T207 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 6538 T207 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 6887 T207 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 6891 T207 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:64270
[junit4:junit4]   2> 6892 T207 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 6892 T207 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6893 T207 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1362524914928
[junit4:junit4]   2> 6893 T207 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1362524914928\solr.xml
[junit4:junit4]   2> 6893 T207 oasc.CoreContainer.<init> New CoreContainer 1143786034
[junit4:junit4]   2> 6893 T207 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1362524914928\'
[junit4:junit4]   2> 6894 T207 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1362524914928\'
[junit4:junit4]   2> 6948 T207 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 6949 T207 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 6949 T207 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 6949 T207 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 6950 T207 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 6950 T207 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 6951 T207 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 6951 T207 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 6952 T207 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 6952 T207 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 6968 T207 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 6993 T207 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:64251/solr
[junit4:junit4]   2> 6994 T207 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 6995 T207 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:64251 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@5d3ad90d
[junit4:junit4]   2> 6996 T207 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6998 T246 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:64251. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 6999 T246 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:64251, initiating session
[junit4:junit4]   2> 6999 T209 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:64275
[junit4:junit4]   2> 6999 T209 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:64275
[junit4:junit4]   2> 7011 T211 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3cd02c950005 with negotiated timeout 20000 for client /127.0.0.1:64275
[junit4:junit4]   2> 7011 T246 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:64251, sessionid = 0x13d3cd02c950005, negotiated timeout = 20000
[junit4:junit4]   2> 7011 T247 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5d3ad90d name:ZooKeeperConnection Watcher:127.0.0.1:64251 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7012 T207 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7014 T212 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d3cd02c950005
[junit4:junit4]   2> 7016 T207 oaz.ZooKeeper.close Session: 0x13d3cd02c950005 closed
[junit4:junit4]   2> 7016 T247 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 7016 T209 oazs.NIOServerCnxn.doIO WARNING caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13d3cd02c950005, likely client has closed socket
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 
[junit4:junit4]   2> 7017 T207 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 7018 T209 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:64275 which had sessionid 0x13d3cd02c950005
[junit4:junit4]   2> 7023 T207 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:64251/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@8cb7e08
[junit4:junit4]   2> 7025 T207 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7027 T248 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:64251. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 7028 T248 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:64251, initiating session
[junit4:junit4]   2> 7028 T209 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:64278
[junit4:junit4]   2> 7029 T209 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:64278
[junit4:junit4]   2> 7031 T211 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3cd02c950006 with negotiated timeout 20000 for client /127.0.0.1:64278
[junit4:junit4]   2> 7031 T248 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:64251, sessionid = 0x13d3cd02c950006, negotiated timeout = 20000
[junit4:junit4]   2> 7031 T249 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8cb7e08 name:ZooKeeperConnection Watcher:127.0.0.1:64251/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7032 T207 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7034 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c950006 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7036 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c950006 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7040 T207 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7953 T230 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7955 T230 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:64258_o_xi",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:64258/o_xi"}
[junit4:junit4]   2> 7967 T236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 7967 T229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 7967 T249 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 8045 T207 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64270_o_xi
[junit4:junit4]   2> 8046 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c950006 type:delete cxid:0xb zxid:0x4f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:64270_o_xi Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:64270_o_xi
[junit4:junit4]   2> 8049 T207 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64270_o_xi
[junit4:junit4]   2> 8054 T249 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 8055 T236 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 8055 T236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8057 T229 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 8057 T229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 8067 T249 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 8091 T250 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1362524914928\collection1
[junit4:junit4]   2> 8091 T250 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 8093 T250 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 8093 T250 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 8096 T250 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1362524914928\collection1\'
[junit4:junit4]   2> 8098 T250 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1362524914928/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 8099 T250 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1362524914928/collection1/lib/README' to classloader
[junit4:junit4]   2> 8157 T250 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 8258 T250 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 8260 T250 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 8279 T250 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 9179 T250 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 9193 T250 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 9197 T250 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 9237 T250 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 9243 T250 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 9250 T250 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 9253 T250 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 9253 T250 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 9254 T250 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 9256 T250 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 9256 T250 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 9256 T250 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1362524914928\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398/jetty1\
[junit4:junit4]   2> 9257 T250 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c95648d
[junit4:junit4]   2> 9259 T250 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 9259 T250 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty1 forceNew:false
[junit4:junit4]   2> 9259 T250 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty1
[junit4:junit4]   2> 9260 T250 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398/jetty1\index/
[junit4:junit4]   2> 9261 T250 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty1\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 9262 T250 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty1\index forceNew:false
[junit4:junit4]   2> 9273 T250 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty1\index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 9273 T250 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 9275 T250 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty1\index
[junit4:junit4]   2> 9279 T250 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 9280 T250 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 9280 T250 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 9281 T250 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 9282 T250 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 9282 T250 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 9283 T250 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 9284 T250 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 9284 T250 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 9296 T250 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 9302 T250 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty1
[junit4:junit4]   2> 9305 T250 oass.SolrIndexSearcher.<init> Opening Searcher@1ef479c2 main
[junit4:junit4]   2> 9308 T250 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 9308 T250 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 9320 T251 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1ef479c2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 9324 T250 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 9324 T250 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9485 T230 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9487 T230 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:64270_o_xi",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:64270/o_xi"}
[junit4:junit4]   2> 9487 T230 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 3
[junit4:junit4]   2> 9487 T230 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 9500 T236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9501 T249 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9501 T229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 10329 T250 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 10329 T250 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:64270/o_xi collection:collection1 shard:shard1
[junit4:junit4]   2> 10331 T250 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 10351 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c950006 type:delete cxid:0x48 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 10353 T250 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 10354 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c950006 type:create cxid:0x49 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 10362 T250 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 10363 T250 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 10363 T250 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:64270/o_xi/collection1/
[junit4:junit4]   2> 10363 T250 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 10364 T250 oasc.SyncStrategy.syncToMe http://127.0.0.1:64270/o_xi/collection1/ has no replicas
[junit4:junit4]   2> 10364 T250 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:64270/o_xi/collection1/
[junit4:junit4]   2> 10364 T250 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 10380 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c950006 type:create cxid:0x53 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11019 T230 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11046 T229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 11046 T249 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 11046 T236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 11095 T250 oasc.ZkController.register We are http://127.0.0.1:64270/o_xi/collection1/ and leader is http://127.0.0.1:64270/o_xi/collection1/
[junit4:junit4]   2> 11095 T250 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:64270/o_xi
[junit4:junit4]   2> 11095 T250 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 11097 T250 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 11097 T250 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11105 T250 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11108 T207 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 11108 T207 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 11109 T207 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 11529 T207 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 11533 T207 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:64279
[junit4:junit4]   2> 11534 T207 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 11535 T207 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 11535 T207 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1362524919508
[junit4:junit4]   2> 11536 T207 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1362524919508\solr.xml
[junit4:junit4]   2> 11536 T207 oasc.CoreContainer.<init> New CoreContainer 2112235466
[junit4:junit4]   2> 11537 T207 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1362524919508\'
[junit4:junit4]   2> 11537 T207 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1362524919508\'
[junit4:junit4]   2> 11601 T207 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 11601 T207 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 11602 T207 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 11602 T207 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 11603 T207 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 11603 T207 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 11604 T207 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 11604 T207 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 11605 T207 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 11605 T207 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 11628 T207 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 11658 T207 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:64251/solr
[junit4:junit4]   2> 11658 T207 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 11659 T207 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:64251 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@2fd9c2a3
[junit4:junit4]   2> 11661 T207 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11662 T262 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:64251. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 11664 T262 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:64251, initiating session
[junit4:junit4]   2> 11664 T209 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:64284
[junit4:junit4]   2> 11664 T209 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:64284
[junit4:junit4]   2> 11690 T211 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3cd02c950007 with negotiated timeout 20000 for client /127.0.0.1:64284
[junit4:junit4]   2> 11690 T262 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:64251, sessionid = 0x13d3cd02c950007, negotiated timeout = 20000
[junit4:junit4]   2> 11691 T263 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2fd9c2a3 name:ZooKeeperConnection Watcher:127.0.0.1:64251 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11692 T207 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11695 T212 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d3cd02c950007
[junit4:junit4]   2> 11723 T209 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:64284 which had sessionid 0x13d3cd02c950007
[junit4:junit4]   2> 11724 T263 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 11724 T207 oaz.ZooKeeper.close Session: 0x13d3cd02c950007 closed
[junit4:junit4]   2> 11725 T207 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 11730 T207 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:64251/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@2d15b382
[junit4:junit4]   2> 11732 T207 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11733 T264 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:64251. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 11734 T264 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:64251, initiating session
[junit4:junit4]   2> 11735 T209 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:64287
[junit4:junit4]   2> 11735 T209 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:64287
[junit4:junit4]   2> 11762 T211 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3cd02c950008 with negotiated timeout 20000 for client /127.0.0.1:64287
[junit4:junit4]   2> 11762 T264 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:64251, sessionid = 0x13d3cd02c950008, negotiated timeout = 20000
[junit4:junit4]   2> 11762 T265 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d15b382 name:ZooKeeperConnection Watcher:127.0.0.1:64251/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11763 T207 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11765 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c950008 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11791 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c950008 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11823 T207 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 12567 T230 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12570 T230 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:64270_o_xi",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:64270/o_xi"}
[junit4:junit4]   2> 12592 T249 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 12592 T236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 12592 T265 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 12592 T229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 12828 T207 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64279_o_xi
[junit4:junit4]   2> 12829 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c950008 type:delete cxid:0xb zxid:0x73 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:64279_o_xi Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:64279_o_xi
[junit4:junit4]   2> 12834 T207 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64279_o_xi
[junit4:junit4]   2> 12842 T249 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 12843 T229 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 12845 T229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12843 T236 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 12845 T236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12846 T265 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 12848 T265 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 12851 T249 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 12868 T266 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1362524919508\collection1
[junit4:junit4]   2> 12869 T266 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 12871 T266 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 12872 T266 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 12878 T266 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1362524919508\collection1\'
[junit4:junit4]   2> 12881 T266 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1362524919508/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 12883 T266 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1362524919508/collection1/lib/README' to classloader
[junit4:junit4]   2> 12982 T266 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 13062 T266 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 13065 T266 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 13085 T266 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 14370 T266 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 14391 T266 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 14398 T266 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 14473 T266 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 14480 T266 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 14489 T266 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 14491 T266 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 14492 T266 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 14492 T266 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 14495 T266 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 14496 T266 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 14497 T266 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1362524919508\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398/jetty2\
[junit4:junit4]   2> 14497 T266 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c95648d
[junit4:junit4]   2> 14498 T266 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 14500 T266 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty2 forceNew:false
[junit4:junit4]   2> 14501 T266 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty2
[junit4:junit4]   2> 14502 T266 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398/jetty2\index/
[junit4:junit4]   2> 14503 T266 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty2\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 14504 T266 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty2\index forceNew:false
[junit4:junit4]   2> 14521 T266 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty2\index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 14522 T266 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 14524 T266 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty2\index
[junit4:junit4]   2> 14709 T266 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 14710 T266 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 14711 T266 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 14712 T266 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 14718 T266 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 14719 T266 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 14719 T266 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 14731 T266 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 14732 T266 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 14750 T266 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 14760 T266 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty2
[junit4:junit4]   2> 14764 T266 oass.SolrIndexSearcher.<init> Opening Searcher@4c0906ae main
[junit4:junit4]   2> 14780 T266 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 14781 T266 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 14790 T266 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty2
[junit4:junit4]   2> 14795 T266 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 14795 T266 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 14800 T267 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4c0906ae main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 15925 T230 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15925 T230 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:64279_o_xi",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:64279/o_xi"}
[junit4:junit4]   2> 15925 T230 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4]   2> 15925 T230 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 15969 T236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 15970 T249 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 15970 T229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 15971 T265 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 16804 T266 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 16804 T266 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:64279/o_xi collection:collection1 shard:shard2
[junit4:junit4]   2> 16809 T266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 16843 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c950008 type:delete cxid:0x47 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 16871 T266 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 16875 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c950008 type:create cxid:0x48 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16882 T266 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 16883 T266 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 16883 T266 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:64279/o_xi/collection1/
[junit4:junit4]   2> 16883 T266 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 16884 T266 oasc.SyncStrategy.syncToMe http://127.0.0.1:64279/o_xi/collection1/ has no replicas
[junit4:junit4]   2> 16884 T266 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:64279/o_xi/collection1/
[junit4:junit4]   2> 16884 T266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 16898 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c950008 type:create cxid:0x51 zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 17486 T230 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17515 T229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 17516 T249 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 17516 T265 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 17515 T236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 17567 T266 oasc.ZkController.register We are http://127.0.0.1:64279/o_xi/collection1/ and leader is http://127.0.0.1:64279/o_xi/collection1/
[junit4:junit4]   2> 17567 T266 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:64279/o_xi
[junit4:junit4]   2> 17568 T266 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 17568 T266 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 17568 T266 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 17599 T266 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17602 T207 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 17602 T207 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 17603 T207 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 18110 T207 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 18114 T207 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:64288
[junit4:junit4]   2> 18116 T207 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 18118 T207 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 18119 T207 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1362524926008
[junit4:junit4]   2> 18119 T207 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1362524926008\solr.xml
[junit4:junit4]   2> 18120 T207 oasc.CoreContainer.<init> New CoreContainer 419322789
[junit4:junit4]   2> 18121 T207 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1362524926008\'
[junit4:junit4]   2> 18121 T207 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1362524926008\'
[junit4:junit4]   2> 18198 T207 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 18198 T207 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 18199 T207 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 18200 T207 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 18200 T207 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 18201 T207 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 18201 T207 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 18202 T207 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 18203 T207 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 18204 T207 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 18228 T207 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 18264 T207 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:64251/solr
[junit4:junit4]   2> 18264 T207 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 18266 T207 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:64251 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@3e66cedc
[junit4:junit4]   2> 18268 T207 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 18270 T280 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:64251. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 18273 T280 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:64251, initiating session
[junit4:junit4]   2> 18273 T209 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:64293
[junit4:junit4]   2> 18274 T209 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:64293
[junit4:junit4]   2> 18291 T211 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3cd02c950009 with negotiated timeout 20000 for client /127.0.0.1:64293
[junit4:junit4]   2> 18291 T280 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:64251, sessionid = 0x13d3cd02c950009, negotiated timeout = 20000
[junit4:junit4]   2> 18293 T281 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e66cedc name:ZooKeeperConnection Watcher:127.0.0.1:64251 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 18294 T207 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 18297 T212 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d3cd02c950009
[junit4:junit4]   2> 18300 T207 oaz.ZooKeeper.close Session: 0x13d3cd02c950009 closed
[junit4:junit4]   2> 18300 T209 oazs.NIOServerCnxn.doIO WARNING caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13d3cd02c950009, likely client has closed socket
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 
[junit4:junit4]   2> 18300 T281 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 18301 T209 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:64293 which had sessionid 0x13d3cd02c950009
[junit4:junit4]   2> 18301 T207 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 18312 T207 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:64251/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@2c8d0d4e
[junit4:junit4]   2> 18317 T207 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 18320 T282 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:64251. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 18322 T282 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:64251, initiating session
[junit4:junit4]   2> 18323 T209 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:64296
[junit4:junit4]   2> 18324 T209 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:64296
[junit4:junit4]   2> 18336 T211 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3cd02c95000a with negotiated timeout 20000 for client /127.0.0.1:64296
[junit4:junit4]   2> 18336 T282 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:64251, sessionid = 0x13d3cd02c95000a, negotiated timeout = 20000
[junit4:junit4]   2> 18336 T283 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c8d0d4e name:ZooKeeperConnection Watcher:127.0.0.1:64251/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 18336 T207 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 18342 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c95000a type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 18355 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c95000a type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 18380 T207 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 19035 T230 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 19037 T230 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:64279_o_xi",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:64279/o_xi"}
[junit4:junit4]   2> 19119 T249 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 19119 T229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 19119 T236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 19112 T283 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 19121 T265 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 19385 T207 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64288_o_xi
[junit4:junit4]   2> 19387 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c95000a type:delete cxid:0xb zxid:0x95 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:64288_o_xi Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:64288_o_xi
[junit4:junit4]   2> 19390 T207 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64288_o_xi
[junit4:junit4]   2> 19399 T249 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 19401 T283 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 19401 T283 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19403 T229 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 19404 T229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19404 T265 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 19404 T265 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19408 T236 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 19409 T236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19413 T249 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 19425 T284 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1362524926008\collection1
[junit4:junit4]   2> 19425 T284 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 19427 T284 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 19427 T284 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 19431 T284 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1362524926008\collection1\'
[junit4:junit4]   2> 19434 T284 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1362524926008/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 19436 T284 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1362524926008/collection1/lib/README' to classloader
[junit4:junit4]   2> 19510 T284 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 19581 T284 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 19584 T284 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 19594 T284 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 20384 T284 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 20409 T284 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 20413 T284 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 20458 T284 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 20468 T284 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 20478 T284 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 20482 T284 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 20484 T284 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 20484 T284 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 20492 T284 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 20492 T284 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 20494 T284 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1362524926008\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398/jetty3\
[junit4:junit4]   2> 20494 T284 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c95648d
[junit4:junit4]   2> 20495 T284 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 20497 T284 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty3 forceNew:false
[junit4:junit4]   2> 20498 T284 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty3
[junit4:junit4]   2> 20498 T284 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398/jetty3\index/
[junit4:junit4]   2> 20501 T284 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty3\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 20501 T284 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty3\index forceNew:false
[junit4:junit4]   2> 20519 T284 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty3\index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 20520 T284 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 20521 T284 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty3\index
[junit4:junit4]   2> 20524 T284 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 20525 T284 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 20526 T284 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 20527 T284 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 20528 T284 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 20528 T284 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 20528 T284 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 20529 T284 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 20530 T284 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 20541 T284 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 20551 T284 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty3
[junit4:junit4]   2> 20554 T284 oass.SolrIndexSearcher.<init> Opening Searcher@7ac7c9cc main
[junit4:junit4]   2> 20556 T284 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 20556 T284 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 20563 T285 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7ac7c9cc main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 20567 T284 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 20567 T284 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 20648 T230 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 20650 T230 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:64288_o_xi",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:64288/o_xi"}
[junit4:junit4]   2> 20650 T230 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4]   2> 20651 T230 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4:junit4]   2> 20664 T283 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 20665 T229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 20665 T249 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 20666 T265 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 20664 T236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 21571 T284 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 21571 T284 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:64288/o_xi collection:collection1 shard:shard3
[junit4:junit4]   2> 21574 T284 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4:junit4]   2> 21592 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c95000a type:delete cxid:0x47 zxid:0xa0 txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard3 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard3
[junit4:junit4]   2> 21594 T284 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 21595 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c95000a type:create cxid:0x48 zxid:0xa1 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 21600 T284 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 21601 T284 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 21601 T284 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:64288/o_xi/collection1/
[junit4:junit4]   2> 21601 T284 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 21602 T284 oasc.SyncStrategy.syncToMe http://127.0.0.1:64288/o_xi/collection1/ has no replicas
[junit4:junit4]   2> 21602 T284 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:64288/o_xi/collection1/
[junit4:junit4]   2> 21602 T284 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4:junit4]   2> 21610 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c95000a type:create cxid:0x51 zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 22184 T230 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 22208 T283 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 22210 T229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 22210 T249 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 22211 T265 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 22212 T236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 22225 T284 oasc.ZkController.register We are http://127.0.0.1:64288/o_xi/collection1/ and leader is http://127.0.0.1:64288/o_xi/collection1/
[junit4:junit4]   2> 22225 T284 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:64288/o_xi
[junit4:junit4]   2> 22226 T284 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 22227 T284 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 22227 T284 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 22234 T284 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 22236 T207 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 22236 T207 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 22237 T207 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 22653 T207 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 22656 T207 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:64297
[junit4:junit4]   2> 22657 T207 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 22658 T207 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 22658 T207 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1362524930634
[junit4:junit4]   2> 22659 T207 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1362524930634\solr.xml
[junit4:junit4]   2> 22659 T207 oasc.CoreContainer.<init> New CoreContainer 934454317
[junit4:junit4]   2> 22660 T207 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1362524930634\'
[junit4:junit4]   2> 22660 T207 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1362524930634\'
[junit4:junit4]   2> 22719 T207 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 22720 T207 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 22720 T207 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 22721 T207 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 22721 T207 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 22722 T207 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 22722 T207 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 22722 T207 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 22723 T207 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 22723 T207 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 22739 T207 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 22763 T207 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:64251/solr
[junit4:junit4]   2> 22763 T207 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 22764 T207 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:64251 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@2601cad
[junit4:junit4]   2> 22766 T207 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 22767 T296 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:64251. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 22768 T296 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:64251, initiating session
[junit4:junit4]   2> 22768 T209 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:64302
[junit4:junit4]   2> 22769 T209 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:64302
[junit4:junit4]   2> 22783 T211 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3cd02c95000b with negotiated timeout 20000 for client /127.0.0.1:64302
[junit4:junit4]   2> 22783 T296 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:64251, sessionid = 0x13d3cd02c95000b, negotiated timeout = 20000
[junit4:junit4]   2> 22783 T297 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2601cad name:ZooKeeperConnection Watcher:127.0.0.1:64251 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 22784 T207 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 22786 T212 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d3cd02c95000b
[junit4:junit4]   2> 22789 T207 oaz.ZooKeeper.close Session: 0x13d3cd02c95000b closed
[junit4:junit4]   2> 22789 T297 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 22789 T209 oazs.NIOServerCnxn.doIO WARNING caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13d3cd02c95000b, likely client has closed socket
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 
[junit4:junit4]   2> 22789 T207 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 22790 T209 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:64302 which had sessionid 0x13d3cd02c95000b
[junit4:junit4]   2> 22797 T207 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:64251/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@645ed3b1
[junit4:junit4]   2> 22799 T207 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 22799 T298 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:64251. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 22800 T298 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:64251, initiating session
[junit4:junit4]   2> 22800 T209 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:64305
[junit4:junit4]   2> 22800 T209 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:64305
[junit4:junit4]   2> 22802 T211 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3cd02c95000c with negotiated timeout 20000 for client /127.0.0.1:64305
[junit4:junit4]   2> 22802 T298 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:64251, sessionid = 0x13d3cd02c95000c, negotiated timeout = 20000
[junit4:junit4]   2> 22803 T299 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@645ed3b1 name:ZooKeeperConnection Watcher:127.0.0.1:64251/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 22803 T207 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 22805 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c95000c type:create cxid:0x1 zxid:0xb1 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 22808 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c95000c type:create cxid:0x2 zxid:0xb2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 22813 T207 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 23731 T230 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 23733 T230 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":"shard3",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:64288_o_xi",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:64288/o_xi"}
[junit4:junit4]   2> 23748 T283 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 23749 T299 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 23750 T229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 23751 T249 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 23752 T265 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 23754 T236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 23821 T207 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64297_o_xi
[junit4:junit4]   2> 23822 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c95000c type:delete cxid:0xb zxid:0xb7 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:64297_o_xi Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:64297_o_xi
[junit4:junit4]   2> 23825 T207 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64297_o_xi
[junit4:junit4]   2> 23830 T249 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 23832 T299 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 23832 T299 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23833 T283 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 23833 T283 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23833 T229 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 23833 T229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23835 T265 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 23835 T265 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23837 T236 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 23838 T236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23840 T249 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 23851 T300 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1362524930634\collection1
[junit4:junit4]   2> 23851 T300 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 23852 T300 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 23853 T300 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 23856 T300 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1362524930634\collection1\'
[junit4:junit4]   2> 23857 T300 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1362524930634/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 23858 T300 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1362524930634/collection1/lib/README' to classloader
[junit4:junit4]   2> 23919 T300 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 23987 T300 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 23990 T300 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 24000 T300 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 24695 T300 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 24709 T300 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 24712 T300 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 24744 T300 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 24751 T300 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 24757 T300 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 24759 T300 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 24765 T300 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 24765 T300 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 24768 T300 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 24768 T300 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 24769 T300 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1362524930634\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398/jetty4\
[junit4:junit4]   2> 24773 T300 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c95648d
[junit4:junit4]   2> 24773 T300 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 24775 T300 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty4 forceNew:false
[junit4:junit4]   2> 24776 T300 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty4
[junit4:junit4]   2> 24776 T300 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398/jetty4\index/
[junit4:junit4]   2> 24777 T300 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty4\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 24777 T300 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty4\index forceNew:false
[junit4:junit4]   2> 24820 T300 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty4\index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 24820 T300 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 24821 T300 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty4\index
[junit4:junit4]   2> 24825 T300 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 24826 T300 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 24826 T300 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 24827 T300 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 24828 T300 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 24828 T300 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 24828 T300 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 24829 T300 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 24830 T300 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 24840 T300 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 24851 T300 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty4
[junit4:junit4]   2> 24854 T300 oass.SolrIndexSearcher.<init> Opening Searcher@643f226a main
[junit4:junit4]   2> 24855 T300 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 24855 T300 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 24867 T300 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty4
[junit4:junit4]   2> 24870 T300 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 24870 T300 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 24873 T301 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@643f226a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 25268 T230 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 25270 T230 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:64297_o_xi",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:64297/o_xi"}
[junit4:junit4]   2> 25270 T230 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4]   2> 25270 T230 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 25281 T283 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 25281 T236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 25281 T249 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 25281 T299 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 25281 T229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 25282 T265 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 25877 T300 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 25877 T300 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:64297/o_xi collection:collection1 shard:shard1
[junit4:junit4]   2> 25888 T300 oasc.ZkController.register We are http://127.0.0.1:64297/o_xi/collection1/ and leader is http://127.0.0.1:64270/o_xi/collection1/
[junit4:junit4]   2> 25889 T300 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:64297/o_xi
[junit4:junit4]   2> 25889 T300 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 25890 T300 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C6 name=collection1 org.apache.solr.core.SolrCore@743e5fdd url=http://127.0.0.1:64297/o_xi/collection1 node=127.0.0.1:64297_o_xi C6_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:64297_o_xi, base_url=http://127.0.0.1:64297/o_xi}
[junit4:junit4]   2> 25898 T302 C6 P64297 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 25900 T302 C6 P64297 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 25900 T300 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 25900 T302 C6 P64297 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 25901 T302 C6 P64297 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 25903 T207 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4:junit4]   2> 25904 T207 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 25904 T302 C6 P64297 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 25904 T207 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 26268 T207 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 26271 T207 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:64307
[junit4:junit4]   2> 26272 T207 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 26273 T207 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 26273 T207 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1362524934303
[junit4:junit4]   2> 26273 T207 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1362524934303\solr.xml
[junit4:junit4]   2> 26274 T207 oasc.CoreContainer.<init> New CoreContainer 570042655
[junit4:junit4]   2> 26275 T207 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1362524934303\'
[junit4:junit4]   2> 26275 T207 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1362524934303\'
[junit4:junit4]   2> 26329 T207 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4]   2> 26329 T207 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 26330 T207 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 26330 T207 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 26331 T207 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 26331 T207 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 26331 T207 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 26332 T207 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 26332 T207 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 26333 T207 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   2> 26347 T207 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 26373 T207 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:64251/solr
[junit4:junit4]   2> 26374 T207 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 26374 T207 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:64251 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@e9bcd6e
[junit4:junit4]   2> 26376 T207 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 26377 T313 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:64251. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 26378 T313 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:64251, initiating session
[junit4:junit4]   2> 26378 T209 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:64312
[junit4:junit4]   2> 26379 T209 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:64312
[junit4:junit4]   2> 26390 T313 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:64251, sessionid = 0x13d3cd02c95000d, negotiated timeout = 20000
[junit4:junit4]   2> 26392 T211 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3cd02c95000d with negotiated timeout 20000 for client /127.0.0.1:64312
[junit4:junit4]   2> 26400 T314 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e9bcd6e name:ZooKeeperConnection Watcher:127.0.0.1:64251 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 26400 T207 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 26403 T212 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d3cd02c95000d
[junit4:junit4]   2> 26408 T209 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:64312 which had sessionid 0x13d3cd02c95000d
[junit4:junit4]   2> 26408 T207 oaz.ZooKeeper.close Session: 0x13d3cd02c95000d closed
[junit4:junit4]   2> 26410 T314 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 26411 T207 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   2> 26416 T207 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:64251/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1131c015
[junit4:junit4]   2> 26418 T207 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 26419 T315 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:64251. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 26420 T315 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:64251, initiating session
[junit4:junit4]   2> 26420 T209 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:64315
[junit4:junit4]   2> 26421 T209 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:64315
[junit4:junit4]   2> 26426 T211 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3cd02c95000e with negotiated timeout 20000 for client /127.0.0.1:64315
[junit4:junit4]   2> 26426 T315 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:64251, sessionid = 0x13d3cd02c95000e, negotiated timeout = 20000
[junit4:junit4]   2> 26427 T316 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1131c015 name:ZooKeeperConnection Watcher:127.0.0.1:64251/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 26427 T207 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 26429 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c95000e type:create cxid:0x1 zxid:0xc4 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 26431 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c95000e type:create cxid:0x2 zxid:0xc5 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 26435 T207 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 26795 T230 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 26796 T230 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core_node_name":null,
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:64297_o_xi",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:64297/o_xi"}
[junit4:junit4]   2> 26809 T316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 26809 T283 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 26810 T236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 26810 T265 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 26810 T249 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 26809 T299 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 26809 T229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 27440 T207 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64307_o_xi
[junit4:junit4]   2> 27441 T212 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3cd02c95000e type:delete cxid:0xb zxid:0xca txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:64307_o_xi Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:64307_o_xi
[junit4:junit4]   2> 27446 T207 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64307_o_xi
[junit4:junit4]   2> 27453 T249 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 27453 T316 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 27455 T236 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 27456 T236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 27460 T283 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 27460 T283 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 27460 T265 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 27463 T265 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 27460 T299 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 27464 T299 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 27460 T229 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 27465 T229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4]   2> 27464 T316 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 27467 T249 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 27478 T317 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1362524934303\collection1
[junit4:junit4]   2> 27478 T317 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 27480 T317 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 27480 T317 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 27484 T317 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1362524934303\collection1\'
[junit4:junit4]   2> 27485 T317 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1362524934303/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 27486 T317 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1362524934303/collection1/lib/README' to classloader
[junit4:junit4]   2> 27545 T317 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 27614 T317 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 27617 T317 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 27625 T317 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 28343 T317 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 28363 T317 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 28367 T317 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 28416 T317 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 28430 T317 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 28437 T317 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 28439 T317 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 28440 T317 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 28440 T317 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 28443 T317 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4]   2> 28443 T317 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4]   2> 28444 T317 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1362524934303\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398/jetty5\
[junit4:junit4]   2> 28444 T317 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3c95648d
[junit4:junit4]   2> 28445 T317 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4]   2> 28446 T317 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty5 forceNew:false
[junit4:junit4]   2> 28447 T317 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty5
[junit4:junit4]   2> 28447 T317 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398/jetty5\index/
[junit4:junit4]   2> 28448 T317 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty5\index' doesn't exist. Creating new index...
[junit4:junit4]   2> 28449 T317 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty5\index forceNew:false
[junit4:junit4]   2> 28460 T317 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty5\index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 28461 T317 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 28462 T317 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty5\index
[junit4:junit4]   2> 28466 T317 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 28466 T317 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 28467 T317 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 28467 T317 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 28468 T317 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 28468 T317 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 28468 T317 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 28469 T317 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 28470 T317 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 28480 T317 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 28488 T317 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty5
[junit4:junit4]   2> 28490 T317 oass.SolrIndexSearcher.<init> Opening Searcher@35ace71b main
[junit4:junit4]   2> 28492 T317 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 28492 T317 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 28499 T318 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@35ace71b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 28502 T317 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 28503 T317 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2>  C6_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:64297_o_xi, base_url=http://127.0.0.1:64297/o_xi}
[junit4:junit4]   2> 28930 T302 C6 P64297 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:64270/o_xi/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 28944 T302 C6 P64297 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 28969 T302 C6 P64297 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:64297/o_xi START replicas=[http://127.0.0.1:64270/o_xi/collection1/] nUpdates=100
[junit4:junit4]   2> 28983 T302 C6 P64297 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 28985 T302 C6 P64297 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 28985 T302 C6 P64297 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 28985 T302 C6 P64297 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 28986 T302 C6 P64297 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 28986 T302 C6 P64297 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:64270/o_xi/collection1/. core=collection1
[junit4:junit4]   2> 28986 T302 C6 P64297 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C7 name=collection1 org.apache.solr.core.SolrCore@3a08d4b6 url=http://127.0.0.1:64270/o_xi/collection1 node=127.0.0.1:64270_o_xi C7_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:64270_o_xi, base_url=http://127.0.0.1:64270/o_xi, leader=true}
[junit4:junit4]   2> 29003 T242 C7 P64270 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1 
[junit4:junit4]   2> 29012 T240 C7 P64270 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   2> 29013 T240 C7 P64270 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty1
[junit4:junit4]   2> 29021 T240 C7 P64270 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty1\index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 29023 T240 C7 P64270 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 29032 T240 C7 P64270 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty1\index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty1\index,segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 29033 T240 C7 P64270 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 29036 T240 C7 P64270 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty1
[junit4:junit4]   2> 29037 T240 C7 P64270 oass.SolrIndexSearcher.<init> Opening Searcher@761411f7 realtime
[junit4:junit4]   2> 29038 T240 C7 P64270 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 29038 T240 C7 P64270 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 28
[junit4:junit4]   2> 29119 T302 C6 P64297 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 29120 T302 C6 P64297 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 29143 T302 C6 P64297 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 29148 T243 C7 P64270 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 29149 T243 C7 P64270 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=3 
[junit4:junit4]   2> 29151 T302 C6 P64297 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 29151 T302 C6 P64297 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 29152 T302 C6 P64297 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 29155 T245 C7 P64270 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty1
[junit4:junit4]   2> 29157 T245 C7 P64270 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty1\index
[junit4:junit4]   2> 29158 T245 C7 P64270 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=2 
[junit4:junit4]   2> 29159 T302 C6 P64297 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 29163 T302 C6 P64297 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty4\index.20130306070857548 forceNew:false
[junit4:junit4]   2> 29165 T302 C6 P64297 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty4
[junit4:junit4]   2> 29166 T302 C6 P64297 oash.SnapPuller.fetchLatestIndex Starting download to org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty4\index.20130306070857548 lockFactory=org.apache.lucene.store.NativeFSLockFactory@17e27653 fullCopy=false
[junit4:junit4]   2> 29197 T241 C7 P64270 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=6 
[junit4:junit4]   2> 29217 T302 C6 P64297 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty4\index
[junit4:junit4]   2> 29218 T302 C6 P64297 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 29221 T302 C6 P64297 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty4
[junit4:junit4]   2> 29224 T302 C6 P64297 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty4
[junit4:junit4]   2> 29224 T302 C6 P64297 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 29224 T302 C6 P64297 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 29225 T302 C6 P64297 oasc.CachingDirectoryFactory.close Releasing directory:C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty4
[junit4:junit4]   2> 29235 T302 C6 P64297 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty4\index,segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1362524908398\jetty4\index,segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 29236 T302 C6 P64297 o

[...truncated too long message...]

T577 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 162692 T209 oazs.NIOServerCnxnFactory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 162693 T577 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 162697 T207 oazs.ZooKeeperServer.shutdown shutting down
[junit4:junit4]   2> 162697 T207 oazs.SessionTrackerImpl.shutdown Shutting down
[junit4:junit4]   2> 162697 T207 oazs.PrepRequestProcessor.shutdown Shutting down
[junit4:junit4]   2> 162697 T207 oazs.SyncRequestProcessor.shutdown Shutting down
[junit4:junit4]   2> 162697 T207 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4]   1> safe stop:
[junit4:junit4]   1> safe stop:
[junit4:junit4]   2> 162702 T207 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 162709 T206 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4:junit4]   2> 182898 T206 ccr.ThreadLeakControl.checkThreadLeaks SEVERE 1 thread leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest: 
[junit4:junit4]   2> 	   1) Thread[id=430, name=TEST-ChaosMonkeySafeLeaderTest.testDistribSearch-seed#[5F805F8FB5346F4F]-EventThread, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4:junit4]   2> 	        at java.lang.Thread.sleep(Native Method)
[junit4:junit4]   2> 	        at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:428)
[junit4:junit4]   2> 	        at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:404)
[junit4:junit4]   2> 	        at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:833)
[junit4:junit4]   2> 	        at org.apache.solr.cloud.ZkController.register(ZkController.java:766)
[junit4:junit4]   2> 	        at org.apache.solr.cloud.ZkController$1.command(ZkController.java:212)
[junit4:junit4]   2> 	        at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 	        at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 	        at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 	        at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 	        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 182899 T206 ccr.ThreadLeakControl.tryToInterruptAll Starting to interrupt leaked threads:
[junit4:junit4]   2> 	   1) Thread[id=430, name=TEST-ChaosMonkeySafeLeaderTest.testDistribSearch-seed#[5F805F8FB5346F4F]-EventThread, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4:junit4]   2> 182900 T430 oasc.ZkController.getLeader SEVERE Error getting leader from zk java.lang.InterruptedException: sleep interrupted
[junit4:junit4]   2> 	at java.lang.Thread.sleep(Native Method)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:428)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:404)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:833)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ZkController.register(ZkController.java:766)
[junit4:junit4]   2> 	at org.apache.solr.cloud.ZkController$1.command(ZkController.java:212)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 
[junit4:junit4]   2> 182900 T430 oasc.SolrException.log SEVERE Error registering SolrCore:org.apache.solr.common.SolrException: Error getting leader from zk
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:854)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.register(ZkController.java:766)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:212)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	Caused by: java.lang.InterruptedException: sleep interrupted
[junit4:junit4]   2> 		at java.lang.Thread.sleep(Native Method)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:428)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:404)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:833)
[junit4:junit4]   2> 		... 7 more
[junit4:junit4]   2> 	
[junit4:junit4]   2> 182901 T430 oascc.DefaultConnectionStrategy.reconnect Reconnected to ZooKeeper
[junit4:junit4]   2> 182901 T430 oascc.ConnectionManager.process Connected:true
[junit4:junit4]   2> 182901 T430 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 182902 T206 ccr.ThreadLeakControl.tryToInterruptAll All leaked threads terminated.
[junit4:junit4]   2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=425), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=425)), sim=DefaultSimilarity, locale=en_MT, timezone=Asia/Macau
[junit4:junit4]   2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.7.0_15 (64-bit)/cpus=2,threads=1,free=25102072,total=83910656
[junit4:junit4]   2> NOTE: All tests run in this JVM: [DefaultValueUpdateProcessorTest, TestCodecSupport, ScriptEngineTest, SolrCmdDistributorTest, TestPseudoReturnFields, ChaosMonkeySafeLeaderTest]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=5F805F8FB5346F4F -Dtests.slow=true -Dtests.locale=en_MT -Dtests.timezone=Asia/Macau -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] ERROR   0.00s | ChaosMonkeySafeLeaderTest (suite) <<<
[junit4:junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest: 
[junit4:junit4]    >    1) Thread[id=430, name=TEST-ChaosMonkeySafeLeaderTest.testDistribSearch-seed#[5F805F8FB5346F4F]-EventThread, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4:junit4]    >         at java.lang.Thread.sleep(Native Method)
[junit4:junit4]    >         at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:428)
[junit4:junit4]    >         at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:404)
[junit4:junit4]    >         at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:833)
[junit4:junit4]    >         at org.apache.solr.cloud.ZkController.register(ZkController.java:766)
[junit4:junit4]    >         at org.apache.solr.cloud.ZkController$1.command(ZkController.java:212)
[junit4:junit4]    >         at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]    >         at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]    >         at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([5F805F8FB5346F4F]:0)
[junit4:junit4] Completed in 182.97s, 1 test, 1 error <<< FAILURES!

[...truncated 802 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:381: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:361: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:183: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:449: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1213: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:877: There were test failures: 261 suites, 1105 tests, 1 suite-level error, 18 ignored (12 assumptions)

Total time: 58 minutes 17 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.7.0_15 -XX:+UseConcMarkSweepGC
Email was triggered for: Failure
Sending email for trigger: Failure