You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/11/24 14:05:47 UTC

[JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_45) - Build # 3424 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/3424/
Java: 32bit/jdk1.7.0_45 -server -XX:+UseSerialGC

3 tests failed.
FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
Expected content type application/octet-stream but got text/html;charset=ISO-8859-1. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 404 Can not find: /e_jm/wc/onenodecollectioncore/update</title> </head> <body> <h2>HTTP ERROR: 404</h2> <p>Problem accessing /e_jm/wc/onenodecollectioncore/update. Reason: <pre>    Can not find: /e_jm/wc/onenodecollectioncore/update</pre></p> <hr /><i><small>Powered by Jetty://</small></i>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected content type application/octet-stream but got text/html;charset=ISO-8859-1. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 Can not find: /e_jm/wc/onenodecollectioncore/update</title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /e_jm/wc/onenodecollectioncore/update. Reason:
<pre>    Can not find: /e_jm/wc/onenodecollectioncore/update</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
</body>
</html>

	at __randomizedtesting.SeedInfo.seed([84C2DF30CE2BC6A:89AAA3EB7BBDDC56]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:455)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:197)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:88)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
	at sun.reflect.GeneratedMethodAccessor53.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)


FAILED:  org.apache.solr.cloud.CustomCollectionTest.testDistribSearch

Error Message:
collection already exists: routeFieldColl

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: collection already exists: routeFieldColl
	at __randomizedtesting.SeedInfo.seed([84C2DF30CE2BC6A:89AAA3EB7BBDDC56]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:491)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:197)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:285)
	at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:640)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1599)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1561)
	at org.apache.solr.cloud.CustomCollectionTest.testRouteFieldForHashRouter(CustomCollectionTest.java:380)
	at org.apache.solr.cloud.CustomCollectionTest.doTest(CustomCollectionTest.java:134)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)


FAILED:  org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch

Error Message:
Still found shard2 in collection test_unload_shard_and_collection

Stack Trace:
java.lang.AssertionError: Still found shard2 in collection test_unload_shard_and_collection
	at __randomizedtesting.SeedInfo.seed([84C2DF30CE2BC6A:89AAA3EB7BBDDC56]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:128)
	at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:78)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
	at sun.reflect.GeneratedMethodAccessor53.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)




Build Log:
[...truncated 10086 lines...]
   [junit4] Suite: org.apache.solr.cloud.CustomCollectionTest
   [junit4]   2> 207518 T544 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /hbudp/
   [junit4]   2> 207529 T544 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-CustomCollectionTest-1385294940200
   [junit4]   2> 207532 T544 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 207535 T545 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 207661 T544 oasc.ZkTestServer.run start zk server on port:59300
   [junit4]   2> 207664 T544 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 207671 T551 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16d68bb name:ZooKeeperConnection Watcher:127.0.0.1:59300 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 207672 T544 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 207672 T544 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 207696 T544 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 207704 T553 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@77914d name:ZooKeeperConnection Watcher:127.0.0.1:59300/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 207704 T544 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 207704 T544 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 207718 T544 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 207725 T544 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 207731 T544 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 207740 T544 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 207740 T544 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 207753 T544 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 207753 T544 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 207763 T544 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 207763 T544 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 207777 T544 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 207777 T544 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 207788 T544 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 207789 T544 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 207796 T544 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 207798 T544 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 207808 T544 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 207808 T544 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 207817 T544 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 207817 T544 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 207827 T544 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 207827 T544 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 207836 T544 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 207837 T544 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 207846 T544 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 207847 T544 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 208512 T544 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 208541 T544 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59307
   [junit4]   2> 208542 T544 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 208542 T544 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 208542 T544 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.CustomCollectionTest-controljetty-1385294940526
   [junit4]   2> 208542 T544 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.CustomCollectionTest-controljetty-1385294940526\'
   [junit4]   2> 208584 T544 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-controljetty-1385294940526\solr.xml
   [junit4]   2> 208700 T544 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 208700 T544 oasc.CoreContainer.<init> New CoreContainer 23447367
   [junit4]   2> 208700 T544 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.CustomCollectionTest-controljetty-1385294940526\]
   [junit4]   2> 208702 T544 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 208702 T544 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 208702 T544 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 208702 T544 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 208702 T544 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 208702 T544 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 208702 T544 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 208706 T544 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 208706 T544 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 208717 T544 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 208717 T544 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 208717 T544 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 208717 T544 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59300/solr
   [junit4]   2> 208717 T544 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 208722 T544 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 208732 T564 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@177f2cb name:ZooKeeperConnection Watcher:127.0.0.1:59300 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 208733 T544 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 208739 T546 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1428a0348370002, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 208740 T544 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 208744 T566 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@142a24c name:ZooKeeperConnection Watcher:127.0.0.1:59300/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 208745 T544 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 208749 T544 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 208759 T544 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 208766 T544 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 208771 T544 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59307_hbudp
   [junit4]   2> 208773 T544 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59307_hbudp
   [junit4]   2> 208782 T544 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 208793 T544 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 208800 T544 oasc.Overseer.start Overseer (id=90786689201930243-127.0.0.1:59307_hbudp-n_0000000000) starting
   [junit4]   2> 208809 T544 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 208819 T568 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 208821 T544 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 208827 T544 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 208832 T544 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 208838 T567 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 208845 T544 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-controljetty-1385294940526
   [junit4]   2> 209157 T544 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-controljetty-1385294940526\conf\
   [junit4]   2> 209172 T544 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 209173 T544 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 209173 T544 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 209181 T544 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 209186 T571 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1334182 name:ZooKeeperConnection Watcher:127.0.0.1:59300/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 209187 T544 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 209192 T544 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 209202 T544 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 209844 T544 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 209850 T544 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59319
   [junit4]   2> 209853 T544 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 209853 T544 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 209853 T544 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty1-1385294941870
   [junit4]   2> 209855 T544 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty1-1385294941870\'
   [junit4]   2> 209890 T544 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty1-1385294941870\solr.xml
   [junit4]   2> 210006 T544 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 210006 T544 oasc.CoreContainer.<init> New CoreContainer 14123760
   [junit4]   2> 210007 T544 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty1-1385294941870\]
   [junit4]   2> 210010 T544 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 210010 T544 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 210010 T544 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 210011 T544 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 210011 T544 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 210011 T544 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 210012 T544 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 210012 T544 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 210012 T544 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 210026 T544 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 210026 T544 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 210027 T544 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 210027 T544 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59300/solr
   [junit4]   2> 210027 T544 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 210030 T544 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 210040 T582 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1292694 name:ZooKeeperConnection Watcher:127.0.0.1:59300 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 210043 T544 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 210051 T544 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 210057 T584 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ebcdda name:ZooKeeperConnection Watcher:127.0.0.1:59300/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 210057 T544 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 210070 T544 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 211338 T544 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59319_hbudp
   [junit4]   2> 211345 T544 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59319_hbudp
   [junit4]   2> 211367 T584 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 211369 T571 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 211372 T566 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 211402 T544 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty1-1385294941870
   [junit4]   2> 211689 T544 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty1-1385294941870\conf\
   [junit4]   2> 211703 T544 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 211707 T544 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 211707 T544 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 212359 T544 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 212365 T544 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59328
   [junit4]   2> 212368 T544 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 212368 T544 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 212368 T544 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty2-1385294944379
   [junit4]   2> 212368 T544 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty2-1385294944379\'
   [junit4]   2> 212402 T544 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty2-1385294944379\solr.xml
   [junit4]   2> 212516 T544 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 212516 T544 oasc.CoreContainer.<init> New CoreContainer 27131288
   [junit4]   2> 212518 T544 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty2-1385294944379\]
   [junit4]   2> 212519 T544 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 212520 T544 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 212520 T544 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 212520 T544 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 212521 T544 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 212521 T544 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 212521 T544 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 212521 T544 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 212522 T544 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 212535 T544 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 212536 T544 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 212536 T544 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 212536 T544 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59300/solr
   [junit4]   2> 212537 T544 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 212540 T544 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 212557 T596 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11b869 name:ZooKeeperConnection Watcher:127.0.0.1:59300 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 212558 T544 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 212565 T544 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 212570 T598 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1520b33 name:ZooKeeperConnection Watcher:127.0.0.1:59300/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 212572 T544 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 212581 T544 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 213847 T544 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59328_hbudp
   [junit4]   2> 213850 T544 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59328_hbudp
   [junit4]   2> 213864 T598 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 213867 T584 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 213867 T566 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 213867 T571 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 213890 T544 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty2-1385294944379
   [junit4]   2> 214208 T544 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty2-1385294944379\conf\
   [junit4]   2> 214223 T544 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 214224 T544 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 214226 T544 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 214865 T544 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 214873 T544 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59337
   [junit4]   2> 214876 T544 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 214877 T544 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 214877 T544 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.CustomCollectionTest-jetty3-1385294946900
   [junit4]   2> 214877 T544 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.CustomCollectionTest-jetty3-1385294946900\'
   [junit4]   2> 214915 T544 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty3-1385294946900\solr.xml
   [junit4]   2> 215038 T544 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 215038 T544 oasc.CoreContainer.<init> New CoreContainer 1467151
   [junit4]   2> 215039 T544 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.CustomCollectionTest-jetty3-1385294946900\]
   [junit4]   2> 215041 T544 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 215041 T544 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 215043 T544 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 215043 T544 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 215043 T544 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 215044 T544 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 215044 T544 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 215044 T544 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 215045 T544 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 215059 T544 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 215060 T544 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 215060 T544 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 215060 T544 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59300/solr
   [junit4]   2> 215061 T544 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 215064 T544 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 215107 T610 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f30d36 name:ZooKeeperConnection Watcher:127.0.0.1:59300 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 215108 T544 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 215116 T546 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1428a0348370009, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 215119 T544 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 215124 T612 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1523d21 name:ZooKeeperConnection Watcher:127.0.0.1:59300/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 215124 T544 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 215139 T544 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 216423 T544 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59337_hbudp
   [junit4]   2> 216428 T544 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59337_hbudp
   [junit4]   2> 216447 T598 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 216448 T584 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 216450 T566 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 216454 T571 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 216455 T612 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 216496 T544 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty3-1385294946900
   [junit4]   2> 216833 T544 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty3-1385294946900\conf\
   [junit4]   2> 216851 T544 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 216852 T544 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 216852 T544 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 217650 T544 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 217661 T544 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59346
   [junit4]   2> 217662 T544 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 217662 T544 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 217662 T544 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty4-1385294949527
   [junit4]   2> 217662 T544 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty4-1385294949527\'
   [junit4]   2> 217698 T544 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty4-1385294949527\solr.xml
   [junit4]   2> 217817 T544 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 217819 T544 oasc.CoreContainer.<init> New CoreContainer 15914837
   [junit4]   2> 217819 T544 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty4-1385294949527\]
   [junit4]   2> 217821 T544 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 217821 T544 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 217821 T544 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 217823 T544 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 217823 T544 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 217823 T544 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 217824 T544 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 217824 T544 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 217824 T544 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 217839 T544 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 217840 T544 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 217840 T544 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 217840 T544 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59300/solr
   [junit4]   2> 217842 T544 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 217846 T544 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 217862 T624 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1057ce1 name:ZooKeeperConnection Watcher:127.0.0.1:59300 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 217862 T544 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 217869 T546 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1428a034837000b, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 217871 T544 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 217875 T626 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2e9d9f name:ZooKeeperConnection Watcher:127.0.0.1:59300/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 217877 T544 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 217888 T544 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 219281 T544 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59346_hbudp
   [junit4]   2> 219284 T544 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59346_hbudp
   [junit4]   2> 219295 T571 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 219297 T612 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 219297 T598 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 219297 T566 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 219299 T584 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 219300 T626 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 219342 T544 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty4-1385294949527
   [junit4]   2> 219707 T544 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty4-1385294949527\conf\
   [junit4]   2> 219731 T544 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 219733 T544 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 219733 T544 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 219742 T544 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 219749 T629 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11f9377 name:ZooKeeperConnection Watcher:127.0.0.1:59300/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 219750 T544 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 219754 T544 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 219768 T544 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 219776 T631 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@954c48 name:ZooKeeperConnection Watcher:127.0.0.1:59300/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 219776 T544 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 219781 T544 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 219795 T577 oasha.CollectionsHandler.handleCreateAction Creating Collection : name=implicitcoll0&router.name=implicit&wt=javabin&maxShardsPerNode=2&action=CREATE&version=2&replicationFactor=2&shards=a,b,c
   [junit4]   2> 219799 T566 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 219806 T566 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 219808 T568 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"implicitcoll0",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "maxShardsPerNode":"2",
   [junit4]   2> 	  "shards":"a,b,c",
   [junit4]   2> 	  "router.name":"implicit"}
   [junit4]   2> 219808 T568 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"implicitcoll0",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "maxShardsPerNode":"2",
   [junit4]   2> 	  "shards":"a,b,c",
   [junit4]   2> 	  "router.name":"implicit"}
   [junit4]   2> 219823 T566 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 219829 T567 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 219831 T567 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: implicitcoll0
   [junit4]   2> 219831 T567 oasc.Overseer$ClusterStateUpdater.createCollection Create collection implicitcoll0 with shards [a, b, c]
   [junit4]   2> 219838 T566 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 219843 T566 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 219843 T612 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 219845 T598 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 219845 T626 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 219845 T584 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 219846 T631 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 219846 T571 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 219846 T629 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 219964 T568 oasc.OverseerCollectionProcessor.createCollection going to create cores replicas shardNames [a, b, c] , repFactor : 2
   [junit4]   2> 219964 T568 oasc.OverseerCollectionProcessor.createCollection Creating shard implicitcoll0_a_replica1 as part of slice a of collection implicitcoll0 on 127.0.0.1:59319_hbudp
   [junit4]   2> 219965 T568 oasc.OverseerCollectionProcessor.createCollection Creating shard implicitcoll0_a_replica2 as part of slice a of collection implicitcoll0 on 127.0.0.1:59328_hbudp
   [junit4]   2> 219966 T568 oasc.OverseerCollectionProcessor.createCollection Creating shard implicitcoll0_b_replica1 as part of slice b of collection implicitcoll0 on 127.0.0.1:59337_hbudp
   [junit4]   2> 219969 T568 oasc.OverseerCollectionProcessor.createCollection Creating shard implicitcoll0_b_replica2 as part of slice b of collection implicitcoll0 on 127.0.0.1:59307_hbudp
   [junit4]   2> 219975 T568 oasc.OverseerCollectionProcessor.createCollection Creating shard implicitcoll0_c_replica1 as part of slice c of collection implicitcoll0 on 127.0.0.1:59346_hbudp
   [junit4]   2> 219977 T568 oasc.OverseerCollectionProcessor.createCollection Creating shard implicitcoll0_c_replica2 as part of slice c of collection implicitcoll0 on 127.0.0.1:59319_hbudp
   [junit4]   2> 219981 T575 oasc.ZkController.publish publishing core=implicitcoll0_a_replica1 state=down
   [junit4]   2> 219984 T591 oasc.ZkController.publish publishing core=implicitcoll0_a_replica2 state=down
   [junit4]   2> 219993 T566 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 220010 T561 oasc.ZkController.publish publishing core=implicitcoll0_b_replica2 state=down
   [junit4]   2> 219993 T575 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 219993 T591 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 220010 T606 oasc.ZkController.publish publishing core=implicitcoll0_b_replica1 state=down
   [junit4]   2> 220015 T578 oasc.ZkController.publish publishing core=implicitcoll0_c_replica2 state=down
   [junit4]   2> 220015 T621 oasc.ZkController.publish publishing core=implicitcoll0_c_replica1 state=down
   [junit4]   2> 220018 T561 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 220018 T566 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 220019 T606 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 220022 T578 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 220023 T621 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 220023 T567 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 220025 T567 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:59319/hbudp",
   [junit4]   2> 	  "core":"implicitcoll0_a_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:59319_hbudp",
   [junit4]   2> 	  "shard":"a",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"implicitcoll0",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 220038 T567 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:59328/hbudp",
   [junit4]   2> 	  "core":"implicitcoll0_a_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:59328_hbudp",
   [junit4]   2> 	  "shard":"a",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"implicitcoll0",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 220046 T566 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 220054 T567 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:59307/hbudp",
   [junit4]   2> 	  "core":"implicitcoll0_b_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:59307_hbudp",
   [junit4]   2> 	  "shard":"b",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"implicitcoll0",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 220062 T566 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 220065 T567 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:59337/hbudp",
   [junit4]   2> 	  "core":"implicitcoll0_b_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:59337_hbudp",
   [junit4]   2> 	  "shard":"b",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"implicitcoll0",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 220076 T566 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 220077 T567 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:59319/hbudp",
   [junit4]   2> 	  "core":"implicitcoll0_c_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:59319_hbudp",
   [junit4]   2> 	  "shard":"c",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"implicitcoll0",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 220087 T566 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 220091 T567 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:59346/hbudp",
   [junit4]   2> 	  "core":"implicitcoll0_c_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:59346_hbudp",
   [junit4]   2> 	  "shard":"c",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"implicitcoll0",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 220100 T566 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 220246 T629 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 220246 T631 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 220248 T571 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 220249 T626 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 220250 T598 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 220252 T612 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 220252 T584 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 220253 T566 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 221396 T575 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for implicitcoll0_a_replica1
   [junit4]   2> 221398 T591 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for implicitcoll0_a_replica2
   [junit4]   2> 221400 T575 oasc.CoreContainer.create Creating SolrCore 'implicitcoll0_a_replica1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty1-1385294941870\implicitcoll0_a_replica1
   [junit4]   2> 221400 T575 oasc.ZkController.createCollectionZkNode Check for collection zkNode:implicitcoll0
   [junit4]   2> 221402 T561 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for implicitcoll0_b_replica2
   [junit4]   2> 221403 T606 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for implicitcoll0_b_replica1
   [junit4]   2> 221403 T575 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:implicitcoll0
   [junit4]   2> 221405 T575 oasc.ZkController.getConfName Looking for collection configName
   [junit4]   2> 221406 T561 oasc.CoreContainer.create Creating SolrCore 'implicitcoll0_b_replica2' using instanceDir: .\org.apache.solr.cloud.CustomCollectionTest-controljetty-1385294940526\implicitcoll0_b_replica2
   [junit4]   2> 221406 T561 oasc.ZkController.createCollectionZkNode Check for collection zkNode:implicitcoll0
   [junit4]   2> 221406 T606 oasc.CoreContainer.create Creating SolrCore 'implicitcoll0_b_replica1' using instanceDir: .\org.apache.solr.cloud.CustomCollectionTest-jetty3-1385294946900\implicitcoll0_b_replica1
   [junit4]   2> 221407 T621 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for implicitcoll0_c_replica1
   [junit4]   2> 221409 T578 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for implicitcoll0_c_replica2
   [junit4]   2> 221409 T591 oasc.CoreContainer.create Creating SolrCore 'implicitcoll0_a_replica2' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty2-1385294944379\implicitcoll0_a_replica2
   [junit4]   2> 221410 T591 oasc.ZkController.createCollectionZkNode Check for collection zkNode:implicitcoll0
   [junit4]   2> 221413 T578 oasc.CoreContainer.create Creating SolrCore 'implicitcoll0_c_replica2' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty1-1385294941870\implicitcoll0_c_replica2
   [junit4]   2> 221413 T578 oasc.ZkController.createCollectionZkNode Check for collection zkNode:implicitcoll0
   [junit4]   2> 221409 T606 oasc.ZkController.createCollectionZkNode Check for collection zkNode:implicitcoll0
   [junit4]   2> 221413 T621 oasc.CoreContainer.create Creating SolrCore 'implicitcoll0_c_replica1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty4-1385294949527\implicitcoll0_c_replica1
   [junit4]   2> 221415 T621 oasc.ZkController.createCollectionZkNode Check for collection zkNode:implicitcoll0
   [junit4]   2> 221417 T575 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
   [junit4]   2> 221417 T578 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:implicitcoll0
   [junit4]   2> 221417 T578 oasc.ZkController.getConfName Looking for collection configName
   [junit4]   2> 221418 T621 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:implicitcoll0
   [junit4]   2> 221417 T591 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:implicitcoll0
   [junit4]   2> 221417 T561 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:implicitcoll0
   [junit4]   2> 221419 T561 oasc.ZkController.getConfName Looking for collection configName
   [junit4]   2> 221417 T575 oascc.SolrZkClient.makePath makePath: /collections/implicitcoll0
   [junit4]   2> 221421 T578 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
   [junit4]   2> 221422 T578 oascc.SolrZkClient.makePath makePath: /collections/implicitcoll0
   [junit4]   2> 221419 T591 oasc.ZkController.getConfName Looking for collection configName
   [junit4]   2> 221418 T621 oasc.ZkController.getConfName Looking for collection configName
   [junit4]   2> 221426 T561 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
   [junit4]   2> 221418 T606 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:implicitcoll0
   [junit4]   2> 221427 T606 oasc.ZkController.getConfName Looking for collection configName
   [junit4]   2> 221427 T561 oascc.SolrZkClient.makePath makePath: /collections/implicitcoll0
   [junit4]   2> 221434 T591 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
   [junit4]   2> 221434 T591 oascc.SolrZkClient.makePath makePath: /collections/implicitcoll0
   [junit4]   2> 221436 T578 oascc.ZkStateReader.readConfigName Load collection config from:/collections/implicitcoll0
   [junit4]   2> 221436 T606 oascc.SolrZkClient.makePath makePath: /collections/implicitcoll0
   [junit4]   2> 221434 T621 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
   [junit4]   2> 221437 T575 oascc.ZkStateReader.readConfigName Load collection config from:/collections/implicitcoll0
   [junit4]   2> 221438 T621 oascc.SolrZkClient.makePath makePath: /collections/implicitcoll0
   [junit4]   2> 221442 T561 oascc.ZkStateReader.readConfigName Load collection config from:/collections/implicitcoll0
   [junit4]   2> 221444 T578 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty1-1385294941870\implicitcoll0_c_replica2\'
   [junit4]   2> 221461 T575 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty1-1385294941870\implicitcoll0_a_replica1\'
   [junit4]   2> 221467 T591 oascc.ZkStateReader.readConfigName Load collection config from:/collections/implicitcoll0
   [junit4]   2> 221473 T606 oascc.ZkStateReader.readConfigName Load collection config from:/collections/implicitcoll0
   [junit4]   2> 221482 T621 oascc.ZkStateReader.readConfigName Load collection config from:/collections/implicitcoll0
   [junit4]   2> 221484 T561 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.CustomCollectionTest-controljetty-1385294940526\implicitcoll0_b_replica2\'
   [junit4]   2> 221486 T606 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.CustomCollectionTest-jetty3-1385294946900\implicitcoll0_b_replica1\'
   [junit4]   2> 221492 T621 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty4-1385294949527\implicitcoll0_c_replica1\'
   [junit4]   2> 221496 T591 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty2-1385294944379\implicitcoll0_a_replica2\'
   [junit4]   2> 221836 T578 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 221891 T575 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 222167 T578 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 222179 T621 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 222180 T578 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 222201 T591 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 222203 T606 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 222226 T578 oass.IndexSchema.readSchema [implicitcoll0_c_replica2] Schema name=test
   [junit4]   2> 222260 T575 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 222299 T561 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 222559 T575 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 222582 T606 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 222636 T606 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 222659 T606 oass.IndexSchema.readSchema [implicitcoll0_b_replica1] Schema name=test
   [junit4]   2> 222903 T575 oass.IndexSchema.readSchema [implicitcoll0_a_replica1] Schema name=test
   [junit4]   2> 223093 T561 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 223094 T621 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 223106 T621 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 223122 T561 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 223158 T621 oass.IndexSchema.readSchema [implicitcoll0_c_replica1] Schema name=test
   [junit4]   2> 223233 T561 oass.IndexSchema.readSchema [implicitcoll0_b_replica2] Schema name=test
   [junit4]   2> 223290 T591 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 223297 T591 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 223336 T591 oass.IndexSchema.readSchema [implicitcoll0_a_replica2] Schema name=test
   [junit4]   2> 226653 T606 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 226653 T606 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 226653 T606 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 226696 T606 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 226718 T606 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 226876 T578 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 226877 T578 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 226878 T578 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 226899 T578 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 226907 T578 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 227133 T575 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 227134 T575 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 227137 T575 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 227150 T575 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 227223 T575 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 227275 T606 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 227297 T578 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 227326 T606 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 227345 T578 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 227375 T606 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 227385 T606 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 227385 T606 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 227387 T606 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 227392 T606 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 227393 T606 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 227393 T606 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 227396 T606 oasc.SolrCore.<init> [implicitcoll0_b_replica1] Opening new SolrCore at .\org.apache.solr.cloud.CustomCollectionTest-jetty3-1385294946900\implicitcoll0_b_replica1\, dataDir=.\org.apache.solr.cloud.CustomCollectionTest-jetty3-1385294946900\implicitcoll0_b_replica1\data\
   [junit4]   2> 227396 T606 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e99801
   [junit4]   2> 227399 T606 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.CustomCollectionTest-jetty3-1385294946900\implicitcoll0_b_replica1\data\
   [junit4]   2> 227399 T606 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.CustomCollectionTest-jetty3-1385294946900\implicitcoll0_b_replica1\data\index/
   [junit4]   2> 227400 T606 oasc.SolrCore.initIndex WARN [implicitcoll0_b_replica1] Solr index directory '.\org.apache.solr.cloud.CustomCollectionTest-jetty3-1385294946900\implicitcoll0_b_replica1\data\index' doesn't exist. Creating new index...
   [junit4]   2> 227400 T606 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.CustomCollectionTest-jetty3-1385294946900\implicitcoll0_b_replica1\data\index
   [junit4]   2> 227403 T606 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=39, maxMergedSegmentMB=96.82421875, floorSegmentMB=0.4853515625, forceMergeDeletesPctAllowed=29.9495434612696, segmentsPerTier=21.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2919463481443688
   [junit4]   2> 227403 T606 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@4405b7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@df3a7),segFN=segments_1,generation=1}
   [junit4]   2> 227406 T578 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 227407 T606 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 227411 T575 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 227419 T578 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 227420 T578 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 227420 T578 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 227429 T606 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 227430 T606 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 227430 T606 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 227431 T606 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 227433 T606 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 227434 T606 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 227435 T606 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 227435 T578 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 227437 T578 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 227437 T578 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 227438 T578 oasc.SolrCore.<init> [implicitcoll0_c_replica2] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty1-1385294941870\implicitcoll0_c_replica2\, dataDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty1-1385294941870\implicitcoll0_c_replica2\data\
   [junit4]   2> 227445 T578 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e99801
   [junit4]   2> 227450 T606 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 227452 T606 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 227452 T578 oasc.CachingDirectoryFactory.get return new directory for ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty1-1385294941870\implicitcoll0_c_replica2\data\
   [junit4]   2> 227452 T578 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty1-1385294941870\implicitcoll0_c_replica2\data\index/
   [junit4]   2> 227453 T578 oasc.SolrCore.initIndex WARN [implicitcoll0_c_replica2] Solr index directory '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty1-1385294941870\implicitcoll0_c_replica2\data\index' doesn't exist. Creating new index...
   [junit4]   2> 227454 T578 oasc.CachingDirectoryFactory.get return new directory for ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CustomCollectionTest-jetty1-1385294941870\implicitcoll0_c_replica2\data\index
   [junit4]   2> 227456 T578 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=39, maxMergedSegmentMB=96.82421875, floorSegmentMB=0.4853515625, forceMergeDeletesPctAllowed=29.9495434612696, segmentsPerTier=21.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2919463481443688
   [junit4]   2> 227452 T606 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 227458 T606 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 227458 T606 oasc.RequestHandle

[...truncated too long message...]

>           "base": "USD",
   [junit4]   1>           "rates": {
   [junit4]   1>             "USD": 1,
   [junit4]   1>             "JPY": 81.29,
   [junit4]   1>             "EUR": 2.5,
   [junit4]   1>             "GBP": 0.5,
   [junit4]   1>             "MXN": 2.0
   [junit4]   1>           }
   [junit4]   1>         }
   [junit4]   1>         
   [junit4]   1>     /solr/configs/conf1/schema.xml (0)
   [junit4]   1>     DATA: ...supressed...
   [junit4]   1>   /solr/overseer (3)
   [junit4]   1>   DATA:
   [junit4]   1>       
   [junit4]   1>    /solr/overseer/queue-work (0)
   [junit4]   1>    /solr/overseer/collection-queue-work (0)
   [junit4]   1>    /solr/overseer/queue (0)
   [junit4]   1>   /solr/clusterstate.json (0)
   [junit4]   1>   DATA:
   [junit4]   1>       {
   [junit4]   1>         "test_unload_shard_and_collection":{
   [junit4]   1>           "autoCreated":"true",
   [junit4]   1>           "maxShardsPerNode":"1",
   [junit4]   1>           "replicationFactor":"1",
   [junit4]   1>           "shards":{"shard2":{
   [junit4]   1>               "range":"0-7fffffff",
   [junit4]   1>               "state":"active",
   [junit4]   1>               "replicas":{"core_node1":{
   [junit4]   1>                   "state":"active",
   [junit4]   1>                   "base_url":"http://127.0.0.1:62685",
   [junit4]   1>                   "core":"test_unload_shard_and_collection_1",
   [junit4]   1>                   "node_name":"127.0.0.1:62685_",
   [junit4]   1>                   "leader":"true"}}}},
   [junit4]   1>           "router":{"name":"compositeId"}},
   [junit4]   1>         "unloadcollection":{
   [junit4]   1>           "autoCreated":"true",
   [junit4]   1>           "maxShardsPerNode":"1",
   [junit4]   1>           "replicationFactor":"1",
   [junit4]   1>           "shards":{"shard1":{
   [junit4]   1>               "range":"80000000-7fffffff",
   [junit4]   1>               "state":"active",
   [junit4]   1>               "replicas":{
   [junit4]   1>                 "core_node3":{
   [junit4]   1>                   "state":"active",
   [junit4]   1>                   "base_url":"http://127.0.0.1:62703",
   [junit4]   1>                   "core":"unloadcollection3",
   [junit4]   1>                   "node_name":"127.0.0.1:62703_",
   [junit4]   1>                   "leader":"true"},
   [junit4]   1>                 "core_node4":{
   [junit4]   1>                   "state":"active",
   [junit4]   1>                   "base_url":"http://127.0.0.1:62712",
   [junit4]   1>                   "core":"unloadcollection4",
   [junit4]   1>                   "node_name":"127.0.0.1:62712_"},
   [junit4]   1>                 "core_node5":{
   [junit4]   1>                   "state":"active",
   [junit4]   1>                   "base_url":"http://127.0.0.1:62694",
   [junit4]   1>                   "core":"unloadcollection2",
   [junit4]   1>                   "node_name":"127.0.0.1:62694_"}}}},
   [junit4]   1>           "router":{"name":"compositeId"}}}
   [junit4]   1> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=UnloadDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=84C2DF30CE2BC6A -Dtests.slow=true -Dtests.locale=es_NI -Dtests.timezone=Pacific/Yap -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE  133s | UnloadDistributedZkTest.testDistribSearch <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Still found shard2 in collection test_unload_shard_and_collection
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([84C2DF30CE2BC6A:89AAA3EB7BBDDC56]:0)
   [junit4]    > 	at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:128)
   [junit4]    > 	at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:78)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 2203767 T6323 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 133547 T6322 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Lucene42, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=es_NI, timezone=Pacific/Yap
   [junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_45 (32-bit)/cpus=2,threads=1,free=117776160,total=288280576
   [junit4]   2> NOTE: All tests run in this JVM: [NotRequiredUniqueKeyTest, PrimitiveFieldTypeTest, BadIndexSchemaTest, SOLR749Test, CoreContainerCoreInitFailuresTest, TestMergePolicyConfig, SpellCheckCollatorTest, TestLazyCores, PolyFieldTest, TestFieldTypeResource, TestRandomDVFaceting, BadComponentTest, TestDistributedSearch, TestCoreDiscovery, TestCSVLoader, TestRandomMergePolicy, HdfsBasicDistributedZkTest, SolrRequestParserTest, TestShardHandlerFactory, ZkSolrClientTest, DeleteShardTest, CustomCollectionTest, ScriptEngineTest, HdfsSyncSliceTest, TestBM25SimilarityFactory, RAMDirectoryFactoryTest, DeleteInactiveReplicaTest, TestSolrCoreProperties, HighlighterTest, ShardRoutingTest, TestTrie, TestReload, TestLMJelinekMercerSimilarityFactory, MinimalSchemaTest, TestDynamicFieldCollectionResource, AssignTest, PreAnalyzedFieldTest, SpellCheckComponentTest, TestLMDirichletSimilarityFactory, SolrInfoMBeanTest, TestFileDictionaryLookup, HardAutoCommitTest, XsltUpdateRequestHandlerTest, PathHierarchyTokenizerFactoryTest, MigrateRouteKeyTest, LeaderElectionTest, NoCacheHeaderTest, SolrCoreTest, TestComponentsName, TestSolr4Spatial, TestDocSet, FieldAnalysisRequestHandlerTest, JsonLoaderTest, HdfsRecoveryZkTest, SolrXmlInZkTest, ReturnFieldsTest, TestAnalyzeInfixSuggestions, TestFieldCollectionResource, DistributedSpellCheckComponentTest, TestStressVersions, TestJmxIntegration, RequiredFieldsTest, TestRemoteStreaming, SliceStateUpdateTest, TestSchemaVersionResource, TestQueryUtils, QueryParsingTest, TestArbitraryIndexDir, TestDFRSimilarityFactory, TestDocBasedVersionConstraints, SyncSliceTest, TestSystemIdResolver, SoftAutoCommitTest, TestSearchPerf, TestMaxScoreQueryParser, AnalysisAfterCoreReloadTest, ExternalFileFieldSortTest, TestUniqueKeyFieldResource, TestSweetSpotSimilarityFactory, CurrencyFieldXmlFileTest, TestDynamicFieldResource, ZkCLITest, TestLuceneMatchVersion, BJQParserTest, CachingDirectoryFactoryTest, SolrCmdDistributorTest, DateFieldTest, TestStressRecovery, DeleteReplicaTest, TermVectorComponentTest, IndexSchemaRuntimeFieldTest, TestSurroundQueryParser, TestSort, TestSolrQueryParserResource, PluginInfoTest, BlockDirectoryTest, TestQueryTypes, TestManagedSchema, LukeRequestHandlerTest, TestFastWriter, TestSolrXMLSerializer, TestFaceting, CircularListTest, DirectUpdateHandlerTest, CopyFieldTest, OpenCloseCoreStressTest, DocumentAnalysisRequestHandlerTest, BinaryUpdateRequestHandlerTest, TestAnalyzedSuggestions, TestHighFrequencyDictionaryFactory, TestOmitPositions, TestConfig, TestAtomicUpdateErrorCases, HdfsChaosMonkeySafeLeaderTest, TestReplicationHandler, SignatureUpdateProcessorFactoryTest, TestSchemaSimilarityResource, RequestHandlersTest, TestBadConfig, TestFieldTypeCollectionResource, TestMultiCoreConfBootstrap, TestSimpleQParserPlugin, TestCharFilters, StatelessScriptUpdateProcessorFactoryTest, SuggesterWFSTTest, SliceStateTest, TestSuggestSpellingConverter, TestSolrXmlPersistor, TestImplicitCoreProperties, TestPseudoReturnFields, DistributedTermsComponentTest, SampleTest, CoreMergeIndexesAdminHandlerTest, SolrIndexConfigTest, DocValuesMissingTest, ResponseLogComponentTest, TestDefaultSearchFieldResource, TriLevelCompositeIdRoutingTest, SuggesterTest, TestCollapseQParserPlugin, ClusterStateUpdateTest, CacheHeaderTest, ShardRoutingCustomTest, OverseerTest, UpdateRequestProcessorFactoryTest, DistributedQueryElevationComponentTest, TestReversedWildcardFilterFactory, UpdateParamsTest, ZkNodePropsTest, TestCoreContainer, DocValuesTest, OverseerCollectionProcessorTest, PeerSyncTest, TestNRTOpen, IndexSchemaTest, SchemaVersionSpecificBehaviorTest, AliasIntegrationTest, DebugComponentTest, TestRecoveryHdfs, SolrIndexSplitterTest, BadCopyFieldTest, ClusterStateTest, CoreAdminCreateDiscoverTest, LegacyHTMLStripCharFilterTest, SuggestComponentTest, HdfsDirectoryTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, UnloadDistributedZkTest]
   [junit4] Completed in 134.42s, 1 test, 1 failure <<< FAILURES!

[...truncated 524 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:426: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:406: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:492: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1279: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:912: There were test failures: 345 suites, 1505 tests, 2 errors, 1 failure, 41 ignored (13 assumptions)

Total time: 88 minutes 46 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_45 -server -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.6.0_45) - Build # 3426 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/3426/
Java: 32bit/jdk1.6.0_45 -server -XX:+UseSerialGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.testDistribSearch

Error Message:
document count mismatch.  control=249 sum(shards)=250 cloudClient=250

Stack Trace:
java.lang.AssertionError: document count mismatch.  control=249 sum(shards)=250 cloudClient=250
	at __randomizedtesting.SeedInfo.seed([E8D63581F0292648:6930BB9987764674]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1238)
	at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.doTest(ChaosMonkeyNothingIsSafeTest.java:195)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
	at sun.reflect.GeneratedMethodAccessor66.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)




Build Log:
[...truncated 10178 lines...]
   [junit4] Suite: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
   [junit4]   2> 2904440 T7328 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 2904446 T7328 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-ChaosMonkeyNothingIsSafeTest-1385349816460
   [junit4]   2> 2904450 T7328 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 2904450 T7329 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 2904550 T7328 oasc.ZkTestServer.run start zk server on port:50816
   [junit4]   2> 2904552 T7328 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2904560 T7335 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@181fd5 name:ZooKeeperConnection Watcher:127.0.0.1:50816 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2904561 T7328 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2904561 T7328 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 2904569 T7330 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1428d48a0950000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
   [junit4]   2> 
   [junit4]   2> 2904570 T7328 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2904574 T7337 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@95ab3b name:ZooKeeperConnection Watcher:127.0.0.1:50816/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2904575 T7328 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2904575 T7328 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 2904582 T7328 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 2904587 T7328 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 2904592 T7328 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 2904599 T7328 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 2904600 T7328 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 2904611 T7328 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 2904612 T7328 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 2904619 T7328 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2904620 T7328 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2904627 T7328 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 2904628 T7328 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 2904635 T7328 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 2904635 T7328 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 2904643 T7328 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 2904644 T7328 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 2904650 T7328 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 2904651 T7328 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 2904658 T7328 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2904658 T7328 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2904666 T7328 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2904667 T7328 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2904674 T7328 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 2904675 T7328 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 2904681 T7328 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 2904682 T7328 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 2905152 T7328 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 2905156 T7328 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50823
   [junit4]   2> 2905157 T7328 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 2905157 T7328 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2905158 T7328 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385349816703
   [junit4]   2> 2905158 T7328 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385349816703\'
   [junit4]   2> 2905193 T7328 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385349816703\solr.xml
   [junit4]   2> 2905274 T7328 oasc.CoreContainer.<init> New CoreContainer 25471464
   [junit4]   2> 2905274 T7328 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385349816703\]
   [junit4]   2> 2905278 T7328 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 2905278 T7328 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 2905278 T7328 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 2905278 T7328 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2905278 T7328 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 2905278 T7328 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2905278 T7328 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 2905278 T7328 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 2905278 T7328 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 2905288 T7328 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2905290 T7328 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2905290 T7328 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 2905290 T7328 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50816/solr
   [junit4]   2> 2905290 T7328 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 2905293 T7328 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2905300 T7348 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@aed5b0 name:ZooKeeperConnection Watcher:127.0.0.1:50816 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2905300 T7328 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2905303 T7330 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1428d48a0950002, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
   [junit4]   2> 
   [junit4]   2> 2905305 T7328 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2905308 T7350 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10dac89 name:ZooKeeperConnection Watcher:127.0.0.1:50816/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2905309 T7328 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2905312 T7328 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 2905320 T7328 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 2905329 T7328 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 2905335 T7328 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50823_
   [junit4]   2> 2905337 T7328 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50823_
   [junit4]   2> 2905345 T7328 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 2905359 T7328 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 2905366 T7328 oasc.Overseer.start Overseer (id=90790285572112387-127.0.0.1:50823_-n_0000000000) starting
   [junit4]   2> 2905375 T7328 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 2905385 T7352 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 2905386 T7328 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 2905396 T7328 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 2905401 T7328 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2905414 T7351 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 2905417 T7353 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 2905417 T7353 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2905421 T7353 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 2905424 T7351 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2905425 T7351 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:50823",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:50823_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 2905425 T7351 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 2905425 T7351 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 2905431 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2905434 T7350 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2906421 T7353 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 2906421 T7353 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385349816703\collection1
   [junit4]   2> 2906421 T7353 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 2906424 T7353 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 2906424 T7353 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 2906425 T7353 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385349816703\collection1\'
   [junit4]   2> 2906425 T7353 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385349816703/collection1/lib/classes/' to classloader
   [junit4]   2> 2906427 T7353 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385349816703/collection1/lib/README' to classloader
   [junit4]   2> 2906488 T7353 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 2906562 T7353 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2906568 T7353 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 2906577 T7353 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 2907292 T7353 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 2907294 T7353 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 2907296 T7353 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 2907304 T7353 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 2907310 T7353 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2907338 T7353 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2907343 T7353 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2907349 T7353 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 2907352 T7353 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 2907352 T7353 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 2907352 T7353 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 2907355 T7353 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 2907355 T7353 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 2907355 T7353 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 2907356 T7353 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385349816703\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385349816457/control/data\
   [junit4]   2> 2907356 T7353 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6abf59
   [junit4]   2> 2907356 T7353 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385349816457\control\data
   [junit4]   2> 2907356 T7353 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385349816457/control/data\index/
   [junit4]   2> 2907358 T7353 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385349816457\control\data\index' doesn't exist. Creating new index...
   [junit4]   2> 2907358 T7353 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385349816457\control\data\index
   [junit4]   2> 2907359 T7353 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=12, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=4.2685546875, floorSegmentMB=2.1103515625, forceMergeDeletesPctAllowed=28.34504110442253, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 2907365 T7353 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385349816457\control\data\index,segFN=segments_1,generation=1}
   [junit4]   2> 2907365 T7353 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2907369 T7353 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 2907369 T7353 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 2907370 T7353 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 2907370 T7353 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2907370 T7353 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2907370 T7353 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 2907371 T7353 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2907371 T7353 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2907371 T7353 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2907372 T7353 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 2907372 T7353 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 2907372 T7353 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 2907372 T7353 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 2907374 T7353 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 2907374 T7353 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 2907374 T7353 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 2907381 T7353 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2907384 T7353 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2907384 T7353 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2907384 T7353 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=46, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=11.88671875, floorSegmentMB=0.9892578125, forceMergeDeletesPctAllowed=10.119427884573904, segmentsPerTier=48.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.29359672598465353
   [junit4]   2> 2907384 T7353 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385349816457\control\data\index,segFN=segments_1,generation=1}
   [junit4]   2> 2907384 T7353 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2907387 T7353 oass.SolrIndexSearcher.<init> Opening Searcher@174a7ff main
   [junit4]   2> 2907389 T7354 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@174a7ff main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 2907391 T7353 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 2907391 T7353 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50823 collection:control_collection shard:shard1
   [junit4]   2> 2907393 T7353 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 2907410 T7353 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 2907414 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2907417 T7353 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 2907417 T7353 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C6124 name=collection1 org.apache.solr.core.SolrCore@1180b5d url=http://127.0.0.1:50823/collection1 node=127.0.0.1:50823_ C6124_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:50823, core=collection1, node_name=127.0.0.1:50823_}
   [junit4]   2> 2907417 T7353 C6124 P50823 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50823/collection1/
   [junit4]   2> 2907418 T7353 C6124 P50823 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 2907418 T7353 C6124 P50823 oasc.SyncStrategy.syncToMe http://127.0.0.1:50823/collection1/ has no replicas
   [junit4]   2> 2907418 T7353 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50823/collection1/ shard1
   [junit4]   2> 2907418 T7353 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 2907423 T7351 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2907433 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2907436 T7350 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2907450 T7351 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2907456 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2907561 T7350 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2907595 T7353 oasc.ZkController.register We are http://127.0.0.1:50823/collection1/ and leader is http://127.0.0.1:50823/collection1/
   [junit4]   2> 2907595 T7353 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50823
   [junit4]   2> 2907595 T7353 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 2907595 T7353 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 2907595 T7353 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2907599 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2907599 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2907599 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2907600 T7353 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2907603 T7328 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 2907603 T7328 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 2907605 T7351 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2907606 T7351 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:50823",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:50823_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 2907607 T7328 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2907610 T7357 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2ace63 name:ZooKeeperConnection Watcher:127.0.0.1:50816/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2907611 T7328 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2907616 T7328 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2907617 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2907624 T7328 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 2907725 T7357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2907727 T7350 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2908071 T7328 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 2908088 T7328 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50835
   [junit4]   2> 2908088 T7328 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 2908088 T7328 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2908088 T7328 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385349819635
   [junit4]   2> 2908090 T7328 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385349819635\'
   [junit4]   2> 2908117 T7328 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385349819635\solr.xml
   [junit4]   2> 2908187 T7328 oasc.CoreContainer.<init> New CoreContainer 6849528
   [junit4]   2> 2908190 T7328 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385349819635\]
   [junit4]   2> 2908191 T7328 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 2908191 T7328 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 2908191 T7328 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 2908191 T7328 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2908191 T7328 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 2908191 T7328 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2908194 T7328 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 2908194 T7328 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 2908194 T7328 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 2908200 T7328 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2908200 T7328 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2908203 T7328 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 2908203 T7328 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50816/solr
   [junit4]   2> 2908203 T7328 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 2908205 T7328 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2908212 T7368 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b04d90 name:ZooKeeperConnection Watcher:127.0.0.1:50816 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2908212 T7328 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2908216 T7330 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1428d48a0950005, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
   [junit4]   2> 
   [junit4]   2> 2908217 T7328 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2908219 T7370 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@123da30 name:ZooKeeperConnection Watcher:127.0.0.1:50816/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2908220 T7328 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2908232 T7328 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2909239 T7328 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50835_
   [junit4]   2> 2909242 T7328 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50835_
   [junit4]   2> 2909249 T7350 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 2909249 T7357 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 2909250 T7370 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 2909264 T7371 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 2909264 T7371 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2909266 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2909266 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2909267 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2909267 T7371 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 2909270 T7351 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2909271 T7351 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:50835",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:50835_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 2909271 T7351 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 2909272 T7351 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 2909277 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2909279 T7370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2909279 T7350 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2909280 T7357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2910267 T7371 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 2910267 T7371 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385349819635\collection1
   [junit4]   2> 2910267 T7371 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 2910269 T7371 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 2910269 T7371 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 2910272 T7371 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385349819635\collection1\'
   [junit4]   2> 2910272 T7371 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385349819635/collection1/lib/classes/' to classloader
   [junit4]   2> 2910274 T7371 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385349819635/collection1/lib/README' to classloader
   [junit4]   2> 2910358 T7371 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 2910426 T7371 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2910429 T7371 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 2910435 T7371 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 2911160 T7371 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 2911161 T7371 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 2911162 T7371 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 2911174 T7371 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 2911178 T7371 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2911210 T7371 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2911215 T7371 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2911220 T7371 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 2911225 T7371 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 2911225 T7371 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 2911225 T7371 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 2911228 T7371 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 2911228 T7371 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 2911228 T7371 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 2911229 T7371 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385349819635\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385349816457/jetty1\
   [junit4]   2> 2911229 T7371 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6abf59
   [junit4]   2> 2911229 T7371 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385349816457\jetty1
   [junit4]   2> 2911229 T7371 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385349816457/jetty1\index/
   [junit4]   2> 2911229 T7371 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385349816457\jetty1\index' doesn't exist. Creating new index...
   [junit4]   2> 2911232 T7371 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385349816457\jetty1\index
   [junit4]   2> 2911232 T7371 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=12, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=4.2685546875, floorSegmentMB=2.1103515625, forceMergeDeletesPctAllowed=28.34504110442253, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 2911238 T7371 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385349816457\jetty1\index,segFN=segments_1,generation=1}
   [junit4]   2> 2911238 T7371 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2911242 T7371 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 2911243 T7371 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 2911243 T7371 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 2911243 T7371 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2911243 T7371 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2911243 T7371 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 2911245 T7371 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2911245 T7371 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2911245 T7371 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2911246 T7371 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 2911246 T7371 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 2911246 T7371 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 2911246 T7371 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 2911259 T7371 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 2911259 T7371 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 2911260 T7371 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 2911267 T7371 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2911272 T7371 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2911272 T7371 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2911272 T7371 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=46, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=11.88671875, floorSegmentMB=0.9892578125, forceMergeDeletesPctAllowed=10.119427884573904, segmentsPerTier=48.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.29359672598465353
   [junit4]   2> 2911273 T7371 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385349816457\jetty1\index,segFN=segments_1,generation=1}
   [junit4]   2> 2911273 T7371 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2911273 T7371 oass.SolrIndexSearcher.<init> Opening Searcher@34a8be main
   [junit4]   2> 2911281 T7372 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@34a8be main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 2911283 T7371 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 2911283 T7371 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50835 collection:collection1 shard:shard1
   [junit4]   2> 2911285 T7371 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 2911300 T7371 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 2911306 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2911308 T7371 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 2911308 T7371 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C6125 name=collection1 org.apache.solr.core.SolrCore@11552bb url=http://127.0.0.1:50835/collection1 node=127.0.0.1:50835_ C6125_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:50835, core=collection1, node_name=127.0.0.1:50835_}
   [junit4]   2> 2911308 T7371 C6125 P50835 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50835/collection1/
   [junit4]   2> 2911310 T7371 C6125 P50835 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 2911310 T7371 C6125 P50835 oasc.SyncStrategy.syncToMe http://127.0.0.1:50835/collection1/ has no replicas
   [junit4]   2> 2911310 T7371 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50835/collection1/ shard1
   [junit4]   2> 2911310 T7371 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 2911312 T7351 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2911324 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2911327 T7370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2911328 T7350 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2911328 T7357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2911344 T7351 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2911352 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2911458 T7357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2911459 T7350 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2911459 T7370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2911488 T7371 oasc.ZkController.register We are http://127.0.0.1:50835/collection1/ and leader is http://127.0.0.1:50835/collection1/
   [junit4]   2> 2911488 T7371 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50835
   [junit4]   2> 2911488 T7371 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 2911488 T7371 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 2911488 T7371 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2911491 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2911492 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2911492 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2911494 T7371 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2911497 T7328 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 2911498 T7328 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 2911498 T7351 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2911500 T7351 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:50835",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:50835_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 2911508 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2911615 T7370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2911615 T7350 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2911616 T7357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2911959 T7328 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 2911962 T7328 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50844
   [junit4]   2> 2911963 T7328 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 2911963 T7328 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2911963 T7328 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385349823511
   [junit4]   2> 2911963 T7328 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385349823511\'
   [junit4]   2> 2911992 T7328 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385349823511\solr.xml
   [junit4]   2> 2912062 T7328 oasc.CoreContainer.<init> New CoreContainer 29348260
   [junit4]   2> 2912064 T7328 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385349823511\]
   [junit4]   2> 2912066 T7328 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 2912066 T7328 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 2912066 T7328 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 2912066 T7328 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2912066 T7328 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 2912066 T7328 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2912069 T7328 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 2912069 T7328 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 2912069 T7328 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 2912075 T7328 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2912075 T7328 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2912075 T7328 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 2912075 T7328 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50816/solr
   [junit4]   2> 2912077 T7328 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 2912080 T7328 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2912090 T7384 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5c7123 name:ZooKeeperConnection Watcher:127.0.0.1:50816 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2912090 T7328 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2912094 T7328 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2912097 T7386 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@232cf6 name:ZooKeeperConnection Watcher:127.0.0.1:50816/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2912098 T7328 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2912107 T7328 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2913116 T7328 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50844_
   [junit4]   2> 2913118 T7328 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50844_
   [junit4]   2> 2913125 T7350 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 2913126 T7370 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 2913128 T7386 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 2913128 T7357 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 2913142 T7387 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 2913142 T7387 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2913144 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2913144 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2913145 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2913145 T7387 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 2913148 T7351 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2913150 T7351 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:50844",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:50844_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 2913150 T7351 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 2913150 T7351 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 2913156 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2913158 T7386 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2913158 T7350 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2913159 T7357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2913159 T7370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2914208 T7387 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 2914208 T7387 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385349823511\collection1
   [junit4]   2> 2914208 T7387 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 2914210 T7387 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 2914210 T7387 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 2914213 T7387 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385349823511\collection1\'
   [junit4]   2> 2914213 T7387 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385349823511/collection1/lib/classes/' to classloader
   [junit4]   2> 2914216 T7387 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385349823511/collection1/lib/README' to classloader
   [junit4]   2> 2914303 T7387 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 2914375 T7387 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2914380 T7387 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 2914386 T7387 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 2915191 T7387 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 2915192 T7387 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 2915192 T7387 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 2915205 T7387 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 2915210 T7387 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2915243 T7387 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2915250 T7387 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2915258 T7387 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 2915261 T7387 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 2915261 T7387 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 2915261 T7387 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 2915266 T7387 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 2915266 T7387 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 2915266 T7387 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 2915267 T7387 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385349823511\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385349816457/jetty2\
   [junit4]   2> 2915267 T7387 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6abf59
   [junit4]   2> 2915267 T7387 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385349816457\jetty2
   [junit4]   2> 2915267 T7387 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385349816457/jetty2\index/
   [junit4]   2> 2915270 T7387 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385349816457\jetty2\index' doesn't exist. Creating new index...
   [junit4]   2> 2915270 T7387 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385349816457\jetty2\index
   [junit4]   2> 2915271 T7387 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=12, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=4.2685546875, floorSegmentMB=2.1103515625, forceMergeDeletesPctAllowed=28.34504110442253, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 2915277 T7387 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385349816457\jetty2\index,segFN=segments_1,generation=1}
   [junit4]   2> 2915277 T7387 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2915282 T7387 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 2915282 T7387 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 2915282 T7387 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 2915282 T7387 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2915282 T7387 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2915282 T7387 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 2915284 T7387 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2915284 T7387 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2915284 T7387 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2915285 T7387 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 2915286 T7387 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 2915286 T7387 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 2915286 T7387 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 2915287 T7387 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 2915287 T7387 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 2915288 T7387 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 2915293 T7387 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2915300 T7387 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2915300 T7387 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2915300 T7387 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=46, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=11.88671875, floorSegmentMB=0.9892578125, forceMergeDeletesPctAllowed=10.119427884573904, segmentsPerTier=48.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.29359672598465353
   [junit4]   2> 2915300 T7387 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385349816457\jetty2\index,segFN=segments_1,generation=1}
   [junit4]   2> 2915300 T7387 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2915300 T7387 oass.SolrIndexSearcher.<init> Opening Searcher@a14d9b main
   [junit4]   2> 2915307 T7388 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@a14d9b main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 2915309 T7387 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 2915309 T7387 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50844 collection:collection1 shard:shard2
   [junit4]   2> 2915311 T7387 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 2915331 T7387 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 2915337 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2915340 T7387 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 2915340 T7387 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C6126 name=collection1 org.apache.solr.core.SolrCore@bfedc4 url=http://127.0.0.1:50844/collection1 node=127.0.0.1:50844_ C6126_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:50844, core=collection1, node_name=127.0.0.1:50844_}
   [junit4]   2> 2915340 T7387 C6126 P50844 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50844/collection1/
   [junit4]   2> 2915341 T7387 C6126 P50844 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 2915341 T7387 C6126 P50844 oasc.SyncStrategy.syncToMe http://127.0.0.1:50844/collection1/ has no replicas
   [junit4]   2> 2915341 T7387 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50844/collection1/ shard2
   [junit4]   2> 2915343 T7387 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 2915346 T7351 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2915362 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2915367 T7386 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2915368 T7370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2915371 T7350 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2915374 T7357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2915390 T7351 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2915399 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2915516 T7386 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2915516 T7350 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2915517 T7357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2915517 T7370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2915547 T7387 oasc.ZkController.register We are http://127.0.0.1:50844/collection1/ and leader is http://127.0.0.1:50844/collection1/
   [junit4]   2> 2915547 T7387 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50844
   [junit4]   2> 2915547 T7387 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 2915547 T7387 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 2915547 T7387 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2915552 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2915552 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2915552 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2915554 T7387 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2915558 T7328 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 2915559 T7328 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 2915560 T7351 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2915562 T7351 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:50844",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:50844_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 2915575 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2915698 T7357 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2915700 T7386 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2915701 T7370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2915702 T7350 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2916109 T7328 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 2916117 T7328 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50853
   [junit4]   2> 2916118 T7328 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 2916118 T7328 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2916118 T7328 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385349827572
   [junit4]   2> 2916118 T7328 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385349827572\'
   [junit4]   2> 2916151 T7328 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385349827572\solr.xml
   [junit4]   2> 2916250 T7328 oasc.CoreContainer.<init> New CoreContainer 6822410
   [junit4]   2> 2916251 T7328 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty3-1385349827572\]
   [junit4]   2> 2916253 T7328 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 2916253 T7328 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 2916254 T7328 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 2916254 T7328 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2916254 T7328 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 2916255 T7328 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2916255 T7328 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 2916255 T7328 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 2916256 T7328 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 2916266 T7328 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2916266 T7328 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2916267 T7328 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 2916267 T7328 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50816/solr
   [junit4]   2> 2916267 T7328 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 2916269 T7328 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2916276 T7400 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@85a47b name:ZooKeeperConnection Watcher:127.0.0.1:50816 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2916277 T7328 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2916280 T7330 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1428d48a0950009, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
   [junit4]   2> 
   [junit4]   2> 2916283 T7328 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2916286 T7402 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1318f4f name:ZooKeeperConnection Watcher:127.0.0.1:50816/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2916287 T7328 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2916298 T7328 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2917407 T7328 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50853_
   [junit4]   2> 2917410 T7328 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50853_
   [junit4]   2> 2917418 T7357 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 2917420 T7350 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 2917421 T7370 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 2917422 T7386 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 2917423 T7402 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 2917439 T7403 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 2917439 T7403 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2917441 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2917441 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2917441 T7350 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2917442 T7403 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 2917445 T7351 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2917447 T7351 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:50853",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:50853_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 2917447 T7351 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards

[...truncated too long message...]

0.0.1:50900_-n_0000000007 (0)
   [junit4]   1>     /solr/overseer_elect/election/90790285572112400-127.0.0.1:50887_-n_0000000006 (0)
   [junit4]   1>     /solr/overseer_elect/election/90790285572112394-127.0.0.1:50853_-n_0000000003 (0)
   [junit4]   1>     /solr/overseer_elect/election/90790285572112404-127.0.0.1:50844_-n_0000000008 (0)
   [junit4]   1>     /solr/overseer_elect/election/90790285572112387-127.0.0.1:50823_-n_0000000000 (0)
   [junit4]   1>    /solr/overseer_elect/leader (0)
   [junit4]   1>    DATA:
   [junit4]   1>        {"id":"90790285572112387-127.0.0.1:50823_-n_0000000000"}
   [junit4]   1>  /zookeeper (1)
   [junit4]   1>  DATA:
   [junit4]   1>      
   [junit4]   1> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ChaosMonkeyNothingIsSafeTest -Dtests.method=testDistribSearch -Dtests.seed=E8D63581F0292648 -Dtests.slow=true -Dtests.locale=en_IN -Dtests.timezone=Europe/Malta -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 94.1s | ChaosMonkeyNothingIsSafeTest.testDistribSearch <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: document count mismatch.  control=249 sum(shards)=250 cloudClient=250
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([E8D63581F0292648:6930BB9987764674]:0)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1238)
   [junit4]    > 	at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.doTest(ChaosMonkeyNothingIsSafeTest.java:195)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:662)
   [junit4]   2> 2998522 T7328 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: test params are: codec=Lucene40, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=en_IN, timezone=Europe/Malta
   [junit4]   2> NOTE: Windows 7 6.1 x86/Sun Microsystems Inc. 1.6.0_45 (32-bit)/cpus=2,threads=1,free=88206328,total=196964352
   [junit4]   2> NOTE: All tests run in this JVM: [AutoCommitTest, TestInfoStreamLogging, TestCollationField, AlternateDirectoryTest, UpdateParamsTest, TestReload, TestSolrCoreProperties, TestSort, ZkNodePropsTest, SoftAutoCommitTest, SimplePostToolTest, TermVectorComponentDistributedTest, TestRealTimeGet, TestElisionMultitermQuery, TestReversedWildcardFilterFactory, MoreLikeThisHandlerTest, TestExtendedDismaxParser, SolrIndexConfigTest, TestIndexingPerformance, TestRandomDVFaceting, ClusterStateTest, TestSolrXml, ShardSplitTest, SpatialFilterTest, TestHighFrequencyDictionaryFactory, UUIDFieldTest, TestShardHandlerFactory, UniqFieldsUpdateProcessorFactoryTest, DateMathParserTest, TestValueSourceCache, TestFieldCollectionResource, NoCacheHeaderTest, CurrencyFieldOpenExchangeTest, SpellCheckComponentTest, SignatureUpdateProcessorFactoryTest, ShardRoutingCustomTest, OpenCloseCoreStressTest, SyncSliceTest, DateFieldTest, TestCollationKeyRangeQueries, OpenExchangeRatesOrgProviderTest, TestUtils, SynonymTokenizerTest, BlockCacheTest, TestRecovery, TestPHPSerializedResponseWriter, InfoHandlerTest, TestLazyCores, DocValuesTest, CurrencyFieldXmlFileTest, TestStressUserVersions, BadIndexSchemaTest, DistributedSuggesterComponentTest, TestLFUCache, TestArbitraryIndexDir, TestRandomMergePolicy, TestSearchPerf, TestWriterPerf, TestSystemIdResolver, TestBM25SimilarityFactory, TestNoOpRegenerator, TestAnalyzeInfixSuggestions, TestCSVResponseWriter, HdfsBasicDistributedZk2Test, TestGroupingSearch, AddSchemaFieldsUpdateProcessorFactoryTest, RequestHandlersTest, TestFileDictionaryLookup, OutputWriterTest, TestTrie, TestCharFilters, ZkSolrClientTest, ConvertedLegacyTest, DirectUpdateHandlerTest, TestDocumentBuilder, TestSolrQueryParser, TestQueryUtils, SolrTestCaseJ4Test, TestStressReorder, TestNRTOpen, WordBreakSolrSpellCheckerTest, TestComponentsName, StressHdfsTest, ScriptEngineTest, FastVectorHighlighterTest, TestSuggestSpellingConverter, SuggestComponentTest, SystemInfoHandlerTest, TestSolr4Spatial, QueryResultKeyTest, TestQuerySenderNoQuery, TestAddFieldRealTimeGet, ShardRoutingTest, TestJmxIntegration, TermVectorComponentTest, TestSolrQueryParserDefaultOperatorResource, AddBlockUpdateTest, HdfsDirectoryTest, SpellPossibilityIteratorTest, BasicFunctionalityTest, HardAutoCommitTest, TestReplicationHandler, DirectSolrSpellCheckerTest, ZkControllerTest, TestDistributedGrouping, DisMaxRequestHandlerTest, HdfsUnloadDistributedZkTest, RequiredFieldsTest, FullSolrCloudDistribCmdsTest, TestMaxScoreQueryParser, SliceStateTest, TestFieldTypeCollectionResource, TermsComponentTest, TestSolrXmlPersistor, ClusterStateUpdateTest, MultiTermTest, TestSurroundQueryParser, SolrIndexSplitterTest, TestCloudManagedSchemaAddField, MBeansHandlerTest, TestDefaultSimilarityFactory, PreAnalyzedUpdateProcessorTest, TestBinaryField, EchoParamsTest, TestDFRSimilarityFactory, TestCoreDiscovery, TestCSVLoader, TestSolrDeletionPolicy2, UnloadDistributedZkTest, StatelessScriptUpdateProcessorFactoryTest, TestNumberUtils, DOMUtilTest, LeaderElectionTest, OverseerCollectionProcessorTest, TestSchemaSimilarityResource, TestSolrJ, HdfsChaosMonkeySafeLeaderTest, RAMDirectoryFactoryTest, JSONWriterTest, LoggingHandlerTest, TestRecoveryHdfs, PluginInfoTest, TestRemoteStreaming, HdfsLockFactoryTest, CollectionsAPIDistributedZkTest, CoreAdminCreateDiscoverTest, TestXIncludeConfig, TestQuerySenderListener, DistributedSpellCheckComponentTest, TestDynamicFieldCollectionResource, FieldMutatingUpdateProcessorTest, ExternalFileFieldSortTest, ResourceLoaderTest, TestDocSet, TestReloadAndDeleteDocs, TestMultiCoreConfBootstrap, OverseerTest, DeleteInactiveReplicaTest, TestMergePolicyConfig, CachingDirectoryFactoryTest, TestStressRecovery, UpdateRequestProcessorFactoryTest, TestSchemaVersionResource, BasicZkTest, ResponseLogComponentTest, TestPostingsSolrHighlighter, LukeRequestHandlerTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, LeaderElectionIntegrationTest, RecoveryZkTest, TestRandomFaceting, TestZkChroot, ZkCLITest, SliceStateUpdateTest, TestDistributedSearch, TestFaceting, TestHashPartitioner, TestJoin, TestStressVersions, DistributedTermsComponentTest, TestRangeQuery, TestCoreContainer, SimpleFacetsTest, SolrCoreTest, StatsComponentTest, SolrCmdDistributorTest, QueryElevationComponentTest, PeerSyncTest, TestFiltering, TestFunctionQuery, TestBadConfig, TestIndexSearcher, HighlighterTest, ShowFileRequestHandlerTest, DistributedQueryElevationComponentTest, AnalysisAfterCoreReloadTest, SpellCheckCollatorTest, SuggesterFSTTest, CoreAdminHandlerTest, SolrRequestParserTest, TestFoldingMultitermQuery, SuggesterTSTTest, SuggesterTest, TestStressLucene, SuggesterWFSTTest, PolyFieldTest, SchemaVersionSpecificBehaviorTest, SolrCoreCheckLockOnStartupTest, TestPseudoReturnFields, TestUpdate, TestAtomicUpdateErrorCases, TestWordDelimiterFilterFactory, QueryEqualityTest, DirectUpdateHandlerOptimizeTest, DefaultValueUpdateProcessorTest, SortByFunctionTest, DocValuesMultiTest, DistanceFunctionTest, TestSolrDeletionPolicy1, SolrInfoMBeanTest, XsltUpdateRequestHandlerTest, DebugComponentTest, CacheHeaderTest, IndexBasedSpellCheckerTest, StandardRequestHandlerTest, DocumentAnalysisRequestHandlerTest, TestQueryTypes, PrimitiveFieldTypeTest, TestOmitPositions, FileBasedSpellCheckerTest, XmlUpdateRequestHandlerTest, DocumentBuilderTest, PathHierarchyTokenizerFactoryTest, FieldAnalysisRequestHandlerTest, IndexSchemaRuntimeFieldTest, RegexBoostProcessorTest, SolrPluginUtilsTest, IndexSchemaTest, ReturnFieldsTest, QueryParsingTest, TestAnalyzedSuggestions, JsonLoaderTest, BinaryUpdateRequestHandlerTest, TestPartialUpdateDeduplication, PingRequestHandlerTest, CSVRequestHandlerTest, SearchHandlerTest, CoreContainerCoreInitFailuresTest, TestBinaryResponseWriter, HighlighterConfigTest, SOLR749Test, TestSolrIndexConfig, CopyFieldTest, BadComponentTest, SampleTest, NumericFieldsTest, MinimalSchemaTest, TestConfig, TestFuzzyAnalyzedSuggestions, DirectSolrConnectionTest, NotRequiredUniqueKeyTest, TestLuceneMatchVersion, TestPhraseSuggestions, TestCodecSupport, TestSweetSpotSimilarityFactory, TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestIBSimilarityFactory, TestFastWriter, LegacyHTMLStripCharFilterTest, TestJmxMonitoredMap, TimeZoneUtilsTest, TestFastOutputStream, URLClassifyProcessorTest, TestFastLRUCache, ChaosMonkeyNothingIsSafeTest]
   [junit4] Completed in 94.11s, 1 test, 1 failure <<< FAILURES!

[...truncated 194 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:426: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:406: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:492: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1279: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:912: There were test failures: 345 suites, 1505 tests, 1 failure, 41 ignored (13 assumptions)

Total time: 88 minutes 38 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.6.0_45 -server -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.8.0-ea-b116) - Build # 3425 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/3425/
Java: 32bit/jdk1.8.0-ea-b116 -server -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
Could not find the new collection - 404 : http://127.0.0.1:56839/onenodecollectioncore

Stack Trace:
java.lang.AssertionError: Could not find the new collection - 404 : http://127.0.0.1:56839/onenodecollectioncore
	at __randomizedtesting.SeedInfo.seed([B2901D7591B90E0B:3376936DE6E66E37]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForNon403or404or503(AbstractFullDistribZkTestBase.java:1797)
	at org.apache.solr.cloud.BasicDistributedZk2Test.addAndQueryDocs(BasicDistributedZk2Test.java:206)
	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:195)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:90)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
	at sun.reflect.GeneratedMethodAccessor32.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)




Build Log:
[...truncated 10591 lines...]
   [junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
   [junit4]   2> 1584018 T6199 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 1584029 T6199 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-BasicDistributedZk2Test-1385320208845
   [junit4]   2> 1584033 T6199 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 1584033 T6200 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 1584130 T6199 oasc.ZkTestServer.run start zk server on port:56811
   [junit4]   2> 1584131 T6199 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1584138 T6206 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b7f81e name:ZooKeeperConnection Watcher:127.0.0.1:56811 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1584138 T6199 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1584138 T6199 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1584142 T6201 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1428b84d9d80000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1584144 T6199 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1584147 T6208 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@91043c name:ZooKeeperConnection Watcher:127.0.0.1:56811/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1584148 T6199 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1584148 T6199 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 1584152 T6199 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 1584154 T6199 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 1584157 T6199 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 1584160 T6199 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1584160 T6199 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1584167 T6199 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1584168 T6199 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 1584173 T6199 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1584174 T6199 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1584178 T6199 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1584179 T6199 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1584184 T6199 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1584184 T6199 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1584189 T6199 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1584190 T6199 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 1584195 T6199 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1584196 T6199 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1584200 T6199 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1584200 T6199 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1584204 T6199 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1584205 T6199 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1584210 T6199 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1584210 T6199 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1584215 T6199 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1584215 T6199 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1584221 T6201 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1428b84d9d80001, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1584633 T6199 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1584658 T6199 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56818
   [junit4]   2> 1584658 T6199 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1584658 T6199 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1584660 T6199 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1385320209034
   [junit4]   2> 1584661 T6199 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1385320209034\'
   [junit4]   2> 1584689 T6199 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1385320209034\solr.xml
   [junit4]   2> 1584699 T6199 oasc.CoreContainer.<init> New CoreContainer 10326377
   [junit4]   2> 1584699 T6199 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1385320209034\]
   [junit4]   2> 1584700 T6199 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1584700 T6199 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 1584700 T6199 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1584700 T6199 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1584700 T6199 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1584700 T6199 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1584700 T6199 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1584701 T6199 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1584701 T6199 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1584709 T6199 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1584711 T6199 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1584711 T6199 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1584711 T6199 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56811/solr
   [junit4]   2> 1584711 T6199 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1584714 T6199 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1584723 T6219 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5be398 name:ZooKeeperConnection Watcher:127.0.0.1:56811 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1584723 T6199 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1584731 T6199 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1584735 T6221 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d4f875 name:ZooKeeperConnection Watcher:127.0.0.1:56811/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1584735 T6199 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1584737 T6199 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 1584744 T6199 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 1584748 T6199 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1584751 T6199 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56818_
   [junit4]   2> 1584753 T6199 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56818_
   [junit4]   2> 1584758 T6199 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 1584771 T6199 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 1584775 T6199 oasc.Overseer.start Overseer (id=90788345207586819-127.0.0.1:56818_-n_0000000000) starting
   [junit4]   2> 1584781 T6199 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 1584786 T6223 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 1584787 T6199 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 1584790 T6199 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 1584792 T6199 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1584796 T6222 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 1584798 T6224 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 1584798 T6224 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1584800 T6224 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1584800 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1584802 T6222 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1584803 T6222 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:56818",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:56818_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1584803 T6222 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 1584803 T6222 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1584806 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1584807 T6221 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1585761 T6224 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1585761 T6224 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1385320209034\collection1
   [junit4]   2> 1585761 T6224 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 1585761 T6224 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1585761 T6224 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1585763 T6224 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1385320209034\collection1\'
   [junit4]   2> 1585763 T6224 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1385320209034/collection1/lib/classes/' to classloader
   [junit4]   2> 1585763 T6224 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1385320209034/collection1/lib/README' to classloader
   [junit4]   2> 1585790 T6224 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 1585805 T6224 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1585806 T6224 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1585811 T6224 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1585903 T6224 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1585904 T6224 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1585905 T6224 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1585911 T6224 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1585912 T6224 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1585927 T6224 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1585929 T6224 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1585932 T6224 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1585933 T6224 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1585933 T6224 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1585934 T6224 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1585935 T6224 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1585935 T6224 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1585936 T6224 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1585936 T6224 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1385320209034\collection1\, dataDir=.\org.apache.solr.cloud.BasicDistributedZk2Test-1385320208844/control/data\
   [junit4]   2> 1585936 T6224 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f8595c
   [junit4]   2> 1585937 T6224 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.BasicDistributedZk2Test-1385320208844/control/data\
   [junit4]   2> 1585937 T6224 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.BasicDistributedZk2Test-1385320208844/control/data\index/
   [junit4]   2> 1585937 T6224 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.BasicDistributedZk2Test-1385320208844\control\data\index' doesn't exist. Creating new index...
   [junit4]   2> 1585938 T6224 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.BasicDistributedZk2Test-1385320208844/control/data\index
   [junit4]   2> 1585938 T6224 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=19, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2526843779876036]
   [junit4]   2> 1585939 T6224 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1080493 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@19d7535),segFN=segments_1,generation=1}
   [junit4]   2> 1585939 T6224 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1585941 T6224 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1585941 T6224 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1585941 T6224 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1585941 T6224 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1585942 T6224 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1585942 T6224 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1585942 T6224 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1585942 T6224 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1585942 T6224 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1585942 T6224 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1585942 T6224 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1585943 T6224 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1585943 T6224 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1585943 T6224 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1585944 T6224 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1585944 T6224 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1585950 T6224 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1585954 T6224 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1585954 T6224 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1585955 T6224 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=46, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=1.98828125, floorSegmentMB=1.6494140625, forceMergeDeletesPctAllowed=0.6536880590736582, segmentsPerTier=12.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.41388369709055917
   [junit4]   2> 1585955 T6224 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1080493 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@19d7535),segFN=segments_1,generation=1}
   [junit4]   2> 1585955 T6224 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1585955 T6224 oass.SolrIndexSearcher.<init> Opening Searcher@3ea7b6 main
   [junit4]   2> 1585958 T6224 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1585958 T6224 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56818 collection:control_collection shard:shard1
   [junit4]   2> 1585958 T6225 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3ea7b6 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1585958 T6224 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1585969 T6224 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1585974 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1585975 T6224 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1585976 T6224 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C8392 name=collection1 org.apache.solr.core.SolrCore@77b2a9 url=http://127.0.0.1:56818/collection1 node=127.0.0.1:56818_ C8392_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:56818, core=collection1, node_name=127.0.0.1:56818_}
   [junit4]   2> 1585976 T6224 C8392 P56818 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:56818/collection1/
   [junit4]   2> 1585977 T6224 C8392 P56818 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1585977 T6224 C8392 P56818 oasc.SyncStrategy.syncToMe http://127.0.0.1:56818/collection1/ has no replicas
   [junit4]   2> 1585977 T6224 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:56818/collection1/ shard1
   [junit4]   2> 1585977 T6224 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1585978 T6222 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1585986 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1585990 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1585996 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1586095 T6221 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1586138 T6224 oasc.ZkController.register We are http://127.0.0.1:56818/collection1/ and leader is http://127.0.0.1:56818/collection1/
   [junit4]   2> 1586138 T6224 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56818
   [junit4]   2> 1586138 T6224 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1586138 T6224 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 1586138 T6224 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1586140 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1586140 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1586141 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1586142 T6224 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1586145 T6222 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1586145 T6199 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1586146 T6199 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1586146 T6222 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:56818",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:56818_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 1586151 T6199 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1586152 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1586155 T6228 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b5ecae name:ZooKeeperConnection Watcher:127.0.0.1:56811/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1586155 T6199 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1586157 T6199 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1586161 T6199 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1586255 T6221 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1586255 T6228 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1586586 T6199 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1586590 T6199 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56830
   [junit4]   2> 1586590 T6199 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1586590 T6199 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1586590 T6199 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1385320210975
   [junit4]   2> 1586590 T6199 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1385320210975\'
   [junit4]   2> 1586624 T6199 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1385320210975\solr.xml
   [junit4]   2> 1586632 T6199 oasc.CoreContainer.<init> New CoreContainer 2104928
   [junit4]   2> 1586634 T6199 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1385320210975\]
   [junit4]   2> 1586635 T6199 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1586635 T6199 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 1586635 T6199 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1586635 T6199 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1586635 T6199 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1586635 T6199 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1586635 T6199 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1586635 T6199 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1586635 T6199 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1586640 T6199 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1586642 T6199 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1586642 T6199 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1586642 T6199 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56811/solr
   [junit4]   2> 1586642 T6199 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1586645 T6199 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1586655 T6239 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e9de4 name:ZooKeeperConnection Watcher:127.0.0.1:56811 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1586655 T6199 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1586661 T6199 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1586664 T6241 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14d604a name:ZooKeeperConnection Watcher:127.0.0.1:56811/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1586664 T6199 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1586669 T6199 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1587633 T6199 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56830_
   [junit4]   2> 1587635 T6199 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56830_
   [junit4]   2> 1587639 T6228 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1587640 T6221 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1587640 T6241 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1587646 T6242 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 1587646 T6242 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1587647 T6242 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1587647 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1587648 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1587648 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1587650 T6222 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1587650 T6222 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:56830",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:56830_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1587651 T6222 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 1587651 T6222 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 1587654 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1587753 T6228 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1587753 T6241 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1587753 T6221 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1588609 T6242 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1588610 T6242 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1385320210975\collection1
   [junit4]   2> 1588610 T6242 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1588613 T6242 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1588613 T6242 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1588617 T6242 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1385320210975\collection1\'
   [junit4]   2> 1588619 T6242 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1385320210975/collection1/lib/classes/' to classloader
   [junit4]   2> 1588621 T6242 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1385320210975/collection1/lib/README' to classloader
   [junit4]   2> 1588652 T6242 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 1588660 T6242 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1588663 T6242 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1588670 T6242 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1588805 T6242 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1588805 T6242 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1588807 T6242 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1588814 T6242 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1588815 T6242 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1588835 T6242 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1588838 T6242 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1588842 T6242 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1588844 T6242 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1588844 T6242 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1588844 T6242 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1588846 T6242 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1588847 T6242 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1588847 T6242 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1588847 T6242 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1385320210975\collection1\, dataDir=.\org.apache.solr.cloud.BasicDistributedZk2Test-1385320208844/jetty1\
   [junit4]   2> 1588848 T6242 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f8595c
   [junit4]   2> 1588848 T6242 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.BasicDistributedZk2Test-1385320208844/jetty1\
   [junit4]   2> 1588849 T6242 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.BasicDistributedZk2Test-1385320208844/jetty1\index/
   [junit4]   2> 1588849 T6242 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.BasicDistributedZk2Test-1385320208844\jetty1\index' doesn't exist. Creating new index...
   [junit4]   2> 1588849 T6242 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.BasicDistributedZk2Test-1385320208844/jetty1\index
   [junit4]   2> 1588850 T6242 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=19, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2526843779876036]
   [junit4]   2> 1588851 T6242 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1da58e6 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@18082aa),segFN=segments_1,generation=1}
   [junit4]   2> 1588851 T6242 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1588853 T6242 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1588853 T6242 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1588854 T6242 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1588854 T6242 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1588854 T6242 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1588855 T6242 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1588855 T6242 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1588855 T6242 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1588856 T6242 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1588856 T6242 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1588857 T6242 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1588857 T6242 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1588858 T6242 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1588858 T6242 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1588859 T6242 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1588859 T6242 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1588865 T6242 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1588867 T6242 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1588867 T6242 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1588868 T6242 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=46, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=1.98828125, floorSegmentMB=1.6494140625, forceMergeDeletesPctAllowed=0.6536880590736582, segmentsPerTier=12.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.41388369709055917
   [junit4]   2> 1588869 T6242 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1da58e6 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@18082aa),segFN=segments_1,generation=1}
   [junit4]   2> 1588869 T6242 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1588869 T6242 oass.SolrIndexSearcher.<init> Opening Searcher@4e458e main
   [junit4]   2> 1588871 T6243 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4e458e main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1588873 T6242 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1588873 T6242 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56830 collection:collection1 shard:shard2
   [junit4]   2> 1588874 T6242 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 1588884 T6242 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 1588887 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1588887 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1588887 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1588888 T6242 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1588888 T6242 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C8393 name=collection1 org.apache.solr.core.SolrCore@b3f2c url=http://127.0.0.1:56830/collection1 node=127.0.0.1:56830_ C8393_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:56830, core=collection1, node_name=127.0.0.1:56830_}
   [junit4]   2> 1588888 T6242 C8393 P56830 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:56830/collection1/
   [junit4]   2> 1588888 T6242 C8393 P56830 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1588888 T6242 C8393 P56830 oasc.SyncStrategy.syncToMe http://127.0.0.1:56830/collection1/ has no replicas
   [junit4]   2> 1588889 T6242 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:56830/collection1/ shard2
   [junit4]   2> 1588889 T6242 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 1588890 T6222 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1588896 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1588898 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1588902 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1589002 T6228 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1589002 T6241 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1589003 T6221 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1589045 T6242 oasc.ZkController.register We are http://127.0.0.1:56830/collection1/ and leader is http://127.0.0.1:56830/collection1/
   [junit4]   2> 1589045 T6242 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56830
   [junit4]   2> 1589045 T6242 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1589045 T6242 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 1589045 T6242 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1589047 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1589047 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1589048 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1589048 T6242 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1589049 T6199 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1589049 T6199 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1589056 T6222 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1589057 T6222 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:56830",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:56830_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 1589061 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1589163 T6241 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1589163 T6221 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1589163 T6228 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1589474 T6199 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1589478 T6199 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56839
   [junit4]   2> 1589479 T6199 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1589479 T6199 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1589480 T6199 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1385320213863
   [junit4]   2> 1589480 T6199 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1385320213863\'
   [junit4]   2> 1589504 T6199 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1385320213863\solr.xml
   [junit4]   2> 1589514 T6199 oasc.CoreContainer.<init> New CoreContainer 4992293
   [junit4]   2> 1589514 T6199 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1385320213863\]
   [junit4]   2> 1589516 T6199 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1589516 T6199 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 1589516 T6199 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1589516 T6199 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1589516 T6199 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1589516 T6199 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1589516 T6199 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1589516 T6199 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1589516 T6199 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1589523 T6199 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1589523 T6199 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1589523 T6199 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1589525 T6199 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56811/solr
   [junit4]   2> 1589525 T6199 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1589527 T6199 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1589549 T6255 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c92b53 name:ZooKeeperConnection Watcher:127.0.0.1:56811 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1589550 T6199 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1589554 T6199 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1589558 T6257 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d96978 name:ZooKeeperConnection Watcher:127.0.0.1:56811/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1589558 T6199 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1589564 T6199 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1590536 T6199 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56839_
   [junit4]   2> 1590540 T6199 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56839_
   [junit4]   2> 1590544 T6221 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1590544 T6241 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1590544 T6257 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1590545 T6228 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1590552 T6258 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 1590552 T6258 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1590554 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1590554 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1590554 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1590554 T6258 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1590556 T6222 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1590557 T6222 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:56839",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:56839_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1590557 T6222 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 1590557 T6222 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1590561 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1590660 T6228 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1590660 T6257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1590660 T6221 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1590660 T6241 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1591515 T6258 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1591515 T6258 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1385320213863\collection1
   [junit4]   2> 1591515 T6258 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1591516 T6258 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1591516 T6258 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1591518 T6258 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1385320213863\collection1\'
   [junit4]   2> 1591519 T6258 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1385320213863/collection1/lib/classes/' to classloader
   [junit4]   2> 1591520 T6258 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1385320213863/collection1/lib/README' to classloader
   [junit4]   2> 1591544 T6258 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 1591563 T6258 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1591565 T6258 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1591570 T6258 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1591662 T6258 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1591662 T6258 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1591664 T6258 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1591671 T6258 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1591671 T6258 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1591691 T6258 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1591694 T6258 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1591697 T6258 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1591699 T6258 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1591699 T6258 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1591700 T6258 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1591702 T6258 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1591702 T6258 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1591702 T6258 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1591703 T6258 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1385320213863\collection1\, dataDir=.\org.apache.solr.cloud.BasicDistributedZk2Test-1385320208844/jetty2\
   [junit4]   2> 1591703 T6258 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f8595c
   [junit4]   2> 1591704 T6258 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.BasicDistributedZk2Test-1385320208844/jetty2\
   [junit4]   2> 1591704 T6258 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.BasicDistributedZk2Test-1385320208844/jetty2\index/
   [junit4]   2> 1591704 T6258 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.BasicDistributedZk2Test-1385320208844\jetty2\index' doesn't exist. Creating new index...
   [junit4]   2> 1591704 T6258 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.BasicDistributedZk2Test-1385320208844/jetty2\index
   [junit4]   2> 1591705 T6258 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=19, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2526843779876036]
   [junit4]   2> 1591705 T6258 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1c9c463 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f3fc2d),segFN=segments_1,generation=1}
   [junit4]   2> 1591705 T6258 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1591707 T6258 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1591708 T6258 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1591708 T6258 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1591708 T6258 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1591708 T6258 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1591709 T6258 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1591709 T6258 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1591709 T6258 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1591710 T6258 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1591710 T6258 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1591710 T6258 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1591711 T6258 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1591711 T6258 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1591711 T6258 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1591712 T6258 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1591712 T6258 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1591716 T6258 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1591723 T6258 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1591723 T6258 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1591724 T6258 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=46, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=1.98828125, floorSegmentMB=1.6494140625, forceMergeDeletesPctAllowed=0.6536880590736582, segmentsPerTier=12.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.41388369709055917
   [junit4]   2> 1591725 T6258 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1c9c463 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f3fc2d),segFN=segments_1,generation=1}
   [junit4]   2> 1591725 T6258 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1591725 T6258 oass.SolrIndexSearcher.<init> Opening Searcher@108a574 main
   [junit4]   2> 1591729 T6259 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@108a574 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1591731 T6258 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1591731 T6258 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56839 collection:collection1 shard:shard1
   [junit4]   2> 1591732 T6258 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 1591741 T6258 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1591744 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1591744 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1591744 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1591745 T6258 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1591745 T6258 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C8394 name=collection1 org.apache.solr.core.SolrCore@1a365c5 url=http://127.0.0.1:56839/collection1 node=127.0.0.1:56839_ C8394_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:56839, core=collection1, node_name=127.0.0.1:56839_}
   [junit4]   2> 1591745 T6258 C8394 P56839 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:56839/collection1/
   [junit4]   2> 1591745 T6258 C8394 P56839 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1591745 T6258 C8394 P56839 oasc.SyncStrategy.syncToMe http://127.0.0.1:56839/collection1/ has no replicas
   [junit4]   2> 1591746 T6258 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:56839/collection1/ shard1
   [junit4]   2> 1591746 T6258 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 1591747 T6222 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1591752 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1591754 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1591759 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1591858 T6241 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1591858 T6228 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1591858 T6257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1591858 T6221 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1591900 T6258 oasc.ZkController.register We are http://127.0.0.1:56839/collection1/ and leader is http://127.0.0.1:56839/collection1/
   [junit4]   2> 1591900 T6258 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56839
   [junit4]   2> 1591900 T6258 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1591900 T6258 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 1591900 T6258 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1591903 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1591903 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1591903 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1591904 T6258 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1591905 T6222 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1591906 T6199 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1591907 T6199 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1591907 T6222 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:56839",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:56839_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 1591912 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1592013 T6228 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1592013 T6241 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1592014 T6221 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1592014 T6257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1592383 T6199 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1592386 T6199 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56848
   [junit4]   2> 1592386 T6199 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1592386 T6199 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1592386 T6199 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1385320216723
   [junit4]   2> 1592386 T6199 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1385320216723\'
   [junit4]   2> 1592412 T6199 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1385320216723\solr.xml
   [junit4]   2> 1592420 T6199 oasc.CoreContainer.<init> New CoreContainer 13338619
   [junit4]   2> 1592422 T6199 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1385320216723\]
   [junit4]   2> 1592423 T6199 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1592423 T6199 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 1592423 T6199 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1592423 T6199 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1592423 T6199 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1592423 T6199 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1592423 T6199 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1592425 T6199 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1592425 T6199 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1592432 T6199 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1592432 T6199 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1592432 T6199 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1592432 T6199 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56811/solr
   [junit4]   2> 1592434 T6199 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1592436 T6199 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1592443 T6271 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b56091 name:ZooKeeperConnection Watcher:127.0.0.1:56811 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1592444 T6199 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1592456 T6199 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1592459 T6273 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@377464 name:ZooKeeperConnection Watcher:127.0.0.1:56811/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1592459 T6199 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1592463 T6199 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1593338 T6199 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56848_
   [junit4]   2> 1593340 T6199 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56848_
   [junit4]   2> 1593343 T6221 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1593344 T6241 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1593344 T6273 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1593344 T6257 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1593345 T6228 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1593352 T6274 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 1593352 T6274 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1593354 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1593354 T6274 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1593354 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1593354 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1593356 T6222 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1593357 T6222 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:56848",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:56848_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1593357 T6222 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 1593357 T6222 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 1593362 T6221 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1593452 T6241 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1593452 T6221 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1593452 T6273 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1593453 T6257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1593452 T6228 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1594218 T6274 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1594219 T6274 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1385320216723\collection1
   [junit4]   2> 1594219 T6274 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1594221 T6274 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1594221 T6274 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1594222 T6274 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1385320216723\collection1\'
   [junit4]   2> 1594224 T6274 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Wind

[...truncated too long message...]

name":"127.0.0.1:56830_",
   [junit4]   1>                   "leader":"true"}}}},
   [junit4]   1>           "router":{"name":"compositeId"},
   [junit4]   1>           "autoCreated":"true",
   [junit4]   1>           "maxShardsPerNode":"1"},
   [junit4]   1>         "collection1":{
   [junit4]   1>           "replicationFactor":"1",
   [junit4]   1>           "shards":{
   [junit4]   1>             "shard1":{
   [junit4]   1>               "range":"80000000-ffffffff",
   [junit4]   1>               "state":"active",
   [junit4]   1>               "replicas":{
   [junit4]   1>                 "core_node2":{
   [junit4]   1>                   "state":"active",
   [junit4]   1>                   "base_url":"http://127.0.0.1:56839",
   [junit4]   1>                   "core":"collection1",
   [junit4]   1>                   "node_name":"127.0.0.1:56839_",
   [junit4]   1>                   "leader":"true"},
   [junit4]   1>                 "core_node4":{
   [junit4]   1>                   "state":"active",
   [junit4]   1>                   "base_url":"http://127.0.0.1:56858",
   [junit4]   1>                   "core":"collection1",
   [junit4]   1>                   "node_name":"127.0.0.1:56858_"}}},
   [junit4]   1>             "shard2":{
   [junit4]   1>               "range":"0-7fffffff",
   [junit4]   1>               "state":"active",
   [junit4]   1>               "replicas":{
   [junit4]   1>                 "core_node1":{
   [junit4]   1>                   "state":"active",
   [junit4]   1>                   "base_url":"http://127.0.0.1:56830",
   [junit4]   1>                   "core":"collection1",
   [junit4]   1>                   "node_name":"127.0.0.1:56830_",
   [junit4]   1>                   "leader":"true"},
   [junit4]   1>                 "core_node3":{
   [junit4]   1>                   "state":"active",
   [junit4]   1>                   "base_url":"http://127.0.0.1:56848",
   [junit4]   1>                   "core":"collection1",
   [junit4]   1>                   "node_name":"127.0.0.1:56848_"}}}},
   [junit4]   1>           "router":{"name":"compositeId"},
   [junit4]   1>           "autoCreated":"true",
   [junit4]   1>           "maxShardsPerNode":"1"},
   [junit4]   1>         "control_collection":{
   [junit4]   1>           "replicationFactor":"1",
   [junit4]   1>           "shards":{"shard1":{
   [junit4]   1>               "range":"80000000-7fffffff",
   [junit4]   1>               "state":"active",
   [junit4]   1>               "replicas":{"core_node1":{
   [junit4]   1>                   "state":"active",
   [junit4]   1>                   "base_url":"http://127.0.0.1:56818",
   [junit4]   1>                   "core":"collection1",
   [junit4]   1>                   "node_name":"127.0.0.1:56818_",
   [junit4]   1>                   "leader":"true"}}}},
   [junit4]   1>           "router":{"name":"compositeId"},
   [junit4]   1>           "autoCreated":"true",
   [junit4]   1>           "maxShardsPerNode":"1"}}
   [junit4]   1> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZk2Test -Dtests.method=testDistribSearch -Dtests.seed=B2901D7591B90E0B -Dtests.slow=true -Dtests.locale=sv -Dtests.timezone=America/Swift_Current -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 55.4s | BasicDistributedZk2Test.testDistribSearch <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Could not find the new collection - 404 : http://127.0.0.1:56839/onenodecollectioncore
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([B2901D7591B90E0B:3376936DE6E66E37]:0)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForNon403or404or503(AbstractFullDistribZkTestBase.java:1797)
   [junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.addAndQueryDocs(BasicDistributedZk2Test.java:206)
   [junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:195)
   [junit4]    > 	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:90)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 1639387 T6199 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: test params are: codec=Lucene41, sim=DefaultSimilarity, locale=sv, timezone=America/Swift_Current
   [junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.8.0-ea (32-bit)/cpus=2,threads=1,free=195124080,total=342814720
   [junit4]   2> NOTE: All tests run in this JVM: [TestReversedWildcardFilterFactory, WordBreakSolrSpellCheckerTest, MBeansHandlerTest, TestCopyFieldCollectionResource, FullSolrCloudDistribCmdsTest, CurrencyFieldOpenExchangeTest, TestFoldingMultitermQuery, EnumFieldTest, TriLevelCompositeIdRoutingTest, DirectSolrSpellCheckerTest, StatsComponentTest, TestStressVersions, PolyFieldTest, SuggesterTest, TestFunctionQuery, TestPartialUpdateDeduplication, TestWordDelimiterFilterFactory, LegacyHTMLStripCharFilterTest, DistributedSpellCheckComponentTest, NoCacheHeaderTest, TestSystemIdResolver, HdfsSyncSliceTest, UpdateRequestProcessorFactoryTest, IndexSchemaTest, FileUtilsTest, TestFastOutputStream, SolrCmdDistributorTest, TestCoreDiscovery, ZkControllerTest, PathHierarchyTokenizerFactoryTest, ZkCLITest, TestRealTimeGet, TestIndexingPerformance, TermVectorComponentDistributedTest, UnloadDistributedZkTest, SolrCoreCheckLockOnStartupTest, TestFaceting, ClusterStateTest, TestCollationKeyRangeQueries, PrimUtilsTest, SpellCheckCollatorTest, TestClassNameShortening, RequestHandlersTest, LeaderElectionTest, MoreLikeThisHandlerTest, PluginInfoTest, HdfsLockFactoryTest, JSONWriterTest, CoreAdminCreateDiscoverTest, TestRandomMergePolicy, ResourceLoaderTest, AssignTest, PeerSyncTest, TestSchemaSimilarityResource, SynonymTokenizerTest, TestZkChroot, DirectUpdateHandlerOptimizeTest, TestStressReorder, TestDefaultSimilarityFactory, TestPhraseSuggestions, CacheHeaderTest, TestRandomDVFaceting, RegexBoostProcessorTest, AddSchemaFieldsUpdateProcessorFactoryTest, DistanceFunctionTest, InfoHandlerTest, TestFieldResource, BadComponentTest, TestCollationField, TestStressUserVersions, TestUtils, TestQuerySenderListener, DateFieldTest, TestSuggestSpellingConverter, DeleteInactiveReplicaTest, RequiredFieldsTest, DebugComponentTest, TestSolrQueryParserResource, TestAnalyzedSuggestions, PreAnalyzedFieldTest, DateMathParserTest, TestElisionMultitermQuery, BinaryUpdateRequestHandlerTest, TestFileDictionaryLookup, ScriptEngineTest, URLClassifyProcessorTest, TestReplicationHandler, TestAtomicUpdateErrorCases, ShardRoutingTest, TestTrie, TestAnalyzeInfixSuggestions, SolrXmlInZkTest, TestSimpleQParserPlugin, TestDynamicFieldCollectionResource, TestDFRSimilarityFactory, TestManagedSchemaFieldResource, TestSurroundQueryParser, CurrencyFieldXmlFileTest, TestCSVResponseWriter, SolrTestCaseJ4Test, HdfsDirectoryTest, TestRangeQuery, TestUpdate, XmlUpdateRequestHandlerTest, TimeZoneUtilsTest, DirectSolrConnectionTest, SoftAutoCommitTest, ChaosMonkeySafeLeaderTest, StandardRequestHandlerTest, TestFieldTypeResource, TestSolrXml, CopyFieldTest, TestCloudManagedSchema, SolrInfoMBeanTest, PrimitiveFieldTypeTest, SliceStateTest, TestModifyConfFiles, TestCodecSupport, TestXIncludeConfig, TestJoin, TestBM25SimilarityFactory, TermVectorComponentTest, SolrIndexConfigTest, SimplePostToolTest, BlockCacheTest, TestDistributedGrouping, OverseerTest, SchemaVersionSpecificBehaviorTest, TestSolrJ, TestReload, DistributedSuggesterComponentTest, TestBinaryField, TestQueryTypes, ResponseLogComponentTest, QueryParsingTest, HdfsChaosMonkeySafeLeaderTest, ReturnFieldsTest, TestNumberUtils, DistributedTermsComponentTest, RAMDirectoryFactoryTest, MigrateRouteKeyTest, DocumentAnalysisRequestHandlerTest, SortByFunctionTest, TestExtendedDismaxParser, CoreAdminHandlerTest, RecoveryZkTest, HdfsRecoveryZkTest, SpellCheckComponentTest, SolrRequestParserTest, SolrPluginUtilsTest, DeleteReplicaTest, TestFastWriter, TestLMJelinekMercerSimilarityFactory, TestSolr4Spatial, TestValueSourceCache, TestHighFrequencyDictionaryFactory, TestStressLucene, TestHashPartitioner, TestNRTOpen, SolrIndexSplitterTest, ShardSplitTest, SpellingQueryConverterTest, TestPseudoReturnFields, TestSolrXmlPersistence, CustomCollectionTest, BasicDistributedZkTest, BasicDistributedZk2Test]
   [junit4] Completed in 55.41s, 1 test, 1 failure <<< FAILURES!

[...truncated 533 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:426: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:406: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:492: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1279: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:912: There were test failures: 345 suites, 1505 tests, 1 failure, 43 ignored (13 assumptions)

Total time: 72 minutes 9 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0-ea-b116 -server -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure