You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/11/24 12:35:37 UTC

[JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.7.0_45) - Build # 3501 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3501/
Java: 64bit/jdk1.7.0_45 -XX:+UseCompressedOops -XX:+UseParallelGC

4 tests failed.
REGRESSION:  org.apache.solr.analytics.NoFacetTest.stddevTest

Error Message:
Oops: (double raws) 4688277397122842624 - 4628496337733101339 < 4442235333156365461 Calculated diff 4688276920858191075 Let's see what the JVM thinks these bits are. FloatResult:  263901.0 floatTest: 27.72225134241226 Diff 263873.27774865757

Stack Trace:
java.lang.AssertionError: Oops: (double raws) 4688277397122842624 - 4628496337733101339 < 4442235333156365461 Calculated diff 4688276920858191075 Let's see what the JVM thinks these bits are. FloatResult:  263901.0 floatTest: 27.72225134241226 Diff 263873.27774865757
	at __randomizedtesting.SeedInfo.seed([9B43D1441B026691:9E8391F12B61629E]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.analytics.NoFacetTest.stddevTest(NoFacetTest.java:227)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)


REGRESSION:  org.apache.solr.analytics.facet.QueryFacetTest.queryTest

Error Message:
The query facet dependencies [float3] either do not exist or are defined in a dependency looop.

Stack Trace:
org.apache.solr.common.SolrException: The query facet dependencies [float3] either do not exist or are defined in a dependency looop.
	at __randomizedtesting.SeedInfo.seed([9B43D1441B026691:65A9FA57DA82904]:0)
	at org.apache.solr.analytics.request.AnalyticsRequestFactory.parse(AnalyticsRequestFactory.java:148)
	at org.apache.solr.analytics.request.AnalyticsStats.execute(AnalyticsStats.java:66)
	at org.apache.solr.handler.component.AnalyticsComponent.process(AnalyticsComponent.java:44)
	at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:209)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
	at org.apache.solr.core.SolrCore.execute(SolrCore.java:1866)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:291)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:273)
	at org.apache.solr.analytics.facet.QueryFacetTest.queryTest(QueryFacetTest.java:105)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)


REGRESSION:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
Expected content type application/octet-stream but got text/html;charset=ISO-8859-1. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 404 Can not find: /onenodecollectioncore/update</title> </head> <body> <h2>HTTP ERROR: 404</h2> <p>Problem accessing /onenodecollectioncore/update. Reason: <pre>    Can not find: /onenodecollectioncore/update</pre></p> <hr /><i><small>Powered by Jetty://</small></i>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected content type application/octet-stream but got text/html;charset=ISO-8859-1. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 Can not find: /onenodecollectioncore/update</title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /onenodecollectioncore/update. Reason:
<pre>    Can not find: /onenodecollectioncore/update</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
</body>
</html>

	at __randomizedtesting.SeedInfo.seed([9B43D1441B026691:1AA55F5C6C5D06AD]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:455)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:197)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:196)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:88)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)


REGRESSION:  org.apache.solr.cloud.UnloadDistributedZkTest.testDistribSearch

Error Message:
Still found shard2 in collection test_unload_shard_and_collection

Stack Trace:
java.lang.AssertionError: Still found shard2 in collection test_unload_shard_and_collection
	at __randomizedtesting.SeedInfo.seed([9B43D1441B026691:1AA55F5C6C5D06AD]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.UnloadDistributedZkTest.testUnloadShardAndCollection(UnloadDistributedZkTest.java:128)
	at org.apache.solr.cloud.UnloadDistributedZkTest.doTest(UnloadDistributedZkTest.java:78)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
	at sun.reflect.GeneratedMethodAccessor43.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)




Build Log:
[...truncated 9952 lines...]
   [junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
   [junit4]   2> 329412 T825 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 329418 T825 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-BasicDistributedZk2Test-1385290055735
   [junit4]   2> 329420 T825 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 329421 T826 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 329508 T825 oasc.ZkTestServer.run start zk server on port:54484
   [junit4]   2> 329511 T825 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 329522 T832 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5cc23584 name:ZooKeeperConnection Watcher:127.0.0.1:54484 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 329522 T825 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 329523 T825 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 329531 T827 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14289b8c03c0000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 329536 T825 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 329540 T834 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7524e048 name:ZooKeeperConnection Watcher:127.0.0.1:54484/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 329540 T825 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 329541 T825 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 329549 T825 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 329557 T825 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 329563 T825 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 329569 T825 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 329571 T825 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 329580 T825 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 329580 T825 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 329587 T825 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 329587 T825 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 329594 T825 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 329594 T825 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 329600 T825 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 329600 T825 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 329607 T825 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 329607 T825 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 329613 T825 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 329613 T825 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 329618 T825 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 329618 T825 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 329621 T825 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 329621 T825 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 329627 T825 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 329627 T825 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 329631 T825 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 329631 T825 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 330062 T825 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 330072 T825 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54491
   [junit4]   2> 330072 T825 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 330073 T825 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 330073 T825 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1385290055953
   [junit4]   2> 330073 T825 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1385290055953\'
   [junit4]   2> 330097 T825 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1385290055953\solr.xml
   [junit4]   2> 330183 T825 oasc.CoreContainer.<init> New CoreContainer 2062024617
   [junit4]   2> 330184 T825 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1385290055953\]
   [junit4]   2> 330186 T825 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 330186 T825 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 330186 T825 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 330187 T825 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 330187 T825 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 330187 T825 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 330187 T825 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 330187 T825 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 330187 T825 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 330198 T825 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 330198 T825 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 330199 T825 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 330199 T825 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54484/solr
   [junit4]   2> 330199 T825 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 330201 T825 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 330206 T845 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@61ebb6e5 name:ZooKeeperConnection Watcher:127.0.0.1:54484 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 330207 T825 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 330210 T827 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14289b8c03c0002, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 330212 T825 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 330214 T847 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@33285176 name:ZooKeeperConnection Watcher:127.0.0.1:54484/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 330214 T825 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 330218 T825 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 330225 T825 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 330232 T825 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 330235 T825 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54491_
   [junit4]   2> 330236 T825 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54491_
   [junit4]   2> 330241 T825 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 330248 T825 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 330253 T825 oasc.Overseer.start Overseer (id=90786369092976643-127.0.0.1:54491_-n_0000000000) starting
   [junit4]   2> 330258 T825 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 330263 T849 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 330264 T825 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 330267 T825 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 330269 T825 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 330274 T848 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 330279 T850 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 330279 T850 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 330280 T850 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 330280 T847 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 330283 T848 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 330284 T848 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:54491",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:54491_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 330284 T848 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 330284 T848 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 330287 T847 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 330288 T847 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 331145 T850 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 331145 T850 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1385290055953\collection1
   [junit4]   2> 331145 T850 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 331147 T850 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 331147 T850 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 331151 T850 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1385290055953\collection1\'
   [junit4]   2> 331151 T850 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1385290055953/collection1/lib/classes/' to classloader
   [junit4]   2> 331151 T850 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1385290055953/collection1/lib/README' to classloader
   [junit4]   2> 331217 T850 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 331266 T850 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 331269 T850 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 331282 T850 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 331787 T850 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 331797 T850 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 331800 T850 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 331824 T850 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 331828 T850 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 331832 T850 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 331834 T850 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 331835 T850 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 331835 T850 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 331836 T850 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 331836 T850 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 331836 T850 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 331836 T850 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1385290055953\collection1\, dataDir=.\org.apache.solr.cloud.BasicDistributedZk2Test-1385290055734/control/data\
   [junit4]   2> 331836 T850 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@351aa5d7
   [junit4]   2> 331837 T850 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.BasicDistributedZk2Test-1385290055734/control/data\
   [junit4]   2> 331837 T850 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.BasicDistributedZk2Test-1385290055734/control/data\index/
   [junit4]   2> 331837 T850 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.BasicDistributedZk2Test-1385290055734\control\data\index' doesn't exist. Creating new index...
   [junit4]   2> 331837 T850 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.BasicDistributedZk2Test-1385290055734/control/data\index
   [junit4]   2> 331837 T850 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=13.650390625, floorSegmentMB=1.8046875, forceMergeDeletesPctAllowed=19.4401140952715, segmentsPerTier=21.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5923233385611871
   [junit4]   2> 331838 T850 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@69473deb lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4d86e0a8),segFN=segments_1,generation=1}
   [junit4]   2> 331838 T850 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 331841 T850 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 331841 T850 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 331841 T850 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 331841 T850 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 331842 T850 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 331842 T850 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 331842 T850 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 331843 T850 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 331843 T850 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 331843 T850 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 331843 T850 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 331843 T850 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 331843 T850 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 331845 T850 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 331845 T850 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 331845 T850 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 331851 T850 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 331856 T850 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 331856 T850 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 331857 T850 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=62.2392578125, floorSegmentMB=0.3818359375, forceMergeDeletesPctAllowed=24.500702933760536, segmentsPerTier=42.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.17852658065059623
   [junit4]   2> 331857 T850 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@69473deb lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4d86e0a8),segFN=segments_1,generation=1}
   [junit4]   2> 331857 T850 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 331857 T850 oass.SolrIndexSearcher.<init> Opening Searcher@3766f63d main
   [junit4]   2> 331859 T851 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3766f63d main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 331860 T850 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 331860 T850 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:54491 collection:control_collection shard:shard1
   [junit4]   2> 331862 T850 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 331872 T850 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 331874 T847 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 331875 T850 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 331875 T850 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C237 name=collection1 org.apache.solr.core.SolrCore@ef0df48 url=http://127.0.0.1:54491/collection1 node=127.0.0.1:54491_ C237_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:54491, core=collection1, node_name=127.0.0.1:54491_}
   [junit4]   2> 331875 T850 C237 P54491 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:54491/collection1/
   [junit4]   2> 331875 T850 C237 P54491 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 331875 T850 C237 P54491 oasc.SyncStrategy.syncToMe http://127.0.0.1:54491/collection1/ has no replicas
   [junit4]   2> 331875 T850 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:54491/collection1/ shard1
   [junit4]   2> 331875 T850 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 331877 T848 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 331883 T847 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 331884 T847 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 331890 T848 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 331895 T847 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 331986 T847 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 332019 T850 oasc.ZkController.register We are http://127.0.0.1:54491/collection1/ and leader is http://127.0.0.1:54491/collection1/
   [junit4]   2> 332019 T850 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54491
   [junit4]   2> 332019 T850 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 332019 T850 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 332019 T850 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 332022 T847 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 332023 T847 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 332023 T847 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 332024 T850 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 332028 T848 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 332028 T825 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 332028 T825 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 332029 T848 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:54491",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:54491_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 332036 T825 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 332038 T847 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 332042 T854 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b8a365e name:ZooKeeperConnection Watcher:127.0.0.1:54484/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 332043 T825 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 332045 T825 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 332049 T825 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 332128 T854 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 332129 T847 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 332454 T825 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 332457 T825 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54503
   [junit4]   2> 332459 T825 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 332459 T825 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 332459 T825 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1385290058366
   [junit4]   2> 332459 T825 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1385290058366\'
   [junit4]   2> 332486 T825 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1385290058366\solr.xml
   [junit4]   2> 332546 T825 oasc.CoreContainer.<init> New CoreContainer 759519735
   [junit4]   2> 332546 T825 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1385290058366\]
   [junit4]   2> 332549 T825 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 332549 T825 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 332549 T825 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 332549 T825 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 332549 T825 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 332549 T825 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 332549 T825 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 332549 T825 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 332549 T825 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 332557 T825 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 332557 T825 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 332557 T825 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 332557 T825 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54484/solr
   [junit4]   2> 332557 T825 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 332560 T825 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 332564 T865 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7cecadac name:ZooKeeperConnection Watcher:127.0.0.1:54484 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 332565 T825 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 332568 T827 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14289b8c03c0005, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 332568 T825 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 332570 T867 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b7d43d3 name:ZooKeeperConnection Watcher:127.0.0.1:54484/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 332570 T825 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 332574 T825 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 333442 T825 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54503_
   [junit4]   2> 333446 T825 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54503_
   [junit4]   2> 333452 T867 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 333452 T854 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 333453 T847 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 333472 T868 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 333472 T868 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 333474 T847 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 333475 T847 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 333475 T847 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 333474 T868 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 333479 T848 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 333480 T848 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:54503",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:54503_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 333480 T848 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 333480 T848 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 333489 T847 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 333580 T867 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 333580 T854 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 333581 T847 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 334341 T868 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 334341 T868 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1385290058366\collection1
   [junit4]   2> 334341 T868 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 334342 T868 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 334342 T868 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 334346 T868 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1385290058366\collection1\'
   [junit4]   2> 334346 T868 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1385290058366/collection1/lib/classes/' to classloader
   [junit4]   2> 334346 T868 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1385290058366/collection1/lib/README' to classloader
   [junit4]   2> 334415 T868 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 334467 T868 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 334469 T868 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 334476 T868 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 334973 T868 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 334981 T868 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 334984 T868 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 335007 T868 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 335011 T868 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 335015 T868 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 335017 T868 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 335018 T868 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 335018 T868 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 335019 T868 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 335019 T868 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 335019 T868 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 335019 T868 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1385290058366\collection1\, dataDir=.\org.apache.solr.cloud.BasicDistributedZk2Test-1385290055734/jetty1\
   [junit4]   2> 335019 T868 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@351aa5d7
   [junit4]   2> 335020 T868 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.BasicDistributedZk2Test-1385290055734/jetty1\
   [junit4]   2> 335020 T868 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.BasicDistributedZk2Test-1385290055734/jetty1\index/
   [junit4]   2> 335020 T868 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.BasicDistributedZk2Test-1385290055734\jetty1\index' doesn't exist. Creating new index...
   [junit4]   2> 335020 T868 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.BasicDistributedZk2Test-1385290055734/jetty1\index
   [junit4]   2> 335020 T868 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=13.650390625, floorSegmentMB=1.8046875, forceMergeDeletesPctAllowed=19.4401140952715, segmentsPerTier=21.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5923233385611871
   [junit4]   2> 335021 T868 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3bdf5649 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@9b59abf),segFN=segments_1,generation=1}
   [junit4]   2> 335021 T868 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 335024 T868 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 335024 T868 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 335025 T868 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 335025 T868 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 335025 T868 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 335025 T868 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 335025 T868 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 335025 T868 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 335025 T868 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 335026 T868 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 335026 T868 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 335026 T868 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 335026 T868 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 335027 T868 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 335027 T868 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 335028 T868 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 335034 T868 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 335041 T868 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 335041 T868 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 335041 T868 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=62.2392578125, floorSegmentMB=0.3818359375, forceMergeDeletesPctAllowed=24.500702933760536, segmentsPerTier=42.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.17852658065059623
   [junit4]   2> 335041 T868 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3bdf5649 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@9b59abf),segFN=segments_1,generation=1}
   [junit4]   2> 335041 T868 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 335043 T868 oass.SolrIndexSearcher.<init> Opening Searcher@27996370 main
   [junit4]   2> 335044 T869 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@27996370 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 335047 T868 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 335047 T868 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:54503 collection:collection1 shard:shard2
   [junit4]   2> 335047 T868 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 335057 T868 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 335060 T847 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 335060 T847 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 335060 T847 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 335060 T868 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 335060 T868 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C238 name=collection1 org.apache.solr.core.SolrCore@6feb79a3 url=http://127.0.0.1:54503/collection1 node=127.0.0.1:54503_ C238_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:54503, core=collection1, node_name=127.0.0.1:54503_}
   [junit4]   2> 335060 T868 C238 P54503 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:54503/collection1/
   [junit4]   2> 335060 T868 C238 P54503 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 335060 T868 C238 P54503 oasc.SyncStrategy.syncToMe http://127.0.0.1:54503/collection1/ has no replicas
   [junit4]   2> 335060 T868 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:54503/collection1/ shard2
   [junit4]   2> 335061 T868 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 335064 T848 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 335069 T847 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 335072 T847 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 335077 T847 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 335158 T847 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 335159 T867 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 335159 T854 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 335192 T868 oasc.ZkController.register We are http://127.0.0.1:54503/collection1/ and leader is http://127.0.0.1:54503/collection1/
   [junit4]   2> 335192 T868 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54503
   [junit4]   2> 335192 T868 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 335192 T868 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 335192 T868 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 335195 T847 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 335195 T847 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 335195 T847 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 335196 T868 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 335199 T848 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 335199 T825 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 335200 T825 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 335201 T848 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:54503",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:54503_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 335206 T847 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 335294 T854 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 335294 T847 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 335294 T867 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 335586 T825 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 335588 T825 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54512
   [junit4]   2> 335590 T825 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 335590 T825 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 335590 T825 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1385290061518
   [junit4]   2> 335591 T825 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1385290061518\'
   [junit4]   2> 335610 T825 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1385290061518\solr.xml
   [junit4]   2> 335667 T825 oasc.CoreContainer.<init> New CoreContainer 338422852
   [junit4]   2> 335667 T825 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1385290061518\]
   [junit4]   2> 335668 T825 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 335669 T825 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 335669 T825 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 335669 T825 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 335669 T825 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 335669 T825 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 335670 T825 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 335670 T825 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 335670 T825 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 335677 T825 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 335677 T825 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 335677 T825 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 335678 T825 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54484/solr
   [junit4]   2> 335678 T825 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 335680 T825 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 335686 T881 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@77f5c1c7 name:ZooKeeperConnection Watcher:127.0.0.1:54484 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 335687 T825 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 335691 T825 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 335695 T883 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f474720 name:ZooKeeperConnection Watcher:127.0.0.1:54484/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 335695 T825 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 335701 T825 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 336483 T825 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54512_
   [junit4]   2> 336487 T825 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54512_
   [junit4]   2> 336495 T854 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 336496 T847 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 336496 T883 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 336497 T867 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 336517 T884 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 336517 T884 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 336521 T884 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 336521 T847 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 336521 T847 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 336521 T847 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 336525 T848 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 336526 T848 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:54512",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:54512_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 336526 T848 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 336526 T848 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 336531 T847 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 336614 T883 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 336614 T867 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 336615 T847 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 336615 T854 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 337299 T884 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 337299 T884 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1385290061518\collection1
   [junit4]   2> 337299 T884 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 337301 T884 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 337301 T884 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 337304 T884 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1385290061518\collection1\'
   [junit4]   2> 337305 T884 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1385290061518/collection1/lib/classes/' to classloader
   [junit4]   2> 337307 T884 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1385290061518/collection1/lib/README' to classloader
   [junit4]   2> 337366 T884 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 337414 T884 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 337416 T884 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 337423 T884 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 337924 T884 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 337932 T884 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 337935 T884 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 337956 T884 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 337960 T884 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 337965 T884 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 337967 T884 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 337967 T884 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 337967 T884 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 337968 T884 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 337968 T884 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 337968 T884 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 337969 T884 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1385290061518\collection1\, dataDir=.\org.apache.solr.cloud.BasicDistributedZk2Test-1385290055734/jetty2\
   [junit4]   2> 337969 T884 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@351aa5d7
   [junit4]   2> 337971 T884 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.BasicDistributedZk2Test-1385290055734/jetty2\
   [junit4]   2> 337971 T884 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.BasicDistributedZk2Test-1385290055734/jetty2\index/
   [junit4]   2> 337971 T884 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.BasicDistributedZk2Test-1385290055734\jetty2\index' doesn't exist. Creating new index...
   [junit4]   2> 337971 T884 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.BasicDistributedZk2Test-1385290055734/jetty2\index
   [junit4]   2> 337971 T884 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=13.650390625, floorSegmentMB=1.8046875, forceMergeDeletesPctAllowed=19.4401140952715, segmentsPerTier=21.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5923233385611871
   [junit4]   2> 337971 T884 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@46d62bda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3f5dea88),segFN=segments_1,generation=1}
   [junit4]   2> 337972 T884 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 337978 T884 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 337978 T884 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 337978 T884 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 337978 T884 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 337978 T884 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 337979 T884 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 337979 T884 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 337980 T884 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 337980 T884 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 337980 T884 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 337981 T884 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 337981 T884 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 337981 T884 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 337982 T884 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 337982 T884 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 337983 T884 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 337993 T884 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 337997 T884 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 337997 T884 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 337998 T884 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=62.2392578125, floorSegmentMB=0.3818359375, forceMergeDeletesPctAllowed=24.500702933760536, segmentsPerTier=42.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.17852658065059623
   [junit4]   2> 337999 T884 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@46d62bda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3f5dea88),segFN=segments_1,generation=1}
   [junit4]   2> 337999 T884 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 337999 T884 oass.SolrIndexSearcher.<init> Opening Searcher@31cc954d main
   [junit4]   2> 338002 T885 oasc.SolrCore.registerSearcher 

[...truncated too long message...]

ace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-QueryFacetTest-1385292327674\
   [junit4]   2> 2603444 T7920 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-QueryFacetTest-1385292327674\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-QueryFacetTest-1385292327674\index;done=false>>]
   [junit4]   2> 2603444 T7920 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-QueryFacetTest-1385292327674\index
   [junit4]   2> NOTE: test params are: codec=Lucene46: {int_id=MockFixedIntBlock(blockSize=1978), string_sd=MockFixedIntBlock(blockSize=1978), double_dd=PostingsFormat(name=MockSep), long_ld=MockFixedIntBlock(blockSize=1978), date_dtd=MockFixedIntBlock(blockSize=1978), float_fd=PostingsFormat(name=FSTPulsing41), id=MockFixedIntBlock(blockSize=1978)}, docValues:{floatdv=DocValuesFormat(name=Disk), int_id=DocValuesFormat(name=Memory), string_sd=DocValuesFormat(name=Memory), double_dd=DocValuesFormat(name=Disk), doubledv=DocValuesFormat(name=Memory), long_ld=DocValuesFormat(name=Memory), date_dtd=DocValuesFormat(name=Memory), longdv=DocValuesFormat(name=Disk), float_fd=DocValuesFormat(name=Lucene45), intdv=DocValuesFormat(name=Lucene45), stringdvm=DocValuesFormat(name=Disk), datedv=DocValuesFormat(name=Disk), stringdv=DocValuesFormat(name=Memory)}, sim=DefaultSimilarity, locale=ar_MA, timezone=Europe/Rome
   [junit4]   2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.7.0_45 (64-bit)/cpus=2,threads=1,free=171543904,total=402653184
   [junit4]   2> NOTE: All tests run in this JVM: [SuggesterTSTTest, TestSolrJ, TestDFRSimilarityFactory, BasicZkTest, OverseerCollectionProcessorTest, FieldAnalysisRequestHandlerTest, OverseerTest, TestStressReorder, TestFunctionQuery, TestSweetSpotSimilarityFactory, TestRecoveryHdfs, ShardSplitTest, SolrIndexSplitterTest, WordBreakSolrSpellCheckerTest, BasicDistributedZk2Test, TestAnalyzedSuggestions, TestStressRecovery, DirectUpdateHandlerTest, ChaosMonkeyNothingIsSafeTest, TestSchemaNameResource, TestPartialUpdateDeduplication, ChaosMonkeySafeLeaderTest, BadComponentTest, TestRemoteStreaming, HighlighterTest, AnalysisAfterCoreReloadTest, UUIDFieldTest, SliceStateTest, PrimUtilsTest, TestQuerySenderNoQuery, TestAtomicUpdateErrorCases, TestCloudManagedSchema, ClusterStateTest, TestSolrQueryParserDefaultOperatorResource, BlockCacheTest, SimplePostToolTest, EchoParamsTest, NumericFieldsTest, TestHighFrequencyDictionaryFactory, SpellCheckCollatorTest, TestMaxScoreQueryParser, UpdateParamsTest, TestCloudManagedSchemaAddField, SolrCoreTest, TestDefaultSearchFieldResource, ZkControllerTest, SolrRequestParserTest, TestNoOpRegenerator, ConvertedLegacyTest, TestZkChroot, TestFieldResource, SimpleFacetsTest, TestRangeQuery, TestBM25SimilarityFactory, DocValuesMissingTest, TestJmxIntegration, SoftAutoCommitTest, TestManagedSchemaFieldResource, TestRecovery, SynonymTokenizerTest, ResourceLoaderTest, TestIBSimilarityFactory, SyncSliceTest, TestFieldCollectionResource, DistributedDebugComponentTest, TestOmitPositions, TestConfig, PreAnalyzedUpdateProcessorTest, TestQuerySenderListener, TestFiltering, LeaderElectionIntegrationTest, SolrCoreCheckLockOnStartupTest, CircularListTest, ShardRoutingTest, SuggesterTest, TestFastWriter, AddSchemaFieldsUpdateProcessorFactoryTest, TestSuggestSpellingConverter, HdfsBasicDistributedZkTest, QueryParsingTest, DistributedTermsComponentTest, TermVectorComponentDistributedTest, FieldMutatingUpdateProcessorTest, OutputWriterTest, TestUtils, FileUtilsTest, CSVRequestHandlerTest, TestReversedWildcardFilterFactory, CurrencyFieldOpenExchangeTest, TestPhraseSuggestions, DistanceFunctionTest, RecoveryZkTest, TestLuceneMatchVersion, LukeRequestHandlerTest, SpellPossibilityIteratorTest, SortByFunctionTest, AbstractAnalyticsStatsTest, InfoHandlerTest, BasicFunctionalityTest, DateFieldTest, TestSort, TestBadConfig, TestFileDictionaryLookup, TestExtendedDismaxParser, TestUniqueKeyFieldResource, TestSchemaVersionResource, FunctionTest, BlockDirectoryTest, TestFuzzyAnalyzedSuggestions, DisMaxRequestHandlerTest, RangeFacetTest, DirectUpdateHandlerOptimizeTest, TestSerializedLuceneMatchVersion, DeleteShardTest, SolrIndexConfigTest, QueryEqualityTest, TestSolrQueryParser, CurrencyFieldXmlFileTest, SpatialFilterTest, TestWriterPerf, IndexSchemaRuntimeFieldTest, TestRealTimeGet, ScriptEngineTest, HdfsBasicDistributedZk2Test, FieldFacetExtrasTest, TestFastLRUCache, DistributedSpellCheckComponentTest, StatsComponentTest, TestLazyCores, NoFacetTest, TestDynamicFieldCollectionResource, TestSurroundQueryParser, BadIndexSchemaTest, ZkNodePropsTest, SpellCheckComponentTest, AssignTest, CoreContainerCoreInitFailuresTest, TestCollationField, TestDistributedSearch, DistributedSuggesterComponentTest, LegacyHTMLStripCharFilterTest, SolrTestCaseJ4Test, TestClassNameShortening, TestSolrCoreProperties, DebugComponentTest, TestJmxMonitoredMap, TestNonNRTOpen, CoreAdminHandlerTest, TestReload, TestNumberUtils, LeaderElectionTest, PeerSyncTest, DocValuesMultiTest, SliceStateUpdateTest, StatelessScriptUpdateProcessorFactoryTest, DefaultValueUpdateProcessorTest, ChangedSchemaMergeTest, TestMultiCoreConfBootstrap, HdfsChaosMonkeySafeLeaderTest, FileBasedSpellCheckerTest, MultiTermTest, TestDynamicFieldResource, TestWordDelimiterFilterFactory, SolrXmlInZkTest, TestDocSet, TestCopyFieldCollectionResource, SolrInfoMBeanTest, TestSystemIdResolver, CacheHeaderTest, IndexBasedSpellCheckerTest, PrimitiveFieldTypeTest, TestRandomMergePolicy, BasicDistributedZkTest, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, OpenCloseCoreStressTest, FullSolrCloudDistribCmdsTest, TestReplicationHandler, ClusterStateUpdateTest, TestRandomFaceting, ZkSolrClientTest, TestRandomDVFaceting, ZkCLITest, ShardRoutingCustomTest, AutoCommitTest, TestDistributedGrouping, TestFaceting, TestHashPartitioner, TestJoin, TestStressVersions, HardAutoCommitTest, TestCoreContainer, TestSolr4Spatial, TestGroupingSearch, SolrCmdDistributorTest, QueryElevationComponentTest, TestIndexSearcher, ShowFileRequestHandlerTest, DistributedQueryElevationComponentTest, TestCoreDiscovery, SignatureUpdateProcessorFactoryTest, SuggesterFSTTest, TestFoldingMultitermQuery, DocValuesTest, TestStressLucene, TestTrie, SuggesterWFSTTest, TestCSVLoader, PolyFieldTest, NoCacheHeaderTest, SchemaVersionSpecificBehaviorTest, TestPseudoReturnFields, TestUpdate, TestSolrDeletionPolicy1, XsltUpdateRequestHandlerTest, TestQueryUtils, StandardRequestHandlerTest, DirectSolrSpellCheckerTest, DocumentAnalysisRequestHandlerTest, TestQueryTypes, TermsComponentTest, XmlUpdateRequestHandlerTest, RequestHandlersTest, DocumentBuilderTest, TestValueSourceCache, PathHierarchyTokenizerFactoryTest, TermVectorComponentTest, TestIndexingPerformance, MoreLikeThisHandlerTest, RequiredFieldsTest, TestArbitraryIndexDir, FastVectorHighlighterTest, LoggingHandlerTest, RegexBoostProcessorTest, SolrPluginUtilsTest, IndexSchemaTest, ReturnFieldsTest, UpdateRequestProcessorFactoryTest, JSONWriterTest, TestCSVResponseWriter, MBeansHandlerTest, UniqFieldsUpdateProcessorFactoryTest, JsonLoaderTest, BinaryUpdateRequestHandlerTest, TestPHPSerializedResponseWriter, PingRequestHandlerTest, TestComponentsName, SearchHandlerTest, TestBinaryResponseWriter, TestLFUCache, HighlighterConfigTest, SOLR749Test, AlternateDirectoryTest, TestSolrIndexConfig, CopyFieldTest, ResponseLogComponentTest, TestMergePolicyConfig, TestSolrDeletionPolicy2, SampleTest, TestBinaryField, TestSearchPerf, MinimalSchemaTest, TestElisionMultitermQuery, ExternalFileFieldSortTest, TestPostingsSolrHighlighter, DirectSolrConnectionTest, NotRequiredUniqueKeyTest, TestCharFilters, TestCodecSupport, TestXIncludeConfig, TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestDefaultSimilarityFactory, TimeZoneUtilsTest, TestFastOutputStream, OpenExchangeRatesOrgProviderTest, URLClassifyProcessorTest, PluginInfoTest, DateMathParserTest, TestSolrXMLSerializer, PreAnalyzedFieldTest, SpellingQueryConverterTest, DOMUtilTest, RAMDirectoryFactoryTest, TestLRUCache, TestDocumentBuilder, SystemInfoHandlerTest, TestRTGBase, ExpressionTest, AbstractAnalyticsFacetTest, FieldFacetTest, QueryFacetTest]
   [junit4] Completed in 2.12s, 1 test, 1 error <<< FAILURES!

[...truncated 157 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:420: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:400: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:492: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1275: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:908: There were test failures: 353 suites, 1558 tests, 2 errors, 2 failures, 39 ignored (11 assumptions)

Total time: 77 minutes 29 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_45 -XX:+UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Re: [JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.7.0_45) - Build # 3504 - Still Failing!

Posted by Mark Miller <ma...@gmail.com>.
Seems to be rare, but I’ve seen it a few times - ConcurrentUpdateSolrServer.blockUntilFinished does not return even though there appear to be no runner threads left.

- Mark

On Nov 25, 2013, at 3:54 AM, Policeman Jenkins Server <je...@thetaphi.de> wrote:

> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3504/
> Java: 64bit/jdk1.7.0_45 -XX:+UseCompressedOops -XX:+UseSerialGC
> 
> 3 tests failed.
> FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
> 
> Error Message:
> ERROR: SolrIndexSearcher opens=23 closes=22
> 
> Stack Trace:
> java.lang.AssertionError: ERROR: SolrIndexSearcher opens=23 closes=22
> 	at __randomizedtesting.SeedInfo.seed([9F3EB56801A84E02]:0)
> 	at org.junit.Assert.fail(Assert.java:93)
> 	at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:330)
> 	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:136)
> 	at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> 	at java.lang.Thread.run(Thread.java:744)
> 
> 
> FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
> 
> Error Message:
> 2 threads leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest:     1) Thread[id=7836, name=qtp871330187-7836, state=RUNNABLE, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrServer.blockUntilFinished(ConcurrentUpdateSolrServer.java:391)         at org.apache.solr.update.StreamingSolrServers.blockUntilFinished(StreamingSolrServers.java:104)         at org.apache.solr.update.SolrCmdDistributor.doRetriesIfNeeded(SolrCmdDistributor.java:134)         at org.apache.solr.update.SolrCmdDistributor.finish(SolrCmdDistributor.java:60)         at org.apache.solr.update.processor.DistributedUpdateProcessor.doFinish(DistributedUpdateProcessor.java:609)         at org.apache.solr.update.processor.DistributedUpdateProcessor.finish(DistributedUpdateProcessor.java:1457)         at org.apache.solr.update.processor.LogUpdateProcessor.finish(LogUpdateProcessorFactory.java:179)         at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:83)         at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1866)         at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:755)         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:417)         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:201)         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)         at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:134)         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)         at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)         at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)         at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)         at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)         at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)         at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)         at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)         at org.eclipse.jetty.server.Server.handle(Server.java:368)         at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)         at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)         at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:953)         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)         at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)         at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)         at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:744)    2) Thread[id=7845, name=searcherExecutor-5068-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:744)
> 
> Stack Trace:
> com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest: 
>   1) Thread[id=7836, name=qtp871330187-7836, state=RUNNABLE, group=TGRP-ChaosMonkeyNothingIsSafeTest]
>        at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrServer.blockUntilFinished(ConcurrentUpdateSolrServer.java:391)
>        at org.apache.solr.update.StreamingSolrServers.blockUntilFinished(StreamingSolrServers.java:104)
>        at org.apache.solr.update.SolrCmdDistributor.doRetriesIfNeeded(SolrCmdDistributor.java:134)
>        at org.apache.solr.update.SolrCmdDistributor.finish(SolrCmdDistributor.java:60)
>        at org.apache.solr.update.processor.DistributedUpdateProcessor.doFinish(DistributedUpdateProcessor.java:609)
>        at org.apache.solr.update.processor.DistributedUpdateProcessor.finish(DistributedUpdateProcessor.java:1457)
>        at org.apache.solr.update.processor.LogUpdateProcessor.finish(LogUpdateProcessorFactory.java:179)
>        at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:83)
>        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
>        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1866)
>        at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:755)
>        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:417)
>        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:201)
>        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
>        at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:134)
>        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
>        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
>        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
>        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
>        at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
>        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
>        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
>        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
>        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
>        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
>        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
>        at org.eclipse.jetty.server.Server.handle(Server.java:368)
>        at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
>        at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
>        at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
>        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:953)
>        at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
>        at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
>        at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
>        at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>        at java.lang.Thread.run(Thread.java:744)
>   2) Thread[id=7845, name=searcherExecutor-5068-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
>        at sun.misc.Unsafe.park(Native Method)
>        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>        at java.lang.Thread.run(Thread.java:744)
> 	at __randomizedtesting.SeedInfo.seed([9F3EB56801A84E02]:0)
> 
> 
> FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
> 
> Error Message:
> There are still zombie threads that couldn't be terminated:    1) Thread[id=7845, name=searcherExecutor-5068-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:744)    2) Thread[id=7836, name=qtp871330187-7836, state=RUNNABLE, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrServer.blockUntilFinished(ConcurrentUpdateSolrServer.java:391)         at org.apache.solr.update.StreamingSolrServers.blockUntilFinished(StreamingSolrServers.java:104)         at org.apache.solr.update.SolrCmdDistributor.doRetriesIfNeeded(SolrCmdDistributor.java:134)         at org.apache.solr.update.SolrCmdDistributor.finish(SolrCmdDistributor.java:60)         at org.apache.solr.update.processor.DistributedUpdateProcessor.doFinish(DistributedUpdateProcessor.java:609)         at org.apache.solr.update.processor.DistributedUpdateProcessor.finish(DistributedUpdateProcessor.java:1457)         at org.apache.solr.update.processor.LogUpdateProcessor.finish(LogUpdateProcessorFactory.java:179)         at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:83)         at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1866)         at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:755)         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:417)         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:201)         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)         at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:134)         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)         at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)         at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)         at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)         at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)         at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)         at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)         at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)         at org.eclipse.jetty.server.Server.handle(Server.java:368)         at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)         at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)         at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:953)         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)         at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)         at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)         at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:744)
> 
> Stack Trace:
> com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
>   1) Thread[id=7845, name=searcherExecutor-5068-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
>        at sun.misc.Unsafe.park(Native Method)
>        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>        at java.lang.Thread.run(Thread.java:744)
>   2) Thread[id=7836, name=qtp871330187-7836, state=RUNNABLE, group=TGRP-ChaosMonkeyNothingIsSafeTest]
>        at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrServer.blockUntilFinished(ConcurrentUpdateSolrServer.java:391)
>        at org.apache.solr.update.StreamingSolrServers.blockUntilFinished(StreamingSolrServers.java:104)
>        at org.apache.solr.update.SolrCmdDistributor.doRetriesIfNeeded(SolrCmdDistributor.java:134)
>        at org.apache.solr.update.SolrCmdDistributor.finish(SolrCmdDistributor.java:60)
>        at org.apache.solr.update.processor.DistributedUpdateProcessor.doFinish(DistributedUpdateProcessor.java:609)
>        at org.apache.solr.update.processor.DistributedUpdateProcessor.finish(DistributedUpdateProcessor.java:1457)
>        at org.apache.solr.update.processor.LogUpdateProcessor.finish(LogUpdateProcessorFactory.java:179)
>        at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:83)
>        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
>        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1866)
>        at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:755)
>        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:417)
>        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:201)
>        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
>        at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:134)
>        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
>        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
>        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
>        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
>        at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
>        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
>        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
>        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
>        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
>        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
>        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
>        at org.eclipse.jetty.server.Server.handle(Server.java:368)
>        at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
>        at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
>        at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
>        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:953)
>        at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
>        at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
>        at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
>        at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
>        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>        at java.lang.Thread.run(Thread.java:744)
> 	at __randomizedtesting.SeedInfo.seed([9F3EB56801A84E02]:0)
> 
> 
> 
> 
> Build Log:
> [...truncated 10762 lines...]
>   [junit4] Suite: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
>   [junit4]   2> 2727439 T7751 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
>   [junit4]   2> 2727445 T7751 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
>   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-ChaosMonkeyNothingIsSafeTest-1385369269877
>   [junit4]   2> 2727446 T7751 oasc.ZkTestServer.run STARTING ZK TEST SERVER
>   [junit4]   2> 2727447 T7752 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
>   [junit4]   2> 2727525 T7751 oasc.ZkTestServer.run start zk server on port:56251
>   [junit4]   2> 2727527 T7751 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 2727532 T7758 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@282ac134 name:ZooKeeperConnection Watcher:127.0.0.1:56251 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 2727532 T7751 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 2727532 T7751 oascc.SolrZkClient.makePath makePath: /solr
>   [junit4]   2> 2727536 T7753 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1428e71767a0000, likely client has closed socket
>   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
>   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
>   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
>   [junit4]   2> 
>   [junit4]   2> 2727538 T7751 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 2727540 T7760 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6d875e3c name:ZooKeeperConnection Watcher:127.0.0.1:56251/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 2727541 T7751 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 2727541 T7751 oascc.SolrZkClient.makePath makePath: /collections/collection1
>   [junit4]   2> 2727545 T7751 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
>   [junit4]   2> 2727547 T7751 oascc.SolrZkClient.makePath makePath: /collections/control_collection
>   [junit4]   2> 2727549 T7751 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
>   [junit4]   2> 2727552 T7751 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
>   [junit4]   2> 2727553 T7751 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
>   [junit4]   2> 2727557 T7751 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
>   [junit4]   2> 2727557 T7751 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
>   [junit4]   2> 2727561 T7751 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
>   [junit4]   2> 2727561 T7751 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
>   [junit4]   2> 2727564 T7751 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
>   [junit4]   2> 2727565 T7751 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
>   [junit4]   2> 2727567 T7751 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
>   [junit4]   2> 2727568 T7751 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
>   [junit4]   2> 2727571 T7751 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
>   [junit4]   2> 2727571 T7751 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
>   [junit4]   2> 2727574 T7751 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
>   [junit4]   2> 2727574 T7751 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
>   [junit4]   2> 2727577 T7751 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
>   [junit4]   2> 2727578 T7751 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
>   [junit4]   2> 2727580 T7751 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
>   [junit4]   2> 2727580 T7751 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
>   [junit4]   2> 2727583 T7751 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
>   [junit4]   2> 2727584 T7751 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
>   [junit4]   2> 2727586 T7751 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
>   [junit4]   2> 2727587 T7751 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
>   [junit4]   2> 2727591 T7753 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1428e71767a0001, likely client has closed socket
>   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
>   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
>   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
>   [junit4]   2> 
>   [junit4]   2> 2727937 T7751 oejs.Server.doStart jetty-8.1.10.v20130312
>   [junit4]   2> 2727946 T7751 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56258
>   [junit4]   2> 2727947 T7751 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
>   [junit4]   2> 2727947 T7751 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
>   [junit4]   2> 2727947 T7751 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385369270022
>   [junit4]   2> 2727947 T7751 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385369270022\'
>   [junit4]   2> 2727970 T7751 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385369270022\solr.xml
>   [junit4]   2> 2728043 T7751 oasc.CoreContainer.<init> New CoreContainer 684522700
>   [junit4]   2> 2728043 T7751 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385369270022\]
>   [junit4]   2> 2728044 T7751 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
>   [junit4]   2> 2728044 T7751 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
>   [junit4]   2> 2728045 T7751 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
>   [junit4]   2> 2728045 T7751 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
>   [junit4]   2> 2728045 T7751 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
>   [junit4]   2> 2728046 T7751 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
>   [junit4]   2> 2728046 T7751 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
>   [junit4]   2> 2728046 T7751 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
>   [junit4]   2> 2728047 T7751 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
>   [junit4]   2> 2728054 T7751 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
>   [junit4]   2> 2728054 T7751 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>   [junit4]   2> 2728054 T7751 oasc.CoreContainer.load Host Name: 127.0.0.1
>   [junit4]   2> 2728055 T7751 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56251/solr
>   [junit4]   2> 2728055 T7751 oasc.ZkController.checkChrootPath zkHost includes chroot
>   [junit4]   2> 2728057 T7751 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 2728065 T7771 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6996f2db name:ZooKeeperConnection Watcher:127.0.0.1:56251 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 2728066 T7751 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 2728070 T7751 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 2728073 T7773 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@29e403c2 name:ZooKeeperConnection Watcher:127.0.0.1:56251/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 2728074 T7751 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 2728075 T7751 oascc.SolrZkClient.makePath makePath: /overseer/queue
>   [junit4]   2> 2728081 T7751 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
>   [junit4]   2> 2728086 T7751 oascc.SolrZkClient.makePath makePath: /live_nodes
>   [junit4]   2> 2728090 T7751 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56258_
>   [junit4]   2> 2728090 T7751 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56258_
>   [junit4]   2> 2728095 T7751 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
>   [junit4]   2> 2728104 T7751 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
>   [junit4]   2> 2728107 T7751 oasc.Overseer.start Overseer (id=90791560470986755-127.0.0.1:56258_-n_0000000000) starting
>   [junit4]   2> 2728112 T7751 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
>   [junit4]   2> 2728130 T7775 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
>   [junit4]   2> 2728131 T7751 oascc.SolrZkClient.makePath makePath: /clusterstate.json
>   [junit4]   2> 2728136 T7751 oascc.SolrZkClient.makePath makePath: /aliases.json
>   [junit4]   2> 2728140 T7751 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
>   [junit4]   2> 2728144 T7774 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
>   [junit4]   2> 2728151 T7776 oasc.ZkController.publish publishing core=collection1 state=down
>   [junit4]   2> 2728151 T7776 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
>   [junit4]   2> 2728152 T7776 oasc.ZkController.waitForCoreNodeName look for our core node name
>   [junit4]   2> 2728152 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 2728155 T7774 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 2728156 T7774 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
>   [junit4]   2> 	  "operation":"state",
>   [junit4]   2> 	  "state":"down",
>   [junit4]   2> 	  "base_url":"http://127.0.0.1:56258",
>   [junit4]   2> 	  "core":"collection1",
>   [junit4]   2> 	  "roles":null,
>   [junit4]   2> 	  "node_name":"127.0.0.1:56258_",
>   [junit4]   2> 	  "shard":null,
>   [junit4]   2> 	  "shard_range":null,
>   [junit4]   2> 	  "shard_state":"active",
>   [junit4]   2> 	  "shard_parent":null,
>   [junit4]   2> 	  "collection":"control_collection",
>   [junit4]   2> 	  "numShards":"1",
>   [junit4]   2> 	  "core_node_name":null}
>   [junit4]   2> 2728156 T7774 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
>   [junit4]   2> 2728156 T7774 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
>   [junit4]   2> 2728161 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 2728162 T7773 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>   [junit4]   2> 2729008 T7776 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
>   [junit4]   2> 2729008 T7776 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385369270022\collection1
>   [junit4]   2> 2729008 T7776 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
>   [junit4]   2> 2729009 T7776 oasc.ZkController.createCollectionZkNode Collection zkNode exists
>   [junit4]   2> 2729009 T7776 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
>   [junit4]   2> 2729011 T7776 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385369270022\collection1\'
>   [junit4]   2> 2729011 T7776 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385369270022/collection1/lib/classes/' to classloader
>   [junit4]   2> 2729011 T7776 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385369270022/collection1/lib/README' to classloader
>   [junit4]   2> 2729065 T7776 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
>   [junit4]   2> 2729134 T7776 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
>   [junit4]   2> 2729137 T7776 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
>   [junit4]   2> 2729167 T7776 oass.IndexSchema.readSchema [collection1] Schema name=test
>   [junit4]   2> 2729729 T7776 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>   [junit4]   2> 2729738 T7776 oass.IndexSchema.readSchema default search field in schema is text
>   [junit4]   2> 2729740 T7776 oass.IndexSchema.readSchema unique key field: id
>   [junit4]   2> 2729757 T7776 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
>   [junit4]   2> 2729761 T7776 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
>   [junit4]   2> 2729765 T7776 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
>   [junit4]   2> 2729767 T7776 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
>   [junit4]   2> 2729767 T7776 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
>   [junit4]   2> 2729767 T7776 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
>   [junit4]   2> 2729769 T7776 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
>   [junit4]   2> 2729769 T7776 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
>   [junit4]   2> 2729769 T7776 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
>   [junit4]   2> 2729770 T7776 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385369270022\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876/control/data\
>   [junit4]   2> 2729770 T7776 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@59168284
>   [junit4]   2> 2729770 T7776 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\control\data
>   [junit4]   2> 2729770 T7776 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876/control/data\index/
>   [junit4]   2> 2729773 T7776 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\control\data\index' doesn't exist. Creating new index...
>   [junit4]   2> 2729773 T7776 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\control\data\index
>   [junit4]   2> 2729773 T7776 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=94.34765625, floorSegmentMB=0.5029296875, forceMergeDeletesPctAllowed=19.809934316957623, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
>   [junit4]   2> 2729778 T7776 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
>   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\control\data\index,segFN=segments_1,generation=1}
>   [junit4]   2> 2729778 T7776 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
>   [junit4]   2> 2729781 T7776 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
>   [junit4]   2> 2729782 T7776 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
>   [junit4]   2> 2729782 T7776 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
>   [junit4]   2> 2729782 T7776 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
>   [junit4]   2> 2729782 T7776 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
>   [junit4]   2> 2729782 T7776 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>   [junit4]   2> 2729783 T7776 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>   [junit4]   2> 2729783 T7776 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>   [junit4]   2> 2729783 T7776 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
>   [junit4]   2> 2729784 T7776 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
>   [junit4]   2> 2729784 T7776 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
>   [junit4]   2> 2729784 T7776 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
>   [junit4]   2> 2729784 T7776 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
>   [junit4]   2> 2729785 T7776 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
>   [junit4]   2> 2729785 T7776 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
>   [junit4]   2> 2729785 T7776 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
>   [junit4]   2> 2729793 T7776 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
>   [junit4]   2> 2729796 T7776 oasu.CommitTracker.<init> Hard AutoCommit: disabled
>   [junit4]   2> 2729796 T7776 oasu.CommitTracker.<init> Soft AutoCommit: disabled
>   [junit4]   2> 2729797 T7776 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=9.712890625, floorSegmentMB=1.7158203125, forceMergeDeletesPctAllowed=8.124560470747364, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
>   [junit4]   2> 2729797 T7776 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
>   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\control\data\index,segFN=segments_1,generation=1}
>   [junit4]   2> 2729797 T7776 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
>   [junit4]   2> 2729797 T7776 oass.SolrIndexSearcher.<init> Opening Searcher@72c276db main
>   [junit4]   2> 2729801 T7777 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@72c276db main{StandardDirectoryReader(segments_1:1:nrt)}
>   [junit4]   2> 2729803 T7776 oasc.CoreContainer.registerCore registering core: collection1
>   [junit4]   2> 2729803 T7776 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56258 collection:control_collection shard:shard1
>   [junit4]   2> 2729805 T7776 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
>   [junit4]   2> 2729815 T7776 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
>   [junit4]   2> 2729819 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 2729820 T7776 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
>   [junit4]   2> 2729820 T7776 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
>   [junit4]   2> ASYNC  NEW_CORE C6359 name=collection1 org.apache.solr.core.SolrCore@21ea60d url=http://127.0.0.1:56258/collection1 node=127.0.0.1:56258_ C6359_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:56258, core=collection1, node_name=127.0.0.1:56258_}
>   [junit4]   2> 2729820 T7776 C6359 P56258 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:56258/collection1/
>   [junit4]   2> 2729820 T7776 C6359 P56258 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
>   [junit4]   2> 2729820 T7776 C6359 P56258 oasc.SyncStrategy.syncToMe http://127.0.0.1:56258/collection1/ has no replicas
>   [junit4]   2> 2729821 T7776 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:56258/collection1/ shard1
>   [junit4]   2> 2729821 T7776 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
>   [junit4]   2> 2729822 T7774 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 2729829 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 2729831 T7773 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>   [junit4]   2> 2729838 T7774 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 2729842 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 2729931 T7773 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>   [junit4]   2> 2729965 T7776 oasc.ZkController.register We are http://127.0.0.1:56258/collection1/ and leader is http://127.0.0.1:56258/collection1/
>   [junit4]   2> 2729965 T7776 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56258
>   [junit4]   2> 2729966 T7776 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
>   [junit4]   2> 2729966 T7776 oasc.ZkController.publish publishing core=collection1 state=active
>   [junit4]   2> 2729966 T7776 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
>   [junit4]   2> 2729968 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 2729968 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 2729968 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 2729968 T7776 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 2729971 T7774 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 2729971 T7751 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
>   [junit4]   2> 2729972 T7751 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
>   [junit4]   2> 2729972 T7774 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
>   [junit4]   2> 	  "operation":"state",
>   [junit4]   2> 	  "state":"active",
>   [junit4]   2> 	  "base_url":"http://127.0.0.1:56258",
>   [junit4]   2> 	  "core":"collection1",
>   [junit4]   2> 	  "roles":null,
>   [junit4]   2> 	  "node_name":"127.0.0.1:56258_",
>   [junit4]   2> 	  "shard":"shard1",
>   [junit4]   2> 	  "shard_range":null,
>   [junit4]   2> 	  "shard_state":"active",
>   [junit4]   2> 	  "shard_parent":null,
>   [junit4]   2> 	  "collection":"control_collection",
>   [junit4]   2> 	  "numShards":"1",
>   [junit4]   2> 	  "core_node_name":"core_node1"}
>   [junit4]   2> 2729977 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 2729977 T7751 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 2729980 T7780 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@68d92bc3 name:ZooKeeperConnection Watcher:127.0.0.1:56251/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 2729981 T7751 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 2729982 T7751 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
>   [junit4]   2> 2729985 T7751 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
>   [junit4]   2> 2730067 T7780 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>   [junit4]   2> 2730068 T7773 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>   [junit4]   2> 2730351 T7751 oejs.Server.doStart jetty-8.1.10.v20130312
>   [junit4]   2> 2730355 T7751 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56270
>   [junit4]   2> 2730356 T7751 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
>   [junit4]   2> 2730356 T7751 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
>   [junit4]   2> 2730356 T7751 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385369272416
>   [junit4]   2> 2730357 T7751 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385369272416\'
>   [junit4]   2> 2730380 T7751 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385369272416\solr.xml
>   [junit4]   2> 2730465 T7751 oasc.CoreContainer.<init> New CoreContainer 631756394
>   [junit4]   2> 2730466 T7751 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385369272416\]
>   [junit4]   2> 2730467 T7751 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
>   [junit4]   2> 2730467 T7751 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
>   [junit4]   2> 2730467 T7751 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
>   [junit4]   2> 2730467 T7751 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
>   [junit4]   2> 2730467 T7751 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
>   [junit4]   2> 2730468 T7751 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
>   [junit4]   2> 2730468 T7751 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
>   [junit4]   2> 2730468 T7751 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
>   [junit4]   2> 2730468 T7751 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
>   [junit4]   2> 2730475 T7751 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
>   [junit4]   2> 2730476 T7751 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>   [junit4]   2> 2730476 T7751 oasc.CoreContainer.load Host Name: 127.0.0.1
>   [junit4]   2> 2730476 T7751 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56251/solr
>   [junit4]   2> 2730477 T7751 oasc.ZkController.checkChrootPath zkHost includes chroot
>   [junit4]   2> 2730478 T7751 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 2730486 T7791 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5fda71f8 name:ZooKeeperConnection Watcher:127.0.0.1:56251 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 2730486 T7751 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 2730492 T7751 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 2730495 T7793 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4ca914ee name:ZooKeeperConnection Watcher:127.0.0.1:56251/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 2730496 T7751 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 2730501 T7751 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
>   [junit4]   2> 2731362 T7751 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56270_
>   [junit4]   2> 2731363 T7751 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56270_
>   [junit4]   2> 2731368 T7793 oascc.ZkStateReader$3.process Updating live nodes... (2)
>   [junit4]   2> 2731368 T7780 oascc.ZkStateReader$3.process Updating live nodes... (2)
>   [junit4]   2> 2731368 T7773 oascc.ZkStateReader$3.process Updating live nodes... (2)
>   [junit4]   2> 2731378 T7794 oasc.ZkController.publish publishing core=collection1 state=down
>   [junit4]   2> 2731378 T7794 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
>   [junit4]   2> 2731380 T7794 oasc.ZkController.waitForCoreNodeName look for our core node name
>   [junit4]   2> 2731380 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 2731380 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 2731381 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 2731383 T7774 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 2731383 T7774 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
>   [junit4]   2> 	  "operation":"state",
>   [junit4]   2> 	  "state":"down",
>   [junit4]   2> 	  "base_url":"http://127.0.0.1:56270",
>   [junit4]   2> 	  "core":"collection1",
>   [junit4]   2> 	  "roles":null,
>   [junit4]   2> 	  "node_name":"127.0.0.1:56270_",
>   [junit4]   2> 	  "shard":null,
>   [junit4]   2> 	  "shard_range":null,
>   [junit4]   2> 	  "shard_state":"active",
>   [junit4]   2> 	  "shard_parent":null,
>   [junit4]   2> 	  "collection":"collection1",
>   [junit4]   2> 	  "numShards":"2",
>   [junit4]   2> 	  "core_node_name":null}
>   [junit4]   2> 2731383 T7774 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
>   [junit4]   2> 2731383 T7774 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
>   [junit4]   2> 2731388 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 2731476 T7793 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 2731476 T7773 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 2731477 T7780 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 2732236 T7794 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
>   [junit4]   2> 2732236 T7794 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385369272416\collection1
>   [junit4]   2> 2732236 T7794 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
>   [junit4]   2> 2732238 T7794 oasc.ZkController.createCollectionZkNode Collection zkNode exists
>   [junit4]   2> 2732238 T7794 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
>   [junit4]   2> 2732238 T7794 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385369272416\collection1\'
>   [junit4]   2> 2732238 T7794 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385369272416/collection1/lib/classes/' to classloader
>   [junit4]   2> 2732241 T7794 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385369272416/collection1/lib/README' to classloader
>   [junit4]   2> 2732298 T7794 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
>   [junit4]   2> 2732353 T7794 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
>   [junit4]   2> 2732355 T7794 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
>   [junit4]   2> 2732387 T7794 oass.IndexSchema.readSchema [collection1] Schema name=test
>   [junit4]   2> 2732956 T7794 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>   [junit4]   2> 2732964 T7794 oass.IndexSchema.readSchema default search field in schema is text
>   [junit4]   2> 2732967 T7794 oass.IndexSchema.readSchema unique key field: id
>   [junit4]   2> 2732984 T7794 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
>   [junit4]   2> 2732988 T7794 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
>   [junit4]   2> 2732992 T7794 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
>   [junit4]   2> 2732994 T7794 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
>   [junit4]   2> 2732994 T7794 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
>   [junit4]   2> 2732994 T7794 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
>   [junit4]   2> 2732996 T7794 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
>   [junit4]   2> 2732996 T7794 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
>   [junit4]   2> 2732996 T7794 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
>   [junit4]   2> 2732997 T7794 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385369272416\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876/jetty1\
>   [junit4]   2> 2732997 T7794 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@59168284
>   [junit4]   2> 2732997 T7794 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\jetty1
>   [junit4]   2> 2732997 T7794 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876/jetty1\index/
>   [junit4]   2> 2732997 T7794 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\jetty1\index' doesn't exist. Creating new index...
>   [junit4]   2> 2732997 T7794 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\jetty1\index
>   [junit4]   2> 2732999 T7794 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=94.34765625, floorSegmentMB=0.5029296875, forceMergeDeletesPctAllowed=19.809934316957623, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
>   [junit4]   2> 2733003 T7794 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
>   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\jetty1\index,segFN=segments_1,generation=1}
>   [junit4]   2> 2733003 T7794 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
>   [junit4]   2> 2733007 T7794 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
>   [junit4]   2> 2733007 T7794 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
>   [junit4]   2> 2733007 T7794 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
>   [junit4]   2> 2733007 T7794 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
>   [junit4]   2> 2733007 T7794 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
>   [junit4]   2> 2733007 T7794 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>   [junit4]   2> 2733008 T7794 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>   [junit4]   2> 2733008 T7794 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>   [junit4]   2> 2733008 T7794 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
>   [junit4]   2> 2733009 T7794 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
>   [junit4]   2> 2733010 T7794 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
>   [junit4]   2> 2733010 T7794 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
>   [junit4]   2> 2733010 T7794 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
>   [junit4]   2> 2733011 T7794 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
>   [junit4]   2> 2733011 T7794 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
>   [junit4]   2> 2733012 T7794 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
>   [junit4]   2> 2733017 T7794 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
>   [junit4]   2> 2733022 T7794 oasu.CommitTracker.<init> Hard AutoCommit: disabled
>   [junit4]   2> 2733022 T7794 oasu.CommitTracker.<init> Soft AutoCommit: disabled
>   [junit4]   2> 2733023 T7794 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=9.712890625, floorSegmentMB=1.7158203125, forceMergeDeletesPctAllowed=8.124560470747364, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
>   [junit4]   2> 2733025 T7794 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
>   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\jetty1\index,segFN=segments_1,generation=1}
>   [junit4]   2> 2733025 T7794 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
>   [junit4]   2> 2733025 T7794 oass.SolrIndexSearcher.<init> Opening Searcher@794ad93c main
>   [junit4]   2> 2733029 T7795 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@794ad93c main{StandardDirectoryReader(segments_1:1:nrt)}
>   [junit4]   2> 2733032 T7794 oasc.CoreContainer.registerCore registering core: collection1
>   [junit4]   2> 2733032 T7794 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56270 collection:collection1 shard:shard2
>   [junit4]   2> 2733032 T7794 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
>   [junit4]   2> 2733045 T7794 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
>   [junit4]   2> 2733048 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 2733048 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 2733048 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 2733048 T7794 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
>   [junit4]   2> 2733048 T7794 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
>   [junit4]   2> ASYNC  NEW_CORE C6360 name=collection1 org.apache.solr.core.SolrCore@527a414a url=http://127.0.0.1:56270/collection1 node=127.0.0.1:56270_ C6360_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:56270, core=collection1, node_name=127.0.0.1:56270_}
>   [junit4]   2> 2733048 T7794 C6360 P56270 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:56270/collection1/
>   [junit4]   2> 2733048 T7794 C6360 P56270 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
>   [junit4]   2> 2733048 T7794 C6360 P56270 oasc.SyncStrategy.syncToMe http://127.0.0.1:56270/collection1/ has no replicas
>   [junit4]   2> 2733051 T7794 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:56270/collection1/ shard2
>   [junit4]   2> 2733051 T7794 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
>   [junit4]   2> 2733055 T7774 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 2733064 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 2733066 T7780 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 2733066 T7773 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 2733067 T7793 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 2733073 T7774 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 2733078 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 2733166 T7793 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 2733166 T7780 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 2733166 T7773 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 2733202 T7794 oasc.ZkController.register We are http://127.0.0.1:56270/collection1/ and leader is http://127.0.0.1:56270/collection1/
>   [junit4]   2> 2733202 T7794 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56270
>   [junit4]   2> 2733202 T7794 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
>   [junit4]   2> 2733202 T7794 oasc.ZkController.publish publishing core=collection1 state=active
>   [junit4]   2> 2733202 T7794 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
>   [junit4]   2> 2733203 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 2733203 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 2733204 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 2733204 T7794 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 2733205 T7774 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 2733205 T7751 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
>   [junit4]   2> 2733205 T7751 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
>   [junit4]   2> 2733205 T7774 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
>   [junit4]   2> 	  "operation":"state",
>   [junit4]   2> 	  "state":"active",
>   [junit4]   2> 	  "base_url":"http://127.0.0.1:56270",
>   [junit4]   2> 	  "core":"collection1",
>   [junit4]   2> 	  "roles":null,
>   [junit4]   2> 	  "node_name":"127.0.0.1:56270_",
>   [junit4]   2> 	  "shard":"shard2",
>   [junit4]   2> 	  "shard_range":null,
>   [junit4]   2> 	  "shard_state":"active",
>   [junit4]   2> 	  "shard_parent":null,
>   [junit4]   2> 	  "collection":"collection1",
>   [junit4]   2> 	  "numShards":"2",
>   [junit4]   2> 	  "core_node_name":"core_node1"}
>   [junit4]   2> 2733213 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 2733303 T7780 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 2733303 T7773 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 2733304 T7793 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 2733612 T7751 oejs.Server.doStart jetty-8.1.10.v20130312
>   [junit4]   2> 2733618 T7751 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56279
>   [junit4]   2> 2733619 T7751 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
>   [junit4]   2> 2733620 T7751 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
>   [junit4]   2> 2733620 T7751 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385369275640
>   [junit4]   2> 2733621 T7751 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385369275640\'
>   [junit4]   2> 2733647 T7751 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385369275640\solr.xml
>   [junit4]   2> 2733738 T7751 oasc.CoreContainer.<init> New CoreContainer 2085493663
>   [junit4]   2> 2733738 T7751 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385369275640\]
>   [junit4]   2> 2733740 T7751 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
>   [junit4]   2> 2733740 T7751 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
>   [junit4]   2> 2733740 T7751 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
>   [junit4]   2> 2733740 T7751 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
>   [junit4]   2> 2733740 T7751 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
>   [junit4]   2> 2733741 T7751 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
>   [junit4]   2> 2733741 T7751 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
>   [junit4]   2> 2733741 T7751 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
>   [junit4]   2> 2733742 T7751 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
>   [junit4]   2> 2733749 T7751 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
>   [junit4]   2> 2733750 T7751 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>   [junit4]   2> 2733750 T7751 oasc.CoreContainer.load Host Name: 127.0.0.1
>   [junit4]   2> 2733750 T7751 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56251/solr
>   [junit4]   2> 2733751 T7751 oasc.ZkController.checkChrootPath zkHost includes chroot
>   [junit4]   2> 2733753 T7751 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 2733760 T7807 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d117687 name:ZooKeeperConnection Watcher:127.0.0.1:56251 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 2733760 T7751 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 2733762 T7753 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1428e71767a0007, likely client has closed socket
>   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
>   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
>   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
>   [junit4]   2> 
>   [junit4]   2> 2733764 T7751 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 2733766 T7809 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3eb65a97 name:ZooKeeperConnection Watcher:127.0.0.1:56251/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 2733767 T7751 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 2733773 T7751 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
>   [junit4]   2> 2734633 T7751 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56279_
>   [junit4]   2> 2734635 T7751 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56279_
>   [junit4]   2> 2734638 T7809 oascc.ZkStateReader$3.process Updating live nodes... (3)
>   [junit4]   2> 2734639 T7793 oascc.ZkStateReader$3.process Updating live nodes... (3)
>   [junit4]   2> 2734639 T7773 oascc.ZkStateReader$3.process Updating live nodes... (3)
>   [junit4]   2> 2734640 T7780 oascc.ZkStateReader$3.process Updating live nodes... (3)
>   [junit4]   2> 2734649 T7810 oasc.ZkController.publish publishing core=collection1 state=down
>   [junit4]   2> 2734649 T7810 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
>   [junit4]   2> 2734651 T7810 oasc.ZkController.waitForCoreNodeName look for our core node name
>   [junit4]   2> 2734651 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 2734651 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 2734651 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 2734653 T7774 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 2734655 T7774 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
>   [junit4]   2> 	  "operation":"state",
>   [junit4]   2> 	  "state":"down",
>   [junit4]   2> 	  "base_url":"http://127.0.0.1:56279",
>   [junit4]   2> 	  "core":"collection1",
>   [junit4]   2> 	  "roles":null,
>   [junit4]   2> 	  "node_name":"127.0.0.1:56279_",
>   [junit4]   2> 	  "shard":null,
>   [junit4]   2> 	  "shard_range":null,
>   [junit4]   2> 	  "shard_state":"active",
>   [junit4]   2> 	  "shard_parent":null,
>   [junit4]   2> 	  "collection":"collection1",
>   [junit4]   2> 	  "numShards":"2",
>   [junit4]   2> 	  "core_node_name":null}
>   [junit4]   2> 2734655 T7774 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
>   [junit4]   2> 2734655 T7774 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
>   [junit4]   2> 2734660 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 2734749 T7780 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 2734749 T7809 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 2734749 T7793 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 2734749 T7773 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 2735506 T7810 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
>   [junit4]   2> 2735506 T7810 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385369275640\collection1
>   [junit4]   2> 2735506 T7810 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
>   [junit4]   2> 2735508 T7810 oasc.ZkController.createCollectionZkNode Collection zkNode exists
>   [junit4]   2> 2735508 T7810 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
>   [junit4]   2> 2735510 T7810 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385369275640\collection1\'
>   [junit4]   2> 2735510 T7810 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385369275640/collection1/lib/classes/' to classloader
>   [junit4]   2> 2735512 T7810 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385369275640/collection1/lib/README' to classloader
>   [junit4]   2> 2735573 T7810 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
>   [junit4]   2> 2735628 T7810 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
>   [junit4]   2> 2735631 T7810 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
>   [junit4]   2> 2735646 T7810 oass.IndexSchema.readSchema [collection1] Schema name=test
>   [junit4]   2> 2736307 T7810 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>   [junit4]   2> 2736315 T7810 oass.IndexSchema.readSchema default search field in schema is text
>   [junit4]   2> 2736319 T7810 oass.IndexSchema.readSchema unique key field: id
>   [junit4]   2> 2736345 T7810 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
>   [junit4]   2> 2736350 T7810 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
>   [junit4]   2> 2736356 T7810 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
>   [junit4]   2> 2736357 T7810 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
>   [junit4]   2> 2736357 T7810 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
>   [junit4]   2> 2736357 T7810 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
>   [junit4]   2> 2736359 T7810 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
>   [junit4]   2> 2736359 T7810 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
>   [junit4]   2> 2736359 T7810 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
>   [junit4]   2> 2736360 T7810 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385369275640\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876/jetty2\
>   [junit4]   2> 2736360 T7810 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@59168284
>   [junit4]   2> 2736360 T7810 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\jetty2
>   [junit4]   2> 2736362 T7810 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876/jetty2\index/
>   [junit4]   2> 2736362 T7810 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\jetty2\index' doesn't exist. Creating new index...
>   [junit4]   2> 2736362 T7810 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\jetty2\index
>   [junit4]   2> 2736364 T7810 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=94.34765625, floorSegmentMB=0.5029296875, forceMergeDeletesPctAllowed=19.809934316957623, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
>   [junit4]   2> 2736369 T7810 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
>   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\jetty2\index,segFN=segments_1,generation=1}
>   [junit4]   2> 2736369 T7810 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
>   [junit4]   2> 2736374 T7810 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
>   [junit4]   2> 2736374 T7810 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
>   [junit4]   2> 2736374 T7810 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
>   [junit4]   2> 2736374 T7810 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
>   [junit4]   2> 2736375 T7810 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
>   [junit4]   2> 2736375 T7810 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>   [junit4]   2> 2736376 T7810 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>   [junit4]   2> 2736376 T7810 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>   [junit4]   2> 2736376 T7810 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
>   [junit4]   2> 2736377 T7810 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
>   [junit4]   2> 2736377 T7810 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
>   [junit4]   2> 2736377 T7810 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
>   [junit4]   2> 2736377 T7810 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
>   [junit4]   2> 2736379 T7810 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
>   [junit4]   2> 2736379 T7810 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
>   [junit4]   2> 2736380 T7810 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
>   [junit4]   2> 2736387 T7810 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
>   [junit4]   2> 2736391 T7810 oasu.CommitTracker.<init> Hard AutoCommit: disabled
>   [junit4]   2> 2736391 T7810 oasu.CommitTracker.<init> Soft AutoCommit: disabled
>   [junit4]   2> 2736392 T7810 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=9.712890625, floorSegmentMB=1.7158203125, forceMergeDeletesPctAllowed=8.124560470747364, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
>   [junit4]   2> 2736393 T7810 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
>   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-t
> 
> [...truncated too long message...]
> 
> 
>   [junit4]    >         at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
>   [junit4]    >         at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
>   [junit4]    >         at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
>   [junit4]    >         at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
>   [junit4]    >         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
>   [junit4]    >         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
>   [junit4]    >         at org.eclipse.jetty.server.Server.handle(Server.java:368)
>   [junit4]    >         at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
>   [junit4]    >         at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
>   [junit4]    >         at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
>   [junit4]    >         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:953)
>   [junit4]    >         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
>   [junit4]    >         at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
>   [junit4]    >         at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
>   [junit4]    >         at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
>   [junit4]    >         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>   [junit4]    >         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>   [junit4]    >         at java.lang.Thread.run(Thread.java:744)
>   [junit4]    >    2) Thread[id=7845, name=searcherExecutor-5068-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
>   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
>   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
>   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
>   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>   [junit4]    >         at java.lang.Thread.run(Thread.java:744)
>   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([9F3EB56801A84E02]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
>   [junit4]    >    1) Thread[id=7845, name=searcherExecutor-5068-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
>   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
>   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
>   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
>   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>   [junit4]    >         at java.lang.Thread.run(Thread.java:744)
>   [junit4]    >    2) Thread[id=7836, name=qtp871330187-7836, state=RUNNABLE, group=TGRP-ChaosMonkeyNothingIsSafeTest]
>   [junit4]    >         at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrServer.blockUntilFinished(ConcurrentUpdateSolrServer.java:391)
>   [junit4]    >         at org.apache.solr.update.StreamingSolrServers.blockUntilFinished(StreamingSolrServers.java:104)
>   [junit4]    >         at org.apache.solr.update.SolrCmdDistributor.doRetriesIfNeeded(SolrCmdDistributor.java:134)
>   [junit4]    >         at org.apache.solr.update.SolrCmdDistributor.finish(SolrCmdDistributor.java:60)
>   [junit4]    >         at org.apache.solr.update.processor.DistributedUpdateProcessor.doFinish(DistributedUpdateProcessor.java:609)
>   [junit4]    >         at org.apache.solr.update.processor.DistributedUpdateProcessor.finish(DistributedUpdateProcessor.java:1457)
>   [junit4]    >         at org.apache.solr.update.processor.LogUpdateProcessor.finish(LogUpdateProcessorFactory.java:179)
>   [junit4]    >         at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:83)
>   [junit4]    >         at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
>   [junit4]    >         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1866)
>   [junit4]    >         at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:755)
>   [junit4]    >         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:417)
>   [junit4]    >         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:201)
>   [junit4]    >         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
>   [junit4]    >         at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:134)
>   [junit4]    >         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
>   [junit4]    >         at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
>   [junit4]    >         at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
>   [junit4]    >         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
>   [junit4]    >         at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
>   [junit4]    >         at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
>   [junit4]    >         at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
>   [junit4]    >         at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
>   [junit4]    >         at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
>   [junit4]    >         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
>   [junit4]    >         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
>   [junit4]    >         at org.eclipse.jetty.server.Server.handle(Server.java:368)
>   [junit4]    >         at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
>   [junit4]    >         at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
>   [junit4]    >         at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
>   [junit4]    >         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:953)
>   [junit4]    >         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
>   [junit4]    >         at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
>   [junit4]    >         at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
>   [junit4]    >         at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
>   [junit4]    >         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
>   [junit4]    >         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
>   [junit4]    >         at java.lang.Thread.run(Thread.java:744)
>   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([9F3EB56801A84E02]:0)
>   [junit4] Completed in 301.76s, 1 test, 1 failure, 2 errors <<< FAILURES!
> 
> [...truncated 210 lines...]
> BUILD FAILED
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:420: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:400: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:492: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1275: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:908: There were test failures: 353 suites, 1558 tests, 3 suite-level errors, 215 ignored (11 assumptions)
> 
> Total time: 79 minutes 30 seconds
> Build step 'Invoke Ant' marked build as failure
> Description set: Java: 64bit/jdk1.7.0_45 -XX:+UseCompressedOops -XX:+UseSerialGC
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure
> Sending email for trigger: Failure
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.7.0_45) - Build # 3504 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3504/
Java: 64bit/jdk1.7.0_45 -XX:+UseCompressedOops -XX:+UseSerialGC

3 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest

Error Message:
ERROR: SolrIndexSearcher opens=23 closes=22

Stack Trace:
java.lang.AssertionError: ERROR: SolrIndexSearcher opens=23 closes=22
	at __randomizedtesting.SeedInfo.seed([9F3EB56801A84E02]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:330)
	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:136)
	at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest

Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest:     1) Thread[id=7836, name=qtp871330187-7836, state=RUNNABLE, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrServer.blockUntilFinished(ConcurrentUpdateSolrServer.java:391)         at org.apache.solr.update.StreamingSolrServers.blockUntilFinished(StreamingSolrServers.java:104)         at org.apache.solr.update.SolrCmdDistributor.doRetriesIfNeeded(SolrCmdDistributor.java:134)         at org.apache.solr.update.SolrCmdDistributor.finish(SolrCmdDistributor.java:60)         at org.apache.solr.update.processor.DistributedUpdateProcessor.doFinish(DistributedUpdateProcessor.java:609)         at org.apache.solr.update.processor.DistributedUpdateProcessor.finish(DistributedUpdateProcessor.java:1457)         at org.apache.solr.update.processor.LogUpdateProcessor.finish(LogUpdateProcessorFactory.java:179)         at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:83)         at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1866)         at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:755)         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:417)         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:201)         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)         at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:134)         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)         at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)         at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)         at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)         at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)         at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)         at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)         at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)         at org.eclipse.jetty.server.Server.handle(Server.java:368)         at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)         at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)         at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:953)         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)         at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)         at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)         at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:744)    2) Thread[id=7845, name=searcherExecutor-5068-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:744)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest: 
   1) Thread[id=7836, name=qtp871330187-7836, state=RUNNABLE, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrServer.blockUntilFinished(ConcurrentUpdateSolrServer.java:391)
        at org.apache.solr.update.StreamingSolrServers.blockUntilFinished(StreamingSolrServers.java:104)
        at org.apache.solr.update.SolrCmdDistributor.doRetriesIfNeeded(SolrCmdDistributor.java:134)
        at org.apache.solr.update.SolrCmdDistributor.finish(SolrCmdDistributor.java:60)
        at org.apache.solr.update.processor.DistributedUpdateProcessor.doFinish(DistributedUpdateProcessor.java:609)
        at org.apache.solr.update.processor.DistributedUpdateProcessor.finish(DistributedUpdateProcessor.java:1457)
        at org.apache.solr.update.processor.LogUpdateProcessor.finish(LogUpdateProcessorFactory.java:179)
        at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:83)
        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1866)
        at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:755)
        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:417)
        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:201)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:134)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
        at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
        at org.eclipse.jetty.server.Server.handle(Server.java:368)
        at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
        at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
        at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:953)
        at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
        at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
        at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
        at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
        at java.lang.Thread.run(Thread.java:744)
   2) Thread[id=7845, name=searcherExecutor-5068-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:744)
	at __randomizedtesting.SeedInfo.seed([9F3EB56801A84E02]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=7845, name=searcherExecutor-5068-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:744)    2) Thread[id=7836, name=qtp871330187-7836, state=RUNNABLE, group=TGRP-ChaosMonkeyNothingIsSafeTest]         at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrServer.blockUntilFinished(ConcurrentUpdateSolrServer.java:391)         at org.apache.solr.update.StreamingSolrServers.blockUntilFinished(StreamingSolrServers.java:104)         at org.apache.solr.update.SolrCmdDistributor.doRetriesIfNeeded(SolrCmdDistributor.java:134)         at org.apache.solr.update.SolrCmdDistributor.finish(SolrCmdDistributor.java:60)         at org.apache.solr.update.processor.DistributedUpdateProcessor.doFinish(DistributedUpdateProcessor.java:609)         at org.apache.solr.update.processor.DistributedUpdateProcessor.finish(DistributedUpdateProcessor.java:1457)         at org.apache.solr.update.processor.LogUpdateProcessor.finish(LogUpdateProcessorFactory.java:179)         at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:83)         at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1866)         at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:755)         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:417)         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:201)         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)         at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:134)         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)         at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)         at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)         at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)         at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)         at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)         at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)         at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)         at org.eclipse.jetty.server.Server.handle(Server.java:368)         at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)         at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)         at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:953)         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)         at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)         at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)         at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)         at java.lang.Thread.run(Thread.java:744)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=7845, name=searcherExecutor-5068-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:744)
   2) Thread[id=7836, name=qtp871330187-7836, state=RUNNABLE, group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrServer.blockUntilFinished(ConcurrentUpdateSolrServer.java:391)
        at org.apache.solr.update.StreamingSolrServers.blockUntilFinished(StreamingSolrServers.java:104)
        at org.apache.solr.update.SolrCmdDistributor.doRetriesIfNeeded(SolrCmdDistributor.java:134)
        at org.apache.solr.update.SolrCmdDistributor.finish(SolrCmdDistributor.java:60)
        at org.apache.solr.update.processor.DistributedUpdateProcessor.doFinish(DistributedUpdateProcessor.java:609)
        at org.apache.solr.update.processor.DistributedUpdateProcessor.finish(DistributedUpdateProcessor.java:1457)
        at org.apache.solr.update.processor.LogUpdateProcessor.finish(LogUpdateProcessorFactory.java:179)
        at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:83)
        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1866)
        at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:755)
        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:417)
        at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:201)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
        at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:134)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
        at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
        at org.eclipse.jetty.server.Server.handle(Server.java:368)
        at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
        at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
        at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:953)
        at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
        at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
        at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
        at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
        at java.lang.Thread.run(Thread.java:744)
	at __randomizedtesting.SeedInfo.seed([9F3EB56801A84E02]:0)




Build Log:
[...truncated 10762 lines...]
   [junit4] Suite: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
   [junit4]   2> 2727439 T7751 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 2727445 T7751 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-ChaosMonkeyNothingIsSafeTest-1385369269877
   [junit4]   2> 2727446 T7751 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 2727447 T7752 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 2727525 T7751 oasc.ZkTestServer.run start zk server on port:56251
   [junit4]   2> 2727527 T7751 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2727532 T7758 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@282ac134 name:ZooKeeperConnection Watcher:127.0.0.1:56251 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2727532 T7751 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2727532 T7751 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 2727536 T7753 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1428e71767a0000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 2727538 T7751 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2727540 T7760 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6d875e3c name:ZooKeeperConnection Watcher:127.0.0.1:56251/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2727541 T7751 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2727541 T7751 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 2727545 T7751 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 2727547 T7751 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 2727549 T7751 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 2727552 T7751 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 2727553 T7751 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 2727557 T7751 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 2727557 T7751 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 2727561 T7751 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2727561 T7751 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2727564 T7751 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 2727565 T7751 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 2727567 T7751 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 2727568 T7751 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 2727571 T7751 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 2727571 T7751 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 2727574 T7751 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 2727574 T7751 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 2727577 T7751 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2727578 T7751 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2727580 T7751 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2727580 T7751 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2727583 T7751 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 2727584 T7751 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 2727586 T7751 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 2727587 T7751 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 2727591 T7753 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1428e71767a0001, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 2727937 T7751 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 2727946 T7751 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56258
   [junit4]   2> 2727947 T7751 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 2727947 T7751 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2727947 T7751 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385369270022
   [junit4]   2> 2727947 T7751 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385369270022\'
   [junit4]   2> 2727970 T7751 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385369270022\solr.xml
   [junit4]   2> 2728043 T7751 oasc.CoreContainer.<init> New CoreContainer 684522700
   [junit4]   2> 2728043 T7751 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385369270022\]
   [junit4]   2> 2728044 T7751 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 2728044 T7751 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 2728045 T7751 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 2728045 T7751 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2728045 T7751 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 2728046 T7751 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2728046 T7751 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 2728046 T7751 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 2728047 T7751 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 2728054 T7751 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2728054 T7751 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2728054 T7751 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 2728055 T7751 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56251/solr
   [junit4]   2> 2728055 T7751 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 2728057 T7751 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2728065 T7771 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6996f2db name:ZooKeeperConnection Watcher:127.0.0.1:56251 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2728066 T7751 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2728070 T7751 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2728073 T7773 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@29e403c2 name:ZooKeeperConnection Watcher:127.0.0.1:56251/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2728074 T7751 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2728075 T7751 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 2728081 T7751 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 2728086 T7751 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 2728090 T7751 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56258_
   [junit4]   2> 2728090 T7751 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56258_
   [junit4]   2> 2728095 T7751 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 2728104 T7751 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 2728107 T7751 oasc.Overseer.start Overseer (id=90791560470986755-127.0.0.1:56258_-n_0000000000) starting
   [junit4]   2> 2728112 T7751 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 2728130 T7775 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 2728131 T7751 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 2728136 T7751 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 2728140 T7751 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2728144 T7774 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 2728151 T7776 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 2728151 T7776 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2728152 T7776 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 2728152 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2728155 T7774 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2728156 T7774 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:56258",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:56258_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 2728156 T7774 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 2728156 T7774 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 2728161 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2728162 T7773 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2729008 T7776 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 2729008 T7776 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385369270022\collection1
   [junit4]   2> 2729008 T7776 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 2729009 T7776 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 2729009 T7776 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 2729011 T7776 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385369270022\collection1\'
   [junit4]   2> 2729011 T7776 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385369270022/collection1/lib/classes/' to classloader
   [junit4]   2> 2729011 T7776 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385369270022/collection1/lib/README' to classloader
   [junit4]   2> 2729065 T7776 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 2729134 T7776 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2729137 T7776 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 2729167 T7776 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 2729729 T7776 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 2729738 T7776 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 2729740 T7776 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2729757 T7776 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2729761 T7776 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2729765 T7776 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 2729767 T7776 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 2729767 T7776 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 2729767 T7776 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 2729769 T7776 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 2729769 T7776 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 2729769 T7776 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 2729770 T7776 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-controljetty-1385369270022\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876/control/data\
   [junit4]   2> 2729770 T7776 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@59168284
   [junit4]   2> 2729770 T7776 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\control\data
   [junit4]   2> 2729770 T7776 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876/control/data\index/
   [junit4]   2> 2729773 T7776 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\control\data\index' doesn't exist. Creating new index...
   [junit4]   2> 2729773 T7776 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\control\data\index
   [junit4]   2> 2729773 T7776 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=94.34765625, floorSegmentMB=0.5029296875, forceMergeDeletesPctAllowed=19.809934316957623, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 2729778 T7776 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\control\data\index,segFN=segments_1,generation=1}
   [junit4]   2> 2729778 T7776 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2729781 T7776 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 2729782 T7776 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 2729782 T7776 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 2729782 T7776 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2729782 T7776 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2729782 T7776 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 2729783 T7776 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2729783 T7776 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2729783 T7776 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2729784 T7776 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 2729784 T7776 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 2729784 T7776 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 2729784 T7776 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 2729785 T7776 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 2729785 T7776 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 2729785 T7776 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 2729793 T7776 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2729796 T7776 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2729796 T7776 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2729797 T7776 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=9.712890625, floorSegmentMB=1.7158203125, forceMergeDeletesPctAllowed=8.124560470747364, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 2729797 T7776 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\control\data\index,segFN=segments_1,generation=1}
   [junit4]   2> 2729797 T7776 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2729797 T7776 oass.SolrIndexSearcher.<init> Opening Searcher@72c276db main
   [junit4]   2> 2729801 T7777 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@72c276db main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 2729803 T7776 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 2729803 T7776 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56258 collection:control_collection shard:shard1
   [junit4]   2> 2729805 T7776 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 2729815 T7776 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 2729819 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2729820 T7776 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 2729820 T7776 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C6359 name=collection1 org.apache.solr.core.SolrCore@21ea60d url=http://127.0.0.1:56258/collection1 node=127.0.0.1:56258_ C6359_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:56258, core=collection1, node_name=127.0.0.1:56258_}
   [junit4]   2> 2729820 T7776 C6359 P56258 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:56258/collection1/
   [junit4]   2> 2729820 T7776 C6359 P56258 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 2729820 T7776 C6359 P56258 oasc.SyncStrategy.syncToMe http://127.0.0.1:56258/collection1/ has no replicas
   [junit4]   2> 2729821 T7776 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:56258/collection1/ shard1
   [junit4]   2> 2729821 T7776 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 2729822 T7774 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2729829 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2729831 T7773 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2729838 T7774 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2729842 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2729931 T7773 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2729965 T7776 oasc.ZkController.register We are http://127.0.0.1:56258/collection1/ and leader is http://127.0.0.1:56258/collection1/
   [junit4]   2> 2729965 T7776 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56258
   [junit4]   2> 2729966 T7776 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 2729966 T7776 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 2729966 T7776 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2729968 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2729968 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2729968 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2729968 T7776 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2729971 T7774 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2729971 T7751 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 2729972 T7751 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 2729972 T7774 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:56258",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:56258_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 2729977 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2729977 T7751 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2729980 T7780 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@68d92bc3 name:ZooKeeperConnection Watcher:127.0.0.1:56251/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2729981 T7751 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2729982 T7751 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2729985 T7751 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 2730067 T7780 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2730068 T7773 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2730351 T7751 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 2730355 T7751 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56270
   [junit4]   2> 2730356 T7751 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 2730356 T7751 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2730356 T7751 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385369272416
   [junit4]   2> 2730357 T7751 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385369272416\'
   [junit4]   2> 2730380 T7751 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385369272416\solr.xml
   [junit4]   2> 2730465 T7751 oasc.CoreContainer.<init> New CoreContainer 631756394
   [junit4]   2> 2730466 T7751 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385369272416\]
   [junit4]   2> 2730467 T7751 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 2730467 T7751 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 2730467 T7751 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 2730467 T7751 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2730467 T7751 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 2730468 T7751 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2730468 T7751 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 2730468 T7751 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 2730468 T7751 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 2730475 T7751 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2730476 T7751 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2730476 T7751 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 2730476 T7751 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56251/solr
   [junit4]   2> 2730477 T7751 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 2730478 T7751 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2730486 T7791 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5fda71f8 name:ZooKeeperConnection Watcher:127.0.0.1:56251 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2730486 T7751 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2730492 T7751 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2730495 T7793 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4ca914ee name:ZooKeeperConnection Watcher:127.0.0.1:56251/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2730496 T7751 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2730501 T7751 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2731362 T7751 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56270_
   [junit4]   2> 2731363 T7751 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56270_
   [junit4]   2> 2731368 T7793 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 2731368 T7780 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 2731368 T7773 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 2731378 T7794 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 2731378 T7794 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2731380 T7794 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 2731380 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2731380 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2731381 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2731383 T7774 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2731383 T7774 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:56270",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:56270_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 2731383 T7774 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 2731383 T7774 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 2731388 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2731476 T7793 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2731476 T7773 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2731477 T7780 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2732236 T7794 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 2732236 T7794 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385369272416\collection1
   [junit4]   2> 2732236 T7794 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 2732238 T7794 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 2732238 T7794 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 2732238 T7794 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385369272416\collection1\'
   [junit4]   2> 2732238 T7794 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385369272416/collection1/lib/classes/' to classloader
   [junit4]   2> 2732241 T7794 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385369272416/collection1/lib/README' to classloader
   [junit4]   2> 2732298 T7794 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 2732353 T7794 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2732355 T7794 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 2732387 T7794 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 2732956 T7794 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 2732964 T7794 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 2732967 T7794 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2732984 T7794 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2732988 T7794 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2732992 T7794 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 2732994 T7794 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 2732994 T7794 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 2732994 T7794 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 2732996 T7794 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 2732996 T7794 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 2732996 T7794 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 2732997 T7794 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty1-1385369272416\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876/jetty1\
   [junit4]   2> 2732997 T7794 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@59168284
   [junit4]   2> 2732997 T7794 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\jetty1
   [junit4]   2> 2732997 T7794 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876/jetty1\index/
   [junit4]   2> 2732997 T7794 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\jetty1\index' doesn't exist. Creating new index...
   [junit4]   2> 2732997 T7794 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\jetty1\index
   [junit4]   2> 2732999 T7794 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=94.34765625, floorSegmentMB=0.5029296875, forceMergeDeletesPctAllowed=19.809934316957623, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 2733003 T7794 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\jetty1\index,segFN=segments_1,generation=1}
   [junit4]   2> 2733003 T7794 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2733007 T7794 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 2733007 T7794 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 2733007 T7794 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 2733007 T7794 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2733007 T7794 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2733007 T7794 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 2733008 T7794 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2733008 T7794 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2733008 T7794 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2733009 T7794 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 2733010 T7794 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 2733010 T7794 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 2733010 T7794 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 2733011 T7794 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 2733011 T7794 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 2733012 T7794 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 2733017 T7794 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2733022 T7794 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2733022 T7794 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2733023 T7794 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=9.712890625, floorSegmentMB=1.7158203125, forceMergeDeletesPctAllowed=8.124560470747364, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 2733025 T7794 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\jetty1\index,segFN=segments_1,generation=1}
   [junit4]   2> 2733025 T7794 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2733025 T7794 oass.SolrIndexSearcher.<init> Opening Searcher@794ad93c main
   [junit4]   2> 2733029 T7795 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@794ad93c main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 2733032 T7794 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 2733032 T7794 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56270 collection:collection1 shard:shard2
   [junit4]   2> 2733032 T7794 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 2733045 T7794 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 2733048 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2733048 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2733048 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2733048 T7794 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 2733048 T7794 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C6360 name=collection1 org.apache.solr.core.SolrCore@527a414a url=http://127.0.0.1:56270/collection1 node=127.0.0.1:56270_ C6360_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:56270, core=collection1, node_name=127.0.0.1:56270_}
   [junit4]   2> 2733048 T7794 C6360 P56270 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:56270/collection1/
   [junit4]   2> 2733048 T7794 C6360 P56270 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 2733048 T7794 C6360 P56270 oasc.SyncStrategy.syncToMe http://127.0.0.1:56270/collection1/ has no replicas
   [junit4]   2> 2733051 T7794 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:56270/collection1/ shard2
   [junit4]   2> 2733051 T7794 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 2733055 T7774 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2733064 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2733066 T7780 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2733066 T7773 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2733067 T7793 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2733073 T7774 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2733078 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2733166 T7793 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2733166 T7780 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2733166 T7773 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2733202 T7794 oasc.ZkController.register We are http://127.0.0.1:56270/collection1/ and leader is http://127.0.0.1:56270/collection1/
   [junit4]   2> 2733202 T7794 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56270
   [junit4]   2> 2733202 T7794 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 2733202 T7794 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 2733202 T7794 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2733203 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2733203 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2733204 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2733204 T7794 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2733205 T7774 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2733205 T7751 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 2733205 T7751 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 2733205 T7774 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:56270",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:56270_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 2733213 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2733303 T7780 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2733303 T7773 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2733304 T7793 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2733612 T7751 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 2733618 T7751 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56279
   [junit4]   2> 2733619 T7751 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 2733620 T7751 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2733620 T7751 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385369275640
   [junit4]   2> 2733621 T7751 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385369275640\'
   [junit4]   2> 2733647 T7751 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385369275640\solr.xml
   [junit4]   2> 2733738 T7751 oasc.CoreContainer.<init> New CoreContainer 2085493663
   [junit4]   2> 2733738 T7751 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385369275640\]
   [junit4]   2> 2733740 T7751 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 2733740 T7751 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 2733740 T7751 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 2733740 T7751 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2733740 T7751 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 2733741 T7751 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2733741 T7751 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 2733741 T7751 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 2733742 T7751 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 2733749 T7751 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2733750 T7751 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2733750 T7751 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 2733750 T7751 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56251/solr
   [junit4]   2> 2733751 T7751 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 2733753 T7751 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2733760 T7807 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d117687 name:ZooKeeperConnection Watcher:127.0.0.1:56251 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2733760 T7751 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2733762 T7753 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1428e71767a0007, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 2733764 T7751 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2733766 T7809 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3eb65a97 name:ZooKeeperConnection Watcher:127.0.0.1:56251/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2733767 T7751 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2733773 T7751 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2734633 T7751 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56279_
   [junit4]   2> 2734635 T7751 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56279_
   [junit4]   2> 2734638 T7809 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 2734639 T7793 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 2734639 T7773 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 2734640 T7780 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 2734649 T7810 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 2734649 T7810 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2734651 T7810 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 2734651 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2734651 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2734651 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2734653 T7774 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2734655 T7774 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:56279",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:56279_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 2734655 T7774 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 2734655 T7774 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 2734660 T7773 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2734749 T7780 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2734749 T7809 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2734749 T7793 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2734749 T7773 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2735506 T7810 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 2735506 T7810 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385369275640\collection1
   [junit4]   2> 2735506 T7810 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 2735508 T7810 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 2735508 T7810 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 2735510 T7810 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385369275640\collection1\'
   [junit4]   2> 2735510 T7810 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385369275640/collection1/lib/classes/' to classloader
   [junit4]   2> 2735512 T7810 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385369275640/collection1/lib/README' to classloader
   [junit4]   2> 2735573 T7810 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 2735628 T7810 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2735631 T7810 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 2735646 T7810 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 2736307 T7810 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 2736315 T7810 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 2736319 T7810 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2736345 T7810 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2736350 T7810 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2736356 T7810 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 2736357 T7810 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 2736357 T7810 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 2736357 T7810 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 2736359 T7810 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 2736359 T7810 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 2736359 T7810 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 2736360 T7810 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-jetty2-1385369275640\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876/jetty2\
   [junit4]   2> 2736360 T7810 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@59168284
   [junit4]   2> 2736360 T7810 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\jetty2
   [junit4]   2> 2736362 T7810 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876/jetty2\index/
   [junit4]   2> 2736362 T7810 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\jetty2\index' doesn't exist. Creating new index...
   [junit4]   2> 2736362 T7810 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\jetty2\index
   [junit4]   2> 2736364 T7810 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=94.34765625, floorSegmentMB=0.5029296875, forceMergeDeletesPctAllowed=19.809934316957623, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 2736369 T7810 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest-1385369269876\jetty2\index,segFN=segments_1,generation=1}
   [junit4]   2> 2736369 T7810 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2736374 T7810 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 2736374 T7810 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 2736374 T7810 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 2736374 T7810 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2736375 T7810 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2736375 T7810 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 2736376 T7810 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2736376 T7810 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2736376 T7810 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2736377 T7810 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 2736377 T7810 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 2736377 T7810 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 2736377 T7810 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 2736379 T7810 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 2736379 T7810 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 2736380 T7810 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 2736387 T7810 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2736391 T7810 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2736391 T7810 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2736392 T7810 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=9.712890625, floorSegmentMB=1.7158203125, forceMergeDeletesPctAllowed=8.124560470747364, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 2736393 T7810 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-t

[...truncated too long message...]


   [junit4]    >         at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
   [junit4]    >         at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
   [junit4]    >         at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
   [junit4]    >         at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
   [junit4]    >         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
   [junit4]    >         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
   [junit4]    >         at org.eclipse.jetty.server.Server.handle(Server.java:368)
   [junit4]    >         at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
   [junit4]    >         at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
   [junit4]    >         at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
   [junit4]    >         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:953)
   [junit4]    >         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
   [junit4]    >         at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
   [junit4]    >         at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
   [junit4]    >         at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
   [junit4]    >         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]    >         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]    >         at java.lang.Thread.run(Thread.java:744)
   [junit4]    >    2) Thread[id=7845, name=searcherExecutor-5068-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    >         at java.lang.Thread.run(Thread.java:744)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([9F3EB56801A84E02]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=7845, name=searcherExecutor-5068-thread-1, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    >         at java.lang.Thread.run(Thread.java:744)
   [junit4]    >    2) Thread[id=7836, name=qtp871330187-7836, state=RUNNABLE, group=TGRP-ChaosMonkeyNothingIsSafeTest]
   [junit4]    >         at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrServer.blockUntilFinished(ConcurrentUpdateSolrServer.java:391)
   [junit4]    >         at org.apache.solr.update.StreamingSolrServers.blockUntilFinished(StreamingSolrServers.java:104)
   [junit4]    >         at org.apache.solr.update.SolrCmdDistributor.doRetriesIfNeeded(SolrCmdDistributor.java:134)
   [junit4]    >         at org.apache.solr.update.SolrCmdDistributor.finish(SolrCmdDistributor.java:60)
   [junit4]    >         at org.apache.solr.update.processor.DistributedUpdateProcessor.doFinish(DistributedUpdateProcessor.java:609)
   [junit4]    >         at org.apache.solr.update.processor.DistributedUpdateProcessor.finish(DistributedUpdateProcessor.java:1457)
   [junit4]    >         at org.apache.solr.update.processor.LogUpdateProcessor.finish(LogUpdateProcessorFactory.java:179)
   [junit4]    >         at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:83)
   [junit4]    >         at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
   [junit4]    >         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1866)
   [junit4]    >         at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:755)
   [junit4]    >         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:417)
   [junit4]    >         at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:201)
   [junit4]    >         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
   [junit4]    >         at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:134)
   [junit4]    >         at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
   [junit4]    >         at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
   [junit4]    >         at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
   [junit4]    >         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
   [junit4]    >         at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
   [junit4]    >         at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
   [junit4]    >         at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
   [junit4]    >         at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
   [junit4]    >         at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
   [junit4]    >         at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
   [junit4]    >         at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
   [junit4]    >         at org.eclipse.jetty.server.Server.handle(Server.java:368)
   [junit4]    >         at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
   [junit4]    >         at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
   [junit4]    >         at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
   [junit4]    >         at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:953)
   [junit4]    >         at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
   [junit4]    >         at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
   [junit4]    >         at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
   [junit4]    >         at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
   [junit4]    >         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]    >         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]    >         at java.lang.Thread.run(Thread.java:744)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([9F3EB56801A84E02]:0)
   [junit4] Completed in 301.76s, 1 test, 1 failure, 2 errors <<< FAILURES!

[...truncated 210 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:420: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:400: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:492: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1275: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:908: There were test failures: 353 suites, 1558 tests, 3 suite-level errors, 215 ignored (11 assumptions)

Total time: 79 minutes 30 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_45 -XX:+UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.8.0-ea-b116) - Build # 3503 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3503/
Java: 32bit/jdk1.8.0-ea-b116 -server -XX:+UseSerialGC

3 tests failed.
REGRESSION:  org.apache.solr.cloud.OverseerTest.testOverseerFailure

Error Message:
KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1

Stack Trace:
org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
	at __randomizedtesting.SeedInfo.seed([D516CCFD887BECE1:D11E430E9ADE03C0]:0)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
	at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:424)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:421)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:378)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:365)
	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:102)
	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:165)
	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:109)
	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:157)
	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:277)
	at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:153)
	at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:584)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)


REGRESSION:  org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigReplication

Error Message:
[C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1385344435314\slave\collection1\data\, C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1385344435314\slave\collection1\data\index.20131125095357895, C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1385344435314\slave\collection1\data\index] expected:<2> but was:<3>

Stack Trace:
java.lang.AssertionError: [C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1385344435314\slave\collection1\data\, C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1385344435314\slave\collection1\data\index.20131125095357895, C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1385344435314\slave\collection1\data\index] expected:<2> but was:<3>
	at __randomizedtesting.SeedInfo.seed([D516CCFD887BECE1:C15E97A8AB7C51FF]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.solr.handler.TestReplicationHandler.checkForSingleIndex(TestReplicationHandler.java:863)
	at org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigReplication(TestReplicationHandler.java:569)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)


FAILED:  junit.framework.TestSuite.org.apache.solr.schema.EnumFieldTest

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
	at __randomizedtesting.SeedInfo.seed([D516CCFD887BECE1]:0)




Build Log:
[...truncated 10264 lines...]
   [junit4] Suite: org.apache.solr.schema.EnumFieldTest
   [junit4]   2> 561260 T2565 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-EnumFieldTest-1385335740897
   [junit4]   2> 561261 T2565 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\'
   [junit4]   2> 561262 T2565 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 561265 T2565 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 561305 T2565 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 561309 T2565 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
   [junit4]   2> 561309 T2565 oass.IndexSchema.readSchema Reading Solr Schema from schema-enums.xml
   [junit4]   2> 561313 T2565 oass.IndexSchema.readSchema [null] Schema name=tiny
   [junit4]   2> 561345 T2565 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 561345 T2565 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 561345 T2565 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr
   [junit4]   2> 561345 T2565 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\'
   [junit4]   2> 561360 T2565 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 561361 T2565 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr
   [junit4]   2> 561361 T2565 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\'
   [junit4]   2> 561385 T2565 oasc.CoreContainer.<init> New CoreContainer 27923901
   [junit4]   2> 561385 T2565 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\]
   [junit4]   2> 561386 T2565 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 561386 T2565 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 561386 T2565 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 561386 T2565 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 561386 T2565 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 561386 T2565 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 561386 T2565 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 561386 T2565 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 561386 T2565 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 561393 T2565 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 561395 T2565 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 561395 T2565 oasc.CoreContainer.load Host Name: 
   [junit4]   2> 561398 T2566 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1
   [junit4]   2> 561402 T2566 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\'
   [junit4]   2> 561402 T2566 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 561402 T2566 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 561422 T2566 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 561425 T2566 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
   [junit4]   2> 561425 T2566 oass.IndexSchema.readSchema Reading Solr Schema from schema-enums.xml
   [junit4]   2> 561429 T2566 oass.IndexSchema.readSchema [collection1] Schema name=tiny
   [junit4]   2> 561434 T2566 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 561434 T2566 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 561436 T2566 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-EnumFieldTest-1385335740897\
   [junit4]   2> 561436 T2566 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 561436 T2566 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-EnumFieldTest-1385335740897\
   [junit4]   2> 561436 T2566 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-EnumFieldTest-1385335740897\index/
   [junit4]   2> 561436 T2566 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-EnumFieldTest-1385335740897\index' doesn't exist. Creating new index...
   [junit4]   2> 561437 T2566 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-EnumFieldTest-1385335740897\index
   [junit4]   2> 561437 T2566 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=31, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=58.86328125, floorSegmentMB=1.12890625, forceMergeDeletesPctAllowed=28.732339032026154, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2806798019617426
   [junit4]   2> 561437 T2566 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1d6ddf5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f2da1c),segFN=segments_1,generation=1}
   [junit4]   2> 561437 T2566 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 561509 T2566 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 561510 T2566 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
   [junit4]   2> 561510 T2566 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 561510 T2566 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 561516 T2566 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 561518 T2566 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 561518 T2566 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 561520 T2566 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=27, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 561568 T2566 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1d6ddf5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f2da1c),segFN=segments_1,generation=1}
   [junit4]   2> 561568 T2566 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 561568 T2566 oass.SolrIndexSearcher.<init> Opening Searcher@14a9c2e main
   [junit4]   2> 561569 T2566 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 561569 T2567 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@14a9c2e main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 561571 T2565 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 561576 T2565 oas.SolrTestCaseJ4.setUp ###Starting testEnumSchema
   [junit4]   2> 561576 T2565 oas.SolrTestCaseJ4.tearDown ###Ending testEnumSchema
   [junit4]   2> 561579 T2565 oas.SolrTestCaseJ4.setUp ###Starting testBogusEnumSearch
   [junit4]   2> ASYNC  NEW_CORE C1300 name=collection1 org.apache.solr.core.SolrCore@15c22a7
   [junit4]   2> 561580 T2565 C1300 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 561582 T2565 C1300 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {deleteByQuery=*:*} 0 3
   [junit4]   2> 561585 T2565 C1300 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[0]} 0 1
   [junit4]   2> 561586 T2565 C1300 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[1]} 0 1
   [junit4]   2> 561587 T2565 C1300 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[2]} 0 1
   [junit4]   2> 561588 T2565 C1300 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[3]} 0 0
   [junit4]   2> 561589 T2565 C1300 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[4]} 0 0
   [junit4]   2> 561591 T2565 C1300 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[8]} 0 1
   [junit4]   2> 561592 T2565 C1300 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[9]} 0 0
   [junit4]   2> 561593 T2565 C1300 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 561595 T2565 C1300 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1d6ddf5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f2da1c),segFN=segments_1,generation=1}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1d6ddf5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f2da1c),segFN=segments_2,generation=2}
   [junit4]   2> 561596 T2565 C1300 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 561596 T2565 C1300 oass.SolrIndexSearcher.<init> Opening Searcher@d7ce30 main
   [junit4]   2> 561597 T2567 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@d7ce30 main{StandardDirectoryReader(segments_2:4:nrt _0(5.0):c7)}
   [junit4]   2> 561597 T2565 C1300 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 561597 T2565 C1300 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 4
   [junit4]   2> 561599 T2565 C1300 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=severity:bla&fl=severity} hits=0 status=0 QTime=1 
   [junit4]   2> 561600 T2565 C1300 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=severity:7&fl=severity} hits=0 status=0 QTime=0 
   [junit4]   2> 561600 T2565 C1300 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=severity:"-3"&fl=severity} hits=0 status=0 QTime=0 
   [junit4]   2> 561600 T2565 oas.SolrTestCaseJ4.tearDown ###Ending testBogusEnumSearch
   [junit4]   2> 561608 T2565 oas.SolrTestCaseJ4.setUp ###Starting testEnumRangeSearch
   [junit4]   2> 561609 T2565 C1300 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 561609 T2565 C1300 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {deleteByQuery=*:*} 0 1
   [junit4]   2> 561610 T2565 C1300 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[0]} 0 0
   [junit4]   2> 561612 T2565 C1300 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[1]} 0 0
   [junit4]   2> ASYNC  NEW_CORE C1301 name=collection1 org.apache.solr.core.SolrCore@15c22a7
   [junit4]   2> 561619 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[2]} 0 1
   [junit4]   2> 561620 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[3]} 0 0
   [junit4]   2> 561622 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[4]} 0 1
   [junit4]   2> 561623 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[5]} 0 0
   [junit4]   2> 561624 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[6]} 0 0
   [junit4]   2> 561626 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[7]} 0 1
   [junit4]   2> 561627 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[8]} 0 0
   [junit4]   2> 561628 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[9]} 0 0
   [junit4]   2> 561629 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[10]} 0 0
   [junit4]   2> 561630 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[11]} 0 0
   [junit4]   2> 561632 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[12]} 0 0
   [junit4]   2> 561633 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[13]} 0 1
   [junit4]   2> 561634 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[14]} 0 0
   [junit4]   2> 561635 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[20]} 0 0
   [junit4]   2> 561636 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[21]} 0 0
   [junit4]   2> 561637 T2565 C1301 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 561641 T2565 C1301 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1d6ddf5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f2da1c),segFN=segments_2,generation=2}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1d6ddf5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f2da1c),segFN=segments_3,generation=3}
   [junit4]   2> 561641 T2565 C1301 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
   [junit4]   2> 561642 T2565 C1301 oass.SolrIndexSearcher.<init> Opening Searcher@bc6f04 main
   [junit4]   2> 561642 T2565 C1301 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 561643 T2567 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@bc6f04 main{StandardDirectoryReader(segments_3:7:nrt _1(5.0):c17)}
   [junit4]   2> 561644 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 7
   [junit4]   2> 561645 T2565 C1301 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=severity:["Not+Available"+TO+"Not+Available"]&fl=severity} hits=5 status=0 QTime=0 
   [junit4]   2> 561646 T2565 C1301 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=severity:["Not+Available"+TO+Critical]&fl=severity} hits=15 status=0 QTime=0 
   [junit4]   2> 561647 T2565 C1301 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=severity:[Low+TO+High]&fl=severity} hits=9 status=0 QTime=1 
   [junit4]   2> 561648 T2565 C1301 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=severity:[High+TO+Low]&fl=severity} hits=0 status=0 QTime=1 
   [junit4]   2> 561649 T2565 C1301 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=severity:[High+TO+4]&fl=severity} hits=3 status=0 QTime=1 
   [junit4]   2> 561650 T2565 C1301 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=severity:[3+TO+Critical]&fl=severity} hits=3 status=0 QTime=1 
   [junit4]   2> 561650 T2565 C1301 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=severity:[3+TO+4]&fl=severity} hits=3 status=0 QTime=0 
   [junit4]   2> 561651 T2565 C1301 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=severity:{Low+TO+High]&fl=severity} hits=5 status=0 QTime=0 
   [junit4]   2> 561652 T2565 C1301 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=severity:[Low+TO+High}&fl=severity} hits=7 status=0 QTime=0 
   [junit4]   2> 561652 T2565 C1301 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=severity:{Low+TO+High}&fl=severity} hits=3 status=0 QTime=0 
   [junit4]   2> 561653 T2565 C1301 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=*:*&fl=severity} hits=17 status=0 QTime=1 
   [junit4]   2> 561654 T2565 C1301 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=severity:[*+TO+*]&fl=severity} hits=15 status=0 QTime=1 
   [junit4]   2> 561656 T2565 C1301 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=-severity:[*+TO+*]&fl=severity} hits=2 status=0 QTime=2 
   [junit4]   2> 561656 T2565 oas.SolrTestCaseJ4.tearDown ###Ending testEnumRangeSearch
   [junit4]   2> 561663 T2565 oas.SolrTestCaseJ4.setUp ###Starting testKnownIntegerEnumIndexing
   [junit4]   2> 561664 T2565 C1301 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 561664 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {deleteByQuery=*:*} 0 1
   [junit4]   2> 561667 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[0]} 0 2
   [junit4]   2> 561669 T2565 C1301 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 561670 T2565 C1301 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1d6ddf5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f2da1c),segFN=segments_3,generation=3}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1d6ddf5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f2da1c),segFN=segments_4,generation=4}
   [junit4]   2> 561670 T2565 C1301 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
   [junit4]   2> 561670 T2565 C1301 oass.SolrIndexSearcher.<init> Opening Searcher@1ead180 main
   [junit4]   2> 561670 T2565 C1301 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 561673 T2567 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1ead180 main{StandardDirectoryReader(segments_4:10:nrt _2(5.0):c1)}
   [junit4]   2> 561673 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 5
   [junit4]   2> 561674 T2565 C1301 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=*:*&fl=severity} hits=1 status=0 QTime=0 
   [junit4]   2> 561678 T2565 oas.SolrTestCaseJ4.tearDown ###Ending testKnownIntegerEnumIndexing
   [junit4]   2> 561684 T2565 oas.SolrTestCaseJ4.setUp ###Starting testEnumSort
   [junit4]   2> 561686 T2565 C1301 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 561686 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {deleteByQuery=*:*} 0 0
   [junit4]   2> 561688 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[0]} 0 0
   [junit4]   2> 561689 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[1]} 0 0
   [junit4]   2> 561690 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[2]} 0 0
   [junit4]   2> 561692 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[3]} 0 1
   [junit4]   2> 561693 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[4]} 0 0
   [junit4]   2> 561694 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[8]} 0 0
   [junit4]   2> 561696 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[9]} 0 0
   [junit4]   2> 561697 T2565 C1301 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 561698 T2565 C1301 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1d6ddf5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f2da1c),segFN=segments_4,generation=4}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1d6ddf5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f2da1c),segFN=segments_5,generation=5}
   [junit4]   2> 561699 T2565 C1301 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
   [junit4]   2> 561699 T2565 C1301 oass.SolrIndexSearcher.<init> Opening Searcher@14202b0 main
   [junit4]   2> 561699 T2565 C1301 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 561701 T2567 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@14202b0 main{StandardDirectoryReader(segments_5:13:nrt _3(5.0):c7)}
   [junit4]   2> 561701 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 4
   [junit4]   2> 561703 T2565 C1301 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=*:*&fl=severity&sort=severity+desc} hits=7 status=0 QTime=0 
   [junit4]   2> 561704 T2565 C1301 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=*:*&fl=severity&sort=severity+asc} hits=7 status=0 QTime=1 
   [junit4]   2> 561705 T2565 C1301 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=severity:[*+TO+*]&fl=severity&sort=severity+asc} hits=5 status=0 QTime=0 
   [junit4]   2> 561705 T2565 oas.SolrTestCaseJ4.tearDown ###Ending testEnumSort
   [junit4]   2> 561713 T2565 oas.SolrTestCaseJ4.setUp ###Starting testBogusEnumIndexing
   [junit4]   2> 561719 T2565 C1301 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 561719 T2565 C1301 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {deleteByQuery=*:*} 0 6
   [junit4]   2> ASYNC  NEW_CORE C1302 name=collection1 org.apache.solr.core.SolrCore@15c22a7
   [junit4]   2> 561726 T2565 C1302 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {} 0 0
   [junit4]   2> 561727 T2565 C1302 oasc.SolrException.log Ignoring exception matching Unknown value for enum field: blabla
   [junit4]   2> 561728 T2565 C1302 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {} 0 0
   [junit4]   2> 561728 T2565 C1302 oasc.SolrException.log Ignoring exception matching Unknown value for enum field: 10
   [junit4]   2> 561730 T2565 C1302 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {} 0 1
   [junit4]   2> 561731 T2565 C1302 oasc.SolrException.log Ignoring exception matching Unknown value for enum field: -4
   [junit4]   2> 561732 T2565 oas.SolrTestCaseJ4.tearDown ###Ending testBogusEnumIndexing
   [junit4]   2> 561732 T2565 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 561732 T2565 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=27923901
   [junit4]   2> 7235311 T2564 ccr.ThreadLeakControl$2.evaluate WARNING Suite execution timed out: org.apache.solr.schema.EnumFieldTest
   [junit4]   2> 	==== jstack at approximately timeout time ====
   [junit4]   2> 	"Thread-1167" ID=2568 WAITING on java.lang.Object@10894b4
   [junit4]   2> 		at java.lang.Object.wait(Native Method)
   [junit4]   2> 		- waiting on java.lang.Object@10894b4
   [junit4]   2> 		at java.lang.Object.wait(Object.java:502)
   [junit4]   2> 		at org.apache.solr.core.CloserThread.run(CoreContainer.java:1006)
   [junit4]   2> 	
   [junit4]   2> 	"searcherExecutor-1650-thread-1" ID=2567 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@6e56d4
   [junit4]   2> 		at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 		- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@6e56d4
   [junit4]   2> 		at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 		at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2> 		at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 	
   [junit4]   2> 	"SUITE-EnumFieldTest-seed#[D516CCFD887BECE1]-worker" ID=2565 WAITING on org.apache.solr.core.CloserThread@1c78f85
   [junit4]   2> 		at java.lang.Object.wait(Native Method)
   [junit4]   2> 		- waiting on org.apache.solr.core.CloserThread@1c78f85
   [junit4]   2> 		at java.lang.Thread.join(Thread.java:1244)
   [junit4]   2> 		at java.lang.Thread.join(Thread.java:1318)
   [junit4]   2> 		at org.apache.solr.core.CoreContainer.shutdown(CoreContainer.java:376)
   [junit4]   2> 		at org.apache.solr.util.TestHarness.close(TestHarness.java:337)
   [junit4]   2> 		at org.apache.solr.SolrTestCaseJ4.deleteCore(SolrTestCaseJ4.java:539)
   [junit4]   2> 		at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:134)
   [junit4]   2> 		at sun.reflect.GeneratedMethodAccessor36.invoke(Unknown Source)
   [junit4]   2> 		at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 		at java.lang.reflect.Method.invoke(Method.java:483)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
   [junit4]   2> 		at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 	
   [junit4]   2> 	"SUITE-EnumFieldTest-seed#[D516CCFD887BECE1]" ID=2564 RUNNABLE
   [junit4]   2> 		at sun.management.ThreadImpl.dumpThreads0(Native Method)
   [junit4]   2> 		at sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:446)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl.formatThreadStacksFull(ThreadLeakControl.java:655)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl.access$800(ThreadLeakControl.java:60)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:396)
   [junit4]   2> 		- locked java.lang.Object@cb7a30
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:556)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:79)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$1.run(RandomizedRunner.java:492)
   [junit4]   2> 	
   [junit4]   2> 	"RMI TCP Accept-0" ID=952 RUNNABLE (in native code)
   [junit4]   2> 		at java.net.DualStackPlainSocketImpl.accept0(Native Method)
   [junit4]   2> 		at java.net.DualStackPlainSocketImpl.socketAccept(DualStackPlainSocketImpl.java:131)
   [junit4]   2> 		at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:404)
   [junit4]   2> 		at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:199)
   [junit4]   2> 		- locked java.net.SocksSocketImpl@47e6f3
   [junit4]   2> 		at java.net.ServerSocket.implAccept(ServerSocket.java:545)
   [junit4]   2> 		at java.net.ServerSocket.accept(ServerSocket.java:513)
   [junit4]   2> 		at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:389)
   [junit4]   2> 		at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:361)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 	
   [junit4]   2> 	"RMI RenewClean-[127.0.0.1:58546]" ID=948 TIMED_WAITING on java.lang.ref.ReferenceQueue$Lock@1276bfb
   [junit4]   2> 		at java.lang.Object.wait(Native Method)
   [junit4]   2> 		- timed waiting on java.lang.ref.ReferenceQueue$Lock@1276bfb
   [junit4]   2> 		at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:142)
   [junit4]   2> 		at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:536)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 	
   [junit4]   2> 	"RMI Scheduler(0)" ID=947 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1d148fd
   [junit4]   2> 		at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 		- timed waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1d148fd
   [junit4]   2> 		at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]   2> 		at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
   [junit4]   2> 		at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
   [junit4]   2> 		at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 	
   [junit4]   2> 	"GC Daemon" ID=945 TIMED_WAITING on sun.misc.GC$LatencyLock@a8a0cd
   [junit4]   2> 		at java.lang.Object.wait(Native Method)
   [junit4]   2> 		- timed waiting on sun.misc.GC$LatencyLock@a8a0cd
   [junit4]   2> 		at sun.misc.GC$Daemon.run(GC.java:117)
   [junit4]   2> 	
   [junit4]   2> 	"RMI Reaper" ID=944 WAITING on java.lang.ref.ReferenceQueue$Lock@143aad5
   [junit4]   2> 		at java.lang.Object.wait(Native Method)
   [junit4]   2> 		- waiting on java.lang.ref.ReferenceQueue$Lock@143aad5
   [junit4]   2> 		at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:142)
   [junit4]   2> 		at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:158)
   [junit4]   2> 		at sun.rmi.transport.ObjectTable$Reaper.run(ObjectTable.java:351)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 	
   [junit4]   2> 	"RMI TCP Accept-0" ID=943 RUNNABLE (in native code)
   [junit4]   2> 		at java.net.DualStackPlainSocketImpl.accept0(Native Method)
   [junit4]   2> 		at java.net.DualStackPlainSocketImpl.socketAccept(DualStackPlainSocketImpl.java:131)
   [junit4]   2> 		at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:404)
   [junit4]   2> 		at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:199)
   [junit4]   2> 		- locked java.net.SocksSocketImpl@1697675
   [junit4]   2> 		at java.net.ServerSocket.implAccept(ServerSocket.java:545)
   [junit4]   2> 		at java.net.ServerSocket.accept(ServerSocket.java:513)
   [junit4]   2> 		at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:389)
   [junit4]   2> 		at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:361)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 	
   [junit4]   2> 	"RMI TCP Accept-0" ID=942 RUNNABLE (in native code)
   [junit4]   2> 		at java.net.DualStackPlainSocketImpl.accept0(Native Method)
   [junit4]   2> 		at java.net.DualStackPlainSocketImpl.socketAccept(DualStackPlainSocketImpl.java:131)
   [junit4]   2> 		at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:404)
   [junit4]   2> 		at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:199)
   [junit4]   2> 		- locked java.net.SocksSocketImpl@325d85
   [junit4]   2> 		at java.net.ServerSocket.implAccept(ServerSocket.java:545)
   [junit4]   2> 		at java.net.ServerSocket.accept(ServerSocket.java:513)
   [junit4]   2> 		at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:389)
   [junit4]   2> 		at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:361)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 	
   [junit4]   2> 	"Attach Listener" ID=5 RUNNABLE
   [junit4]   2> 	
   [junit4]   2> 	"Signal Dispatcher" ID=4 RUNNABLE
   [junit4]   2> 	
   [junit4]   2> 	"Finalizer" ID=3 WAITING on java.lang.ref.ReferenceQueue$Lock@1fd3f86
   [junit4]   2> 		at java.lang.Object.wait(Native Method)
   [junit4]   2> 		- waiting on java.lang.ref.ReferenceQueue$Lock@1fd3f86
   [junit4]   2> 		at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:142)
   [junit4]   2> 		at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:158)
   [junit4]   2> 		at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:189)
   [junit4]   2> 	
   [junit4]   2> 	"Reference Handler" ID=2 WAITING on java.lang.ref.Reference$Lock@14a206e
   [junit4]   2> 		at java.lang.Object.wait(Native Method)
   [junit4]   2> 		- waiting on java.lang.ref.Reference$Lock@14a206e
   [junit4]   2> 		at java.lang.Object.wait(Object.java:502)
   [junit4]   2> 		at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:157)
   [junit4]   2> 	
   [junit4]   2> 	"main" ID=1 WAITING on com.carrotsearch.randomizedtesting.RandomizedRunner$1@359e8f
   [junit4]   2> 		at java.lang.Object.wait(Native Method)
   [junit4]   2> 		- waiting on com.carrotsearch.randomizedtesting.RandomizedRunner$1@359e8f
   [junit4]   2> 		at java.lang.Thread.join(Thread.java:1244)
   [junit4]   2> 		at java.lang.Thread.join(Thread.java:1318)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:502)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.run(RandomizedRunner.java:399)
   [junit4]   2> 		at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:180)
   [junit4]   2> 		at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:275)
   [junit4]   2> 		at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:12)
   [junit4]   2> 	
   [junit4]   2> 	^^==============================================
   [junit4]   2> 	
   [junit4]   2> 7235315 T2564 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 3 leaked thread(s).
   [junit4]   2> 7255363 T2564 ccr.ThreadLeakControl.checkThreadLeaks SEVERE 3 threads leaked from SUITE scope at org.apache.solr.schema.EnumFieldTest: 
   [junit4]   2> 	   1) Thread[id=2568, name=Thread-1167, state=WAITING, group=TGRP-EnumFieldTest]
   [junit4]   2> 	        at java.lang.Object.wait(Native Method)
   [junit4]   2> 	        at java.lang.Object.wait(Object.java:502)
   [junit4]   2> 	        at org.apache.solr.core.CloserThread.run(CoreContainer.java:1006)
   [junit4]   2> 	   2) Thread[id=2567, name=searcherExecutor-1650-thread-1, state=WAITING, group=TGRP-EnumFieldTest]
   [junit4]   2> 	        at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2> 	        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 	   3) Thread[id=2565, name=SUITE-EnumFieldTest-seed#[D516CCFD887BECE1]-worker, state=WAITING, group=TGRP-EnumFieldTest]
   [junit4]   2> 	        at java.lang.Object.wait(Native Method)
   [junit4]   2> 	        at java.lang.Thread.join(Thread.java:1244)
   [junit4]   2> 	        at java.lang.Thread.join(Thread.java:1318)
   [junit4]   2> 	        at org.apache.solr.core.CoreContainer.shutdown(CoreContainer.java:376)
   [junit4]   2> 	        at org.apache.solr.util.TestHarness.close(TestHarness.java:337)
   [junit4]   2> 	        at org.apache.solr.SolrTestCaseJ4.deleteCore(SolrTestCaseJ4.java:539)
   [junit4]   2> 	        at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:134)
   [junit4]   2> 	        at sun.reflect.GeneratedMethodAccessor36.invoke(Unknown Source)
   [junit4]   2> 	        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	        at java.lang.reflect.Method.invoke(Method.java:483)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
   [junit4]   2> 	        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 7255366 T2564 ccr.ThreadLeakControl.tryToInterruptAll Starting to interrupt leaked threads:
   [junit4]   2> 	   1) Thread[id=2568, name=Thread-1167, state=WAITING, group=TGRP-EnumFieldTest]
   [junit4]   2> 	   2) Thread[id=2567, name=searcherExecutor-1650-thread-1, state=WAITING, group=TGRP-EnumFieldTest]
   [junit4]   2> 	   3) Thread[id=2565, name=SUITE-EnumFieldTest-seed#[D516CCFD887BECE1]-worker, state=WAITING, group=TGRP-EnumFieldTest]
   [junit4]   2> 7816625 T2565 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@15c22a7
   [junit4]   2> 7816626 T2565 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=3,deletesById=0,deletesByQuery=1,errors=3,cumulative_adds=35,cumulative_deletesById=0,cumulative_deletesByQuery=5,cumulative_errors=3}
   [junit4]   2> 7816626 T2565 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 7816626 T2565 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 7816626 T2565 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> ASYNC  NEW_CORE C1303 name=collection1 org.apache.solr.core.SolrCore@15c22a7
   [junit4]   2> 7816630 T2565 C1303 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1d6ddf5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f2da1c),segFN=segments_5,generation=5}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1d6ddf5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f2da1c),segFN=segments_6,generation=6}
   [junit4]   2> 7816632 T2565 C1303 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
   [junit4]   2> 7816636 T2565 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 7816637 T2565 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 7816637 T2565 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-EnumFieldTest-1385335740897\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-EnumFieldTest-1385335740897\index;done=false>>]
   [junit4]   2> 7816640 T2565 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-EnumFieldTest-1385335740897\index
   [junit4]   2> 7816641 T2565 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-EnumFieldTest-1385335740897\ [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-EnumFieldTest-1385335740897\;done=false>>]
   [junit4]   2> 7816641 T2565 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-EnumFieldTest-1385335740897\
   [junit4]   2> 7255393 T2564 ccr.ThreadLeakControl.tryToInterruptAll All leaked threads terminated.
   [junit4]   2> NOTE: test params are: codec=Lucene42, sim=DefaultSimilarity, locale=sr_RS, timezone=America/Argentina/ComodRivadavia
   [junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.8.0-ea (32-bit)/cpus=2,threads=1,free=204632456,total=235413504
   [junit4]   2> NOTE: All tests run in this JVM: [DOMUtilTest, TestWriterPerf, TestAnalyzeInfixSuggestions, TestConfig, TermVectorComponentDistributedTest, SOLR749Test, IndexSchemaTest, TestIndexingPerformance, TestLRUCache, CollectionsAPIDistributedZkTest, NumericFieldsTest, TestRTGBase, TestLMJelinekMercerSimilarityFactory, SolrCoreCheckLockOnStartupTest, TestFastLRUCache, SortByFunctionTest, TestWordDelimiterFilterFactory, DocValuesMissingTest, PingRequestHandlerTest, PrimitiveFieldTypeTest, SolrCoreTest, TestIndexSearcher, ParsingFieldUpdateProcessorsTest, TestCSVLoader, TestJmxIntegration, TermsComponentTest, StandardRequestHandlerTest, TestDefaultSearchFieldResource, DistributedQueryElevationComponentTest, TestSolrQueryParserDefaultOperatorResource, TestJmxMonitoredMap, DefaultValueUpdateProcessorTest, RecoveryZkTest, BlockCacheTest, TestModifyConfFiles, HdfsLockFactoryTest, PrimUtilsTest, TestRecoveryHdfs, TestMaxScoreQueryParser, TriLevelCompositeIdRoutingTest, BadIndexSchemaTest, SimplePostToolTest, BadComponentTest, SuggesterTest, TimeZoneUtilsTest, PolyFieldTest, TestClassNameShortening, TestRandomMergePolicy, FieldFacetTest, DistributedSpellCheckComponentTest, HdfsSyncSliceTest, SampleTest, OpenCloseCoreStressTest, TestSolrXml, DateFieldTest, TestCollapseQParserPlugin, TestAnalyzedSuggestions, SolrIndexSplitterTest, TestCloudManagedSchemaAddField, CustomCollectionTest, TermVectorComponentTest, QueryEqualityTest, FunctionTest, ZkControllerTest, ZkSolrClientTest, UniqFieldsUpdateProcessorFactoryTest, TestCoreDiscovery, TestRandomDVFaceting, HighlighterConfigTest, TestInfoStreamLogging, DistributedTermsComponentTest, HdfsBasicDistributedZkTest, TestFoldingMultitermQuery, TestCodecSupport, AlternateDirectoryTest, TestNumberUtils, EnumFieldTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=EnumFieldTest -Dtests.seed=D516CCFD887BECE1 -Dtests.slow=true -Dtests.locale=sr_RS -Dtests.timezone=America/Argentina/ComodRivadavia -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s | EnumFieldTest (suite) <<<
   [junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([D516CCFD887BECE1]:0)
   [junit4] Completed in 7255.47s, 6 tests, 1 error <<< FAILURES!

[...truncated 118 lines...]
   [junit4] Suite: org.apache.solr.cloud.OverseerTest
   [junit4]   2> 8197150 T3688 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-OverseerTest-1385343376787
   [junit4]   2> 8197153 T3688 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 8197156 T3688 oas.SolrTestCaseJ4.setUp ###Starting testDoubleAssignment
   [junit4]   2> 8197157 T3688 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 8197157 T3689 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 8197256 T3688 oasc.ZkTestServer.run start zk server on port:60077
   [junit4]   2> 8197258 T3688 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 8197271 T3695 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ff0e9b name:ZooKeeperConnection Watcher:127.0.0.1:60077/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 8197271 T3688 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 8197273 T3688 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 8197277 T3697 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15dc934 name:ZooKeeperConnection Watcher:127.0.0.1:60077 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 8197277 T3688 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 8197281 T3690 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1428ce65da30001, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 8197283 T3688 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 8197288 T3699 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36fdbb name:ZooKeeperConnection Watcher:127.0.0.1:60077 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 8197288 T3688 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 8197288 T3688 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 8197296 T3688 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 8197296 T3690 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1428ce65da30002, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 8197305 T3688 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 8197309 T3688 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 8197312 T3688 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 8197317 T3688 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 8197324 T3701 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1efa42b name:ZooKeeperConnection Watcher:127.0.0.1:60077/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 8197324 T3688 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 8197326 T3688 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 8197330 T3688 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
   [junit4]   2> 8197335 T3695 oascc.ZkStateReader$3.process Updating live nodes... (1)
   [junit4]   2> 8197335 T3701 oascc.ZkStateReader$3.process Updating live nodes... (1)
   [junit4]   2> 8197337 T3688 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 8197340 T3703 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c1f51b name:ZooKeeperConnection Watcher:127.0.0.1:60077/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 8197341 T3688 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 8197342 T3688 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 8197354 T3688 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 8197358 T3688 oasc.Overseer.start Overseer (id=90789863542161412-127.0.0.1:60077_solr-n_0000000000) starting
   [junit4]   2> 8197362 T3688 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 8197366 T3688 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 8197372 T3688 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 8197379 T3705 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 8197394 T3704 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 8197401 T3704 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 8197402 T3704 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"recovering",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 8197402 T3704 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1]
   [junit4]   2> 8197402 T3704 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 8197408 T3703 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 8197409 T3695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 8197410 T3701 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 8197888 T3688 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 8197911 T3688 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 8197922 T3703 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 8197924 T3688 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 8197925 T3704 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 8197930 T3695 oascc.ZkStateReader$3.process Updating live nodes... (0)
   [junit4]   2> 8197930 T3701 oascc.ZkStateReader$3.process Updating live nodes... (0)
   [junit4]   2> 8197933 T3690 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1428ce65da30003, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 8197934 T3703 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 8197936 T3688 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 8197940 T3707 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@192909e name:ZooKeeperConnection Watcher:127.0.0.1:60077/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 8197940 T3688 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 8197943 T3688 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 8197948 T3688 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
   [junit4]   2> 8197953 T3695 oascc.ZkStateReader$3.process Updating live nodes... (1)
   [junit4]   2> 8197954 T3707 oascc.ZkStateReader$3.process Updating live nodes... (1)
   [junit4]   2> 8197958 T3703 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 8197958 T3688 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 8197960 T3704 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"recovering",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 8197960 T3704 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 8197967 T3703 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 8197973 T3688 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 8197983 T3703 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 8197989 T3703 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 8198092 T3707 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 8198093 T3695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 8198095 T3688 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 8198103 T3707 oascc.ZkStateReader$3.process Updating live nodes... (0)
   [junit4]   2> 8198103 T3695 oascc.ZkStateReader$3.process Updating live nodes... (0)
   [junit4]   2> 8198109 T3690 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1428ce65da30000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 8198114 T3688 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:60077 60077
   [junit4]   2> 8199554 T3704 oasc.Overseer$ClusterStateUpdater.run WARN Solr cannot talk to ZK, exiting Overseer main queue loop org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue-work/qn-0000000002
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:269)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:266)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:266)
   [junit4]   2> 	at org.apache.solr.cloud.DistributedQueue.remove(DistributedQueue.java:169)
   [junit4]   2> 	at org.apache.solr.cloud.DistributedQueue.poll(DistributedQueue.java:445)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:199)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 8200240 T3688 oas.SolrTestCaseJ4.tearDown ###Ending testDoubleAssignment
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 8200244 T3688 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignment
   [junit4]   2> 8200244 T3688 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 8200246 T3708 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 8200335 T3688 oasc.ZkTestServer.run start zk server on port:60098
   [junit4]   2> 8200336 T3688 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 8200345 T3714 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ae7e32 name:ZooKeeperConnection Watcher:127.0.0.1:60098 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 8200345 T3688 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 8200384 T3709 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1428ce669b00000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 8200387 T3688 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 8200393 T3716 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e4030 name:ZooKeeperConnection Watcher:127.0.0.1:60098 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 8200394 T3688 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 8200394 T3688 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 8200399 T3709 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1428ce669b00001, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 8200400 T3688 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 8200407 T3718 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1de0b09 name:ZooKeeperConnection Watcher:127.0.0.1:60098/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 8200407 T3688 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 8200407 T3688 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 8200417 T3688 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 8200423 T3720 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@dd6bcc name:ZooKeeperConnection Watcher:127.0.0.1:60098/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 8200423 T3688 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 8200427 T3688 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 8200436 T3688 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 8200441 T3688 oasc.Overseer.start Overseer (id=90789863744339971-127.0.0.1:60098_solr-n_0000000000) starting
   [junit4]   2> 8200445 T3688 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 8200450 T3688 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 8200456 T3688 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 8200487 T3722 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 8200488 T3688 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 8200493 T3688 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 8200494 T3721 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 8200498 T3688 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 8200508 T3688 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 8200514 T3724 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@197ce8b name:ZooKeeperConnection Watcher:127.0.0.1:60098/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 8200514 T3688 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 8200516 T3688 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 8200521 T3688 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1
   [junit4]   2> 8200526 T3724 oascc.ZkStateReader$3.process Updating live nodes... (1)
   [junit4]   2> 8200526 T3718 oascc.ZkStateReader$3.process Updating live nodes... (1)
   [junit4]   2> 8200530 T3720 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 8200533 T3721 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 8200534 T3721 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"127.0.0.1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "base_url":"http://127.0.0.1/solr/"}
   [junit4]   2> 8200534 T3721 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
   [junit4]   2> 8200534 T3721 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 8200538 T3720 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 8200540 T3718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 8200540 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 8200976 T3688 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 8200989 T3688 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 8200999 T3720 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 8201002 T3720 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 8201003 T3721 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 8201010 T3721 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"127.0.0.1",
   [junit4]   2> 	  "core":"core2",
   [junit4]   2> 	  "core_node_name":"node2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "base_url":"http://127.0.0.1/solr/"}
   [junit4]   2> 8201010 T3721 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 8201010 T3721 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
   [junit4]   2> 8201014 T3720 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 8201106 T3718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 8201107 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 8201448 T3688 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
   [junit4]   2> 8201458 T3688 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
   [junit4]   2> 8201465 T3720 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 8201465 T3720 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 8201465 T3720 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 8201467 T3720 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 8201468 T3721 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 8201473 T3721 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"127.0.0.1",
   [junit4]   2> 	  "core":"core3",
   [junit4]   2> 	  "core_node_name":"node3",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "base_url":"http://127.0.0.1/solr/"}
   [junit4]   2> 8201473 T3721 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 8201473 T3721 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 8201477 T3720 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 8201569 T3718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 8201570 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 8201914 T3688 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 8201922 T3688 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 8201929 T3720 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 8201930 T3720 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 8201930 T3720 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 8201933 T3720 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 8201934 T3721 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 8201940 T3721 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"127.0.0.1",
   [junit4]   2> 	  "core":"core4",
   [junit4]   2> 	  "core_node_name":"node4",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "base_url":"http://127.0.0.1/solr/"}
   [junit4]   2> 8201940 T3721 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 8201940 T3721 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 8201943 T3720 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 8202036 T3718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 8202036 T3724 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 8202378 T3688 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 8202394 T3720 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 8202394 T3720 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 8202394 T3720 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeCh

[...truncated too long message...]

org.apache.solr.handler.TestReplicationHandler$SolrInstance-1385344472080\master\collection1\data\
   [junit4]   2> 9299586 T6537 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1385344472080\master\collection1\data\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1385344472080\master\collection1\data\index;done=false>>]
   [junit4]   2> 9299587 T6537 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1385344472080\master\collection1\data\index
   [junit4]   2> 9299588 T6537 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 9299656 T6537 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=9660000
   [junit4]   2> 9299658 T6537 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1ceb73
   [junit4]   2> 9299659 T6537 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 9299661 T6537 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 9299661 T6537 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 9299661 T6537 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 9299662 T6537 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 9299662 T6537 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 9299662 T6537 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1385344472270\slave\collection1\data\ [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1385344472270\slave\collection1\data\;done=false>>]
   [junit4]   2> 9299662 T6537 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1385344472270\slave\collection1\data\
   [junit4]   2> 9299665 T6537 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1385344472270\slave\collection1\data\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1385344472270\slave\collection1\data\index;done=false>>]
   [junit4]   2> 9299665 T6537 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1385344472270\slave\collection1\data\index
   [junit4]   2> 9299666 T6537 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 9299751 T6537 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=28), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=28)), sim=DefaultSimilarity, locale=sr_ME_#Latn, timezone=Asia/Ulaanbaatar
   [junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.8.0-ea (32-bit)/cpus=2,threads=1,free=71917912,total=367157248
   [junit4]   2> NOTE: All tests run in this JVM: [DOMUtilTest, TestWriterPerf, TestAnalyzeInfixSuggestions, TestConfig, TermVectorComponentDistributedTest, SOLR749Test, IndexSchemaTest, TestIndexingPerformance, TestLRUCache, CollectionsAPIDistributedZkTest, NumericFieldsTest, TestRTGBase, TestLMJelinekMercerSimilarityFactory, SolrCoreCheckLockOnStartupTest, TestFastLRUCache, SortByFunctionTest, TestWordDelimiterFilterFactory, DocValuesMissingTest, PingRequestHandlerTest, PrimitiveFieldTypeTest, SolrCoreTest, TestIndexSearcher, ParsingFieldUpdateProcessorsTest, TestCSVLoader, TestJmxIntegration, TermsComponentTest, StandardRequestHandlerTest, TestDefaultSearchFieldResource, DistributedQueryElevationComponentTest, TestSolrQueryParserDefaultOperatorResource, TestJmxMonitoredMap, DefaultValueUpdateProcessorTest, RecoveryZkTest, BlockCacheTest, TestModifyConfFiles, HdfsLockFactoryTest, PrimUtilsTest, TestRecoveryHdfs, TestMaxScoreQueryParser, TriLevelCompositeIdRoutingTest, BadIndexSchemaTest, SimplePostToolTest, BadComponentTest, SuggesterTest, TimeZoneUtilsTest, PolyFieldTest, TestClassNameShortening, TestRandomMergePolicy, FieldFacetTest, DistributedSpellCheckComponentTest, HdfsSyncSliceTest, SampleTest, OpenCloseCoreStressTest, TestSolrXml, DateFieldTest, TestCollapseQParserPlugin, TestAnalyzedSuggestions, SolrIndexSplitterTest, TestCloudManagedSchemaAddField, CustomCollectionTest, TermVectorComponentTest, QueryEqualityTest, FunctionTest, ZkControllerTest, ZkSolrClientTest, UniqFieldsUpdateProcessorFactoryTest, TestCoreDiscovery, TestRandomDVFaceting, HighlighterConfigTest, TestInfoStreamLogging, DistributedTermsComponentTest, HdfsBasicDistributedZkTest, TestFoldingMultitermQuery, TestCodecSupport, AlternateDirectoryTest, TestNumberUtils, EnumFieldTest, SliceStateTest, MigrateRouteKeyTest, TestSerializedLuceneMatchVersion, StatelessScriptUpdateProcessorFactoryTest, SpellCheckCollatorTest, LegacyHTMLStripCharFilterTest, TestValueSourceCache, TestFieldTypeCollectionResource, RequiredFieldsTest, TestFunctionQuery, TestSolrXmlPersistor, DeleteShardTest, CoreMergeIndexesAdminHandlerTest, TestLFUCache, AnalysisAfterCoreReloadTest, SolrPluginUtilsTest, SignatureUpdateProcessorFactoryTest, ClusterStateUpdateTest, TestRandomFaceting, DirectUpdateHandlerTest, TestNonNRTOpen, BlockDirectoryTest, HighlighterTest, TestZkChroot, HdfsUnloadDistributedZkTest, TestDFRSimilarityFactory, TestBadConfig, TestSolrIndexConfig, TestReloadAndDeleteDocs, TestStressLucene, TestFastOutputStream, TestMultiCoreConfBootstrap, PeerSyncTest, SynonymTokenizerTest, UpdateParamsTest, ChaosMonkeyNothingIsSafeTest, OverseerTest, TestTrie, RequestHandlersTest, IndexSchemaRuntimeFieldTest, TestQueryUtils, TestDynamicFieldCollectionResource, TestCharFilters, TestFieldResource, DocumentBuilderTest, SliceStateUpdateTest, TestUtils, HdfsChaosMonkeySafeLeaderTest, ExpressionTest, QueryResultKeyTest, TestRecovery, AbstractAnalyticsStatsTest, LeaderElectionIntegrationTest, PathHierarchyTokenizerFactoryTest, AliasIntegrationTest, CSVRequestHandlerTest, AbstractAnalyticsFacetTest, CoreAdminHandlerTest, HdfsRecoveryZkTest, TestJoin, UpdateRequestProcessorFactoryTest, SystemInfoHandlerTest, HdfsBasicDistributedZk2Test, IndexBasedSpellCheckerTest, RegexBoostProcessorTest, TestStressReorder, RAMDirectoryFactoryTest, TestSolrQueryParser, TestXIncludeConfig, DateMathParserTest, TestGroupingSearch, MoreLikeThisHandlerTest, LeaderElectionTest, TestSuggestSpellingConverter, BadCopyFieldTest, TestSolrJ, TestUpdate, TestElisionMultitermQuery, ConvertedLegacyTest, ShardRoutingTest, TestReload, TestQuerySenderNoQuery, PreAnalyzedFieldTest, TestStressUserVersions, TestSimpleQParserPlugin, TestRealTimeGet, TestCoreContainer, TestFieldTypeResource, TestUniqueKeyFieldResource, UUIDFieldTest, CoreAdminCreateDiscoverTest, FieldAnalysisRequestHandlerTest, StatsComponentTest, OpenExchangeRatesOrgProviderTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, UnloadDistributedZkTest, SyncSliceTest, BasicZkTest, FullSolrCloudDistribCmdsTest, TestReplicationHandler]
   [junit4] Completed in 46.94s, 14 tests, 1 failure <<< FAILURES!

[...truncated 530 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:420: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:400: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:492: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1275: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:908: There were test failures: 353 suites, 1558 tests, 1 suite-level error, 1 error, 1 failure, 42 ignored (11 assumptions)

Total time: 189 minutes 53 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0-ea-b116 -server -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.7.0_45) - Build # 3502 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3502/
Java: 32bit/jdk1.7.0_45 -server -XX:+UseG1GC

8 tests failed.
REGRESSION:  org.apache.solr.analytics.expression.ExpressionTest.multiplyTest

Error Message:
For input string: "" encoding="UTF-8"?> <response>  <lst name="responseHeader">   <int name="status">0</int>   <int name="QTime">13</int> </lst> <result name="response" numFound="100" start="0"> </result> <lst name="stats">   <lst name="stats_fields"/> </lst> <lst name="stats">   <lst name="csr">     <str name="cs1">this is the first</str>     <str name="cs2">this is the second</str>     <str name="cs3">this is the third</str>   </lst>   <lst name="ar">     <long name="count">100</long>     <null name="mcm"/>     <null name="mean"/>     <null name="median"/>     <null name="su"/>     <null name="sum"/>     <null name="unique"/>   </lst>   <lst name="mr">     <long name="count">100</long>     <null name="mcm"/>     <null name="mean"/>     <null name="median"/>     <null name="su"/>     <null name="sum"/>     <null name="unique"/>   </lst>   <lst name="cr">     <str name="ccmax">this is the secondstr9</str>     <str name="ccmin">this is the firststr0</str>     <str name="csmax">this is the second</str>     <str name="csmin">this is the first</str>     <str name="max">str9</str>     <str name="min">str0</str>   </lst>   <lst name="cdr">     <date name="cd1">1800-12-31T23:59:59Z</date>     <date name="cd2">1804-06-30T23:59:59Z</date>     <str name="cs1">1800-12-31T23:59:59Z</str>     <str name="cs2">1804-06-30T23:59:59Z</str>   </lst>   <lst name="dmr">     <str name="cma">+2MONTHS</str>     <str name="cme">+2YEARS</str>     <date name="dmma">1812-02-29T23:59:59Z</date>     <date name="dmme">1807-12-31T23:59:59Z</date>     <date name="max">1811-12-31T23:59:59Z</date>     <date name="median">1805-12-31T23:59:59Z</date>   </lst>   <lst name="avr">     <double name="c">100.0"

Stack Trace:
java.lang.NumberFormatException: For input string: "" encoding="UTF-8"?>
<response>

<lst name="responseHeader">
  <int name="status">0</int>
  <int name="QTime">13</int>
</lst>
<result name="response" numFound="100" start="0">
</result>
<lst name="stats">
  <lst name="stats_fields"/>
</lst>
<lst name="stats">
  <lst name="csr">
    <str name="cs1">this is the first</str>
    <str name="cs2">this is the second</str>
    <str name="cs3">this is the third</str>
  </lst>
  <lst name="ar">
    <long name="count">100</long>
    <null name="mcm"/>
    <null name="mean"/>
    <null name="median"/>
    <null name="su"/>
    <null name="sum"/>
    <null name="unique"/>
  </lst>
  <lst name="mr">
    <long name="count">100</long>
    <null name="mcm"/>
    <null name="mean"/>
    <null name="median"/>
    <null name="su"/>
    <null name="sum"/>
    <null name="unique"/>
  </lst>
  <lst name="cr">
    <str name="ccmax">this is the secondstr9</str>
    <str name="ccmin">this is the firststr0</str>
    <str name="csmax">this is the second</str>
    <str name="csmin">this is the first</str>
    <str name="max">str9</str>
    <str name="min">str0</str>
  </lst>
  <lst name="cdr">
    <date name="cd1">1800-12-31T23:59:59Z</date>
    <date name="cd2">1804-06-30T23:59:59Z</date>
    <str name="cs1">1800-12-31T23:59:59Z</str>
    <str name="cs2">1804-06-30T23:59:59Z</str>
  </lst>
  <lst name="dmr">
    <str name="cma">+2MONTHS</str>
    <str name="cme">+2YEARS</str>
    <date name="dmma">1812-02-29T23:59:59Z</date>
    <date name="dmme">1807-12-31T23:59:59Z</date>
    <date name="max">1811-12-31T23:59:59Z</date>
    <date name="median">1805-12-31T23:59:59Z</date>
  </lst>
  <lst name="avr">
    <double name="c">100.0"
	at __randomizedtesting.SeedInfo.seed([C75FE9C19F5AC6C0:ACDEF7BFAA54F0AE]:0)
	at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1241)
	at java.lang.Double.parseDouble(Double.java:540)
	at org.apache.solr.analytics.expression.ExpressionTest.getStatResult(ExpressionTest.java:240)
	at org.apache.solr.analytics.expression.ExpressionTest.multiplyTest(ExpressionTest.java:96)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)


REGRESSION:  org.apache.solr.analytics.expression.ExpressionTest.divideTest

Error Message:
For input string: "" encoding="UTF-8"?> <response>  <lst name="responseHeader">   <int name="status">0</int>   <int name="QTime">13</int> </lst> <result name="response" numFound="100" start="0"> </result> <lst name="stats">   <lst name="stats_fields"/> </lst> <lst name="stats">   <lst name="csr">     <str name="cs1">this is the first</str>     <str name="cs2">this is the second</str>     <str name="cs3">this is the third</str>   </lst>   <lst name="ar">     <long name="count">100</long>     <null name="mcm"/>     <null name="mean"/>     <null name="median"/>     <null name="su"/>     <null name="sum"/>     <null name="unique"/>   </lst>   <lst name="mr">     <long name="count">100</long>     <null name="mcm"/>     <null name="mean"/>     <null name="median"/>     <null name="su"/>     <null name="sum"/>     <null name="unique"/>   </lst>   <lst name="cr">     <str name="ccmax">this is the secondstr9</str>     <str name="ccmin">this is the firststr0</str>     <str name="csmax">this is the second</str>     <str name="csmin">this is the first</str>     <str name="max">str9</str>     <str name="min">str0</str>   </lst>   <lst name="cdr">     <date name="cd1">1800-12-31T23:59:59Z</date>     <date name="cd2">1804-06-30T23:59:59Z</date>     <str name="cs1">1800-12-31T23:59:59Z</str>     <str name="cs2">1804-06-30T23:59:59Z</str>   </lst>   <lst name="dmr">     <str name="cma">+2MONTHS</str>     <str name="cme">+2YEARS</str>     <date name="dmma">1812-02-29T23:59:59Z</date>     <date name="dmme">1807-12-31T23:59:59Z</date>     <date name="max">1811-12-31T23:59:59Z</date>     <date name="median">1805-12-31T23:59:59Z</date>   </lst>   <lst name="avr">     <double name="c">100.0"

Stack Trace:
java.lang.NumberFormatException: For input string: "" encoding="UTF-8"?>
<response>

<lst name="responseHeader">
  <int name="status">0</int>
  <int name="QTime">13</int>
</lst>
<result name="response" numFound="100" start="0">
</result>
<lst name="stats">
  <lst name="stats_fields"/>
</lst>
<lst name="stats">
  <lst name="csr">
    <str name="cs1">this is the first</str>
    <str name="cs2">this is the second</str>
    <str name="cs3">this is the third</str>
  </lst>
  <lst name="ar">
    <long name="count">100</long>
    <null name="mcm"/>
    <null name="mean"/>
    <null name="median"/>
    <null name="su"/>
    <null name="sum"/>
    <null name="unique"/>
  </lst>
  <lst name="mr">
    <long name="count">100</long>
    <null name="mcm"/>
    <null name="mean"/>
    <null name="median"/>
    <null name="su"/>
    <null name="sum"/>
    <null name="unique"/>
  </lst>
  <lst name="cr">
    <str name="ccmax">this is the secondstr9</str>
    <str name="ccmin">this is the firststr0</str>
    <str name="csmax">this is the second</str>
    <str name="csmin">this is the first</str>
    <str name="max">str9</str>
    <str name="min">str0</str>
  </lst>
  <lst name="cdr">
    <date name="cd1">1800-12-31T23:59:59Z</date>
    <date name="cd2">1804-06-30T23:59:59Z</date>
    <str name="cs1">1800-12-31T23:59:59Z</str>
    <str name="cs2">1804-06-30T23:59:59Z</str>
  </lst>
  <lst name="dmr">
    <str name="cma">+2MONTHS</str>
    <str name="cme">+2YEARS</str>
    <date name="dmma">1812-02-29T23:59:59Z</date>
    <date name="dmme">1807-12-31T23:59:59Z</date>
    <date name="max">1811-12-31T23:59:59Z</date>
    <date name="median">1805-12-31T23:59:59Z</date>
  </lst>
  <lst name="avr">
    <double name="c">100.0"
	at __randomizedtesting.SeedInfo.seed([C75FE9C19F5AC6C0:9F520237BB98A416]:0)
	at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1241)
	at java.lang.Double.parseDouble(Double.java:540)
	at org.apache.solr.analytics.expression.ExpressionTest.getStatResult(ExpressionTest.java:240)
	at org.apache.solr.analytics.expression.ExpressionTest.divideTest(ExpressionTest.java:110)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)


REGRESSION:  org.apache.solr.analytics.expression.ExpressionTest.addTest

Error Message:
For input string: "" encoding="UTF-8"?> <response>  <lst name="responseHeader">   <int name="status">0</int>   <int name="QTime">13</int> </lst> <result name="response" numFound="100" start="0"> </result> <lst name="stats">   <lst name="stats_fields"/> </lst> <lst name="stats">   <lst name="csr">     <str name="cs1">this is the first</str>     <str name="cs2">this is the second</str>     <str name="cs3">this is the third</str>   </lst>   <lst name="ar">     <long name="count">100</long>     <null name="mcm"/>     <null name="mean"/>     <null name="median"/>     <null name="su"/>     <null name="sum"/>     <null name="unique"/>   </lst>   <lst name="mr">     <long name="count">100</long>     <null name="mcm"/>     <null name="mean"/>     <null name="median"/>     <null name="su"/>     <null name="sum"/>     <null name="unique"/>   </lst>   <lst name="cr">     <str name="ccmax">this is the secondstr9</str>     <str name="ccmin">this is the firststr0</str>     <str name="csmax">this is the second</str>     <str name="csmin">this is the first</str>     <str name="max">str9</str>     <str name="min">str0</str>   </lst>   <lst name="cdr">     <date name="cd1">1800-12-31T23:59:59Z</date>     <date name="cd2">1804-06-30T23:59:59Z</date>     <str name="cs1">1800-12-31T23:59:59Z</str>     <str name="cs2">1804-06-30T23:59:59Z</str>   </lst>   <lst name="dmr">     <str name="cma">+2MONTHS</str>     <str name="cme">+2YEARS</str>     <date name="dmma">1812-02-29T23:59:59Z</date>     <date name="dmme">1807-12-31T23:59:59Z</date>     <date name="max">1811-12-31T23:59:59Z</date>     <date name="median">1805-12-31T23:59:59Z</date>   </lst>   <lst name="avr">     <double name="c">100.0"

Stack Trace:
java.lang.NumberFormatException: For input string: "" encoding="UTF-8"?>
<response>

<lst name="responseHeader">
  <int name="status">0</int>
  <int name="QTime">13</int>
</lst>
<result name="response" numFound="100" start="0">
</result>
<lst name="stats">
  <lst name="stats_fields"/>
</lst>
<lst name="stats">
  <lst name="csr">
    <str name="cs1">this is the first</str>
    <str name="cs2">this is the second</str>
    <str name="cs3">this is the third</str>
  </lst>
  <lst name="ar">
    <long name="count">100</long>
    <null name="mcm"/>
    <null name="mean"/>
    <null name="median"/>
    <null name="su"/>
    <null name="sum"/>
    <null name="unique"/>
  </lst>
  <lst name="mr">
    <long name="count">100</long>
    <null name="mcm"/>
    <null name="mean"/>
    <null name="median"/>
    <null name="su"/>
    <null name="sum"/>
    <null name="unique"/>
  </lst>
  <lst name="cr">
    <str name="ccmax">this is the secondstr9</str>
    <str name="ccmin">this is the firststr0</str>
    <str name="csmax">this is the second</str>
    <str name="csmin">this is the first</str>
    <str name="max">str9</str>
    <str name="min">str0</str>
  </lst>
  <lst name="cdr">
    <date name="cd1">1800-12-31T23:59:59Z</date>
    <date name="cd2">1804-06-30T23:59:59Z</date>
    <str name="cs1">1800-12-31T23:59:59Z</str>
    <str name="cs2">1804-06-30T23:59:59Z</str>
  </lst>
  <lst name="dmr">
    <str name="cma">+2MONTHS</str>
    <str name="cme">+2YEARS</str>
    <date name="dmma">1812-02-29T23:59:59Z</date>
    <date name="dmme">1807-12-31T23:59:59Z</date>
    <date name="max">1811-12-31T23:59:59Z</date>
    <date name="median">1805-12-31T23:59:59Z</date>
  </lst>
  <lst name="avr">
    <double name="c">100.0"
	at __randomizedtesting.SeedInfo.seed([C75FE9C19F5AC6C0:3173441FDE95C187]:0)
	at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1241)
	at java.lang.Double.parseDouble(Double.java:540)
	at org.apache.solr.analytics.expression.ExpressionTest.getStatResult(ExpressionTest.java:240)
	at org.apache.solr.analytics.expression.ExpressionTest.addTest(ExpressionTest.java:82)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)


REGRESSION:  org.apache.solr.analytics.expression.ExpressionTest.absoluteValueTest

Error Message:
For input string: "" encoding="UTF-8"?> <response>  <lst name="responseHeader">   <int name="status">0</int>   <int name="QTime">13</int> </lst> <result name="response" numFound="100" start="0"> </result> <lst name="stats">   <lst name="stats_fields"/> </lst> <lst name="stats">   <lst name="csr">     <str name="cs1">this is the first</str>     <str name="cs2">this is the second</str>     <str name="cs3">this is the third</str>   </lst>   <lst name="ar">     <long name="count">100</long>     <null name="mcm"/>     <null name="mean"/>     <null name="median"/>     <null name="su"/>     <null name="sum"/>     <null name="unique"/>   </lst>   <lst name="mr">     <long name="count">100</long>     <null name="mcm"/>     <null name="mean"/>     <null name="median"/>     <null name="su"/>     <null name="sum"/>     <null name="unique"/>   </lst>   <lst name="cr">     <str name="ccmax">this is the secondstr9</str>     <str name="ccmin">this is the firststr0</str>     <str name="csmax">this is the second</str>     <str name="csmin">this is the first</str>     <str name="max">str9</str>     <str name="min">str0</str>   </lst>   <lst name="cdr">     <date name="cd1">1800-12-31T23:59:59Z</date>     <date name="cd2">1804-06-30T23:59:59Z</date>     <str name="cs1">1800-12-31T23:59:59Z</str>     <str name="cs2">1804-06-30T23:59:59Z</str>   </lst>   <lst name="dmr">     <str name="cma">+2MONTHS</str>     <str name="cme">+2YEARS</str>     <date name="dmma">1812-02-29T23:59:59Z</date>     <date name="dmme">1807-12-31T23:59:59Z</date>     <date name="max">1811-12-31T23:59:59Z</date>     <date name="median">1805-12-31T23:59:59Z</date>   </lst>   <lst name="avr">     <double name="c">100.0"

Stack Trace:
java.lang.NumberFormatException: For input string: "" encoding="UTF-8"?>
<response>

<lst name="responseHeader">
  <int name="status">0</int>
  <int name="QTime">13</int>
</lst>
<result name="response" numFound="100" start="0">
</result>
<lst name="stats">
  <lst name="stats_fields"/>
</lst>
<lst name="stats">
  <lst name="csr">
    <str name="cs1">this is the first</str>
    <str name="cs2">this is the second</str>
    <str name="cs3">this is the third</str>
  </lst>
  <lst name="ar">
    <long name="count">100</long>
    <null name="mcm"/>
    <null name="mean"/>
    <null name="median"/>
    <null name="su"/>
    <null name="sum"/>
    <null name="unique"/>
  </lst>
  <lst name="mr">
    <long name="count">100</long>
    <null name="mcm"/>
    <null name="mean"/>
    <null name="median"/>
    <null name="su"/>
    <null name="sum"/>
    <null name="unique"/>
  </lst>
  <lst name="cr">
    <str name="ccmax">this is the secondstr9</str>
    <str name="ccmin">this is the firststr0</str>
    <str name="csmax">this is the second</str>
    <str name="csmin">this is the first</str>
    <str name="max">str9</str>
    <str name="min">str0</str>
  </lst>
  <lst name="cdr">
    <date name="cd1">1800-12-31T23:59:59Z</date>
    <date name="cd2">1804-06-30T23:59:59Z</date>
    <str name="cs1">1800-12-31T23:59:59Z</str>
    <str name="cs2">1804-06-30T23:59:59Z</str>
  </lst>
  <lst name="dmr">
    <str name="cma">+2MONTHS</str>
    <str name="cme">+2YEARS</str>
    <date name="dmma">1812-02-29T23:59:59Z</date>
    <date name="dmme">1807-12-31T23:59:59Z</date>
    <date name="max">1811-12-31T23:59:59Z</date>
    <date name="median">1805-12-31T23:59:59Z</date>
  </lst>
  <lst name="avr">
    <double name="c">100.0"
	at __randomizedtesting.SeedInfo.seed([C75FE9C19F5AC6C0:E6F3C9D452C79EA6]:0)
	at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1241)
	at java.lang.Double.parseDouble(Double.java:540)
	at org.apache.solr.analytics.expression.ExpressionTest.getStatResult(ExpressionTest.java:240)
	at org.apache.solr.analytics.expression.ExpressionTest.absoluteValueTest(ExpressionTest.java:147)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)


REGRESSION:  org.apache.solr.analytics.expression.ExpressionTest.powerTest

Error Message:
For input string: "" encoding="UTF-8"?> <response>  <lst name="responseHeader">   <int name="status">0</int>   <int name="QTime">13</int> </lst> <result name="response" numFound="100" start="0"> </result> <lst name="stats">   <lst name="stats_fields"/> </lst> <lst name="stats">   <lst name="csr">     <str name="cs1">this is the first</str>     <str name="cs2">this is the second</str>     <str name="cs3">this is the third</str>   </lst>   <lst name="ar">     <long name="count">100</long>     <null name="mcm"/>     <null name="mean"/>     <null name="median"/>     <null name="su"/>     <null name="sum"/>     <null name="unique"/>   </lst>   <lst name="mr">     <long name="count">100</long>     <null name="mcm"/>     <null name="mean"/>     <null name="median"/>     <null name="su"/>     <null name="sum"/>     <null name="unique"/>   </lst>   <lst name="cr">     <str name="ccmax">this is the secondstr9</str>     <str name="ccmin">this is the firststr0</str>     <str name="csmax">this is the second</str>     <str name="csmin">this is the first</str>     <str name="max">str9</str>     <str name="min">str0</str>   </lst>   <lst name="cdr">     <date name="cd1">1800-12-31T23:59:59Z</date>     <date name="cd2">1804-06-30T23:59:59Z</date>     <str name="cs1">1800-12-31T23:59:59Z</str>     <str name="cs2">1804-06-30T23:59:59Z</str>   </lst>   <lst name="dmr">     <str name="cma">+2MONTHS</str>     <str name="cme">+2YEARS</str>     <date name="dmma">1812-02-29T23:59:59Z</date>     <date name="dmme">1807-12-31T23:59:59Z</date>     <date name="max">1811-12-31T23:59:59Z</date>     <date name="median">1805-12-31T23:59:59Z</date>   </lst>   <lst name="avr">     <double name="c">100.0"

Stack Trace:
java.lang.NumberFormatException: For input string: "" encoding="UTF-8"?>
<response>

<lst name="responseHeader">
  <int name="status">0</int>
  <int name="QTime">13</int>
</lst>
<result name="response" numFound="100" start="0">
</result>
<lst name="stats">
  <lst name="stats_fields"/>
</lst>
<lst name="stats">
  <lst name="csr">
    <str name="cs1">this is the first</str>
    <str name="cs2">this is the second</str>
    <str name="cs3">this is the third</str>
  </lst>
  <lst name="ar">
    <long name="count">100</long>
    <null name="mcm"/>
    <null name="mean"/>
    <null name="median"/>
    <null name="su"/>
    <null name="sum"/>
    <null name="unique"/>
  </lst>
  <lst name="mr">
    <long name="count">100</long>
    <null name="mcm"/>
    <null name="mean"/>
    <null name="median"/>
    <null name="su"/>
    <null name="sum"/>
    <null name="unique"/>
  </lst>
  <lst name="cr">
    <str name="ccmax">this is the secondstr9</str>
    <str name="ccmin">this is the firststr0</str>
    <str name="csmax">this is the second</str>
    <str name="csmin">this is the first</str>
    <str name="max">str9</str>
    <str name="min">str0</str>
  </lst>
  <lst name="cdr">
    <date name="cd1">1800-12-31T23:59:59Z</date>
    <date name="cd2">1804-06-30T23:59:59Z</date>
    <str name="cs1">1800-12-31T23:59:59Z</str>
    <str name="cs2">1804-06-30T23:59:59Z</str>
  </lst>
  <lst name="dmr">
    <str name="cma">+2MONTHS</str>
    <str name="cme">+2YEARS</str>
    <date name="dmma">1812-02-29T23:59:59Z</date>
    <date name="dmme">1807-12-31T23:59:59Z</date>
    <date name="max">1811-12-31T23:59:59Z</date>
    <date name="median">1805-12-31T23:59:59Z</date>
  </lst>
  <lst name="avr">
    <double name="c">100.0"
	at __randomizedtesting.SeedInfo.seed([C75FE9C19F5AC6C0:A9ED5EC2774D9811]:0)
	at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1241)
	at java.lang.Double.parseDouble(Double.java:540)
	at org.apache.solr.analytics.expression.ExpressionTest.getStatResult(ExpressionTest.java:240)
	at org.apache.solr.analytics.expression.ExpressionTest.powerTest(ExpressionTest.java:123)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)


REGRESSION:  org.apache.solr.analytics.expression.ExpressionTest.negateTest

Error Message:
For input string: "" encoding="UTF-8"?> <response>  <lst name="responseHeader">   <int name="status">0</int>   <int name="QTime">13</int> </lst> <result name="response" numFound="100" start="0"> </result> <lst name="stats">   <lst name="stats_fields"/> </lst> <lst name="stats">   <lst name="csr">     <str name="cs1">this is the first</str>     <str name="cs2">this is the second</str>     <str name="cs3">this is the third</str>   </lst>   <lst name="ar">     <long name="count">100</long>     <null name="mcm"/>     <null name="mean"/>     <null name="median"/>     <null name="su"/>     <null name="sum"/>     <null name="unique"/>   </lst>   <lst name="mr">     <long name="count">100</long>     <null name="mcm"/>     <null name="mean"/>     <null name="median"/>     <null name="su"/>     <null name="sum"/>     <null name="unique"/>   </lst>   <lst name="cr">     <str name="ccmax">this is the secondstr9</str>     <str name="ccmin">this is the firststr0</str>     <str name="csmax">this is the second</str>     <str name="csmin">this is the first</str>     <str name="max">str9</str>     <str name="min">str0</str>   </lst>   <lst name="cdr">     <date name="cd1">1800-12-31T23:59:59Z</date>     <date name="cd2">1804-06-30T23:59:59Z</date>     <str name="cs1">1800-12-31T23:59:59Z</str>     <str name="cs2">1804-06-30T23:59:59Z</str>   </lst>   <lst name="dmr">     <str name="cma">+2MONTHS</str>     <str name="cme">+2YEARS</str>     <date name="dmma">1812-02-29T23:59:59Z</date>     <date name="dmme">1807-12-31T23:59:59Z</date>     <date name="max">1811-12-31T23:59:59Z</date>     <date name="median">1805-12-31T23:59:59Z</date>   </lst>   <lst name="avr">     <double name="c">100.0"

Stack Trace:
java.lang.NumberFormatException: For input string: "" encoding="UTF-8"?>
<response>

<lst name="responseHeader">
  <int name="status">0</int>
  <int name="QTime">13</int>
</lst>
<result name="response" numFound="100" start="0">
</result>
<lst name="stats">
  <lst name="stats_fields"/>
</lst>
<lst name="stats">
  <lst name="csr">
    <str name="cs1">this is the first</str>
    <str name="cs2">this is the second</str>
    <str name="cs3">this is the third</str>
  </lst>
  <lst name="ar">
    <long name="count">100</long>
    <null name="mcm"/>
    <null name="mean"/>
    <null name="median"/>
    <null name="su"/>
    <null name="sum"/>
    <null name="unique"/>
  </lst>
  <lst name="mr">
    <long name="count">100</long>
    <null name="mcm"/>
    <null name="mean"/>
    <null name="median"/>
    <null name="su"/>
    <null name="sum"/>
    <null name="unique"/>
  </lst>
  <lst name="cr">
    <str name="ccmax">this is the secondstr9</str>
    <str name="ccmin">this is the firststr0</str>
    <str name="csmax">this is the second</str>
    <str name="csmin">this is the first</str>
    <str name="max">str9</str>
    <str name="min">str0</str>
  </lst>
  <lst name="cdr">
    <date name="cd1">1800-12-31T23:59:59Z</date>
    <date name="cd2">1804-06-30T23:59:59Z</date>
    <str name="cs1">1800-12-31T23:59:59Z</str>
    <str name="cs2">1804-06-30T23:59:59Z</str>
  </lst>
  <lst name="dmr">
    <str name="cma">+2MONTHS</str>
    <str name="cme">+2YEARS</str>
    <date name="dmma">1812-02-29T23:59:59Z</date>
    <date name="dmme">1807-12-31T23:59:59Z</date>
    <date name="max">1811-12-31T23:59:59Z</date>
    <date name="median">1805-12-31T23:59:59Z</date>
  </lst>
  <lst name="avr">
    <double name="c">100.0"
	at __randomizedtesting.SeedInfo.seed([C75FE9C19F5AC6C0:CF5781643B779670]:0)
	at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1241)
	at java.lang.Double.parseDouble(Double.java:540)
	at org.apache.solr.analytics.expression.ExpressionTest.getStatResult(ExpressionTest.java:240)
	at org.apache.solr.analytics.expression.ExpressionTest.negateTest(ExpressionTest.java:136)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)


FAILED:  org.apache.solr.analytics.NoFacetTest.stddevTest

Error Message:
Oops: (double raws) 4661448815188901888 - 4628496337733101339 < 4442235333156365461 Calculated diff 4661418334251202777 Let's see what the JVM thinks these bits are. FloatResult:  4299.0 floatTest: 27.72225134241226 Diff 4271.277748657588

Stack Trace:
java.lang.AssertionError: Oops: (double raws) 4661448815188901888 - 4628496337733101339 < 4442235333156365461 Calculated diff 4661418334251202777 Let's see what the JVM thinks these bits are. FloatResult:  4299.0 floatTest: 27.72225134241226 Diff 4271.277748657588
	at __randomizedtesting.SeedInfo.seed([C75FE9C19F5AC6C0:C29FA974AF39C2CF]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.analytics.NoFacetTest.stddevTest(NoFacetTest.java:227)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)


FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
Expected content type application/octet-stream but got text/html;charset=ISO-8859-1. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 404 Can not find: /lgp/onenodecollectioncore/update</title> </head> <body> <h2>HTTP ERROR: 404</h2> <p>Problem accessing /lgp/onenodecollectioncore/update. Reason: <pre>    Can not find: /lgp/onenodecollectioncore/update</pre></p> <hr /><i><small>Powered by Jetty://</small></i>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected content type application/octet-stream but got text/html;charset=ISO-8859-1. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 Can not find: /lgp/onenodecollectioncore/update</title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /lgp/onenodecollectioncore/update. Reason:
<pre>    Can not find: /lgp/onenodecollectioncore/update</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
</body>
</html>

	at __randomizedtesting.SeedInfo.seed([C75FE9C19F5AC6C0:46B967D9E805A6FC]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:455)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:197)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
	at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:198)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:89)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)




Build Log:
[...truncated 10182 lines...]
   [junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
   [junit4]   2> 886190 T3110 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /lgp/
   [junit4]   2> 886194 T3110 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-BasicDistributedZk2Test-1385314129805
   [junit4]   2> 886196 T3110 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 886197 T3111 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 886270 T3110 oasc.ZkTestServer.run start zk server on port:49594
   [junit4]   2> 886271 T3110 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 886276 T3117 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ed1a65 name:ZooKeeperConnection Watcher:127.0.0.1:49594 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 886276 T3110 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 886277 T3110 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 886281 T3112 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1428b2817940000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 886283 T3110 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 886285 T3119 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10d5f70 name:ZooKeeperConnection Watcher:127.0.0.1:49594/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 886286 T3110 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 886286 T3110 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 886290 T3110 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 886294 T3110 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 886297 T3110 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 886301 T3110 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 886301 T3110 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 886307 T3110 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 886307 T3110 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 886313 T3110 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 886313 T3110 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 886317 T3110 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 886317 T3110 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 886322 T3110 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 886322 T3110 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 886326 T3110 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 886327 T3110 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 886331 T3110 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 886331 T3110 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 886335 T3110 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 886335 T3110 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 886340 T3110 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 886340 T3110 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 886345 T3110 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 886345 T3110 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 886350 T3110 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 886350 T3110 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 886746 T3110 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 886757 T3110 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49601
   [junit4]   2> 886757 T3110 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 886757 T3110 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 886757 T3110 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1385314129965
   [junit4]   2> 886757 T3110 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1385314129965\'
   [junit4]   2> 886779 T3110 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1385314129965\solr.xml
   [junit4]   2> 886839 T3110 oasc.CoreContainer.<init> New CoreContainer 2435891
   [junit4]   2> 886839 T3110 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1385314129965\]
   [junit4]   2> 886841 T3110 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 886841 T3110 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 886841 T3110 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 886841 T3110 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 886841 T3110 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 886841 T3110 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 886841 T3110 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 886843 T3110 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 886843 T3110 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 886848 T3110 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 886850 T3110 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 886850 T3110 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 886850 T3110 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49594/solr
   [junit4]   2> 886850 T3110 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 886852 T3110 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 886858 T3130 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1699994 name:ZooKeeperConnection Watcher:127.0.0.1:49594 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 886858 T3110 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 886861 T3112 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1428b2817940002, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 886862 T3110 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 886865 T3132 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14330b7 name:ZooKeeperConnection Watcher:127.0.0.1:49594/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 886865 T3110 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 886868 T3110 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 886873 T3110 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 886879 T3110 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 886881 T3110 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49601_lgp
   [junit4]   2> 886883 T3110 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49601_lgp
   [junit4]   2> 886889 T3110 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 886897 T3110 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 886901 T3110 oasc.Overseer.start Overseer (id=90787946811359235-127.0.0.1:49601_lgp-n_0000000000) starting
   [junit4]   2> 886906 T3110 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 886913 T3134 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 886914 T3110 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 886919 T3110 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 886923 T3110 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 886928 T3133 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 886933 T3135 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 886933 T3135 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 886935 T3135 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 886935 T3132 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 886937 T3133 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 886938 T3133 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49601/lgp",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49601_lgp",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 886938 T3133 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 886938 T3133 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 886944 T3132 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 886946 T3132 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 887661 T3135 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 887661 T3135 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1385314129965\collection1
   [junit4]   2> 887661 T3135 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 887662 T3135 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 887662 T3135 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 887663 T3135 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1385314129965\collection1\'
   [junit4]   2> 887665 T3135 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1385314129965/collection1/lib/classes/' to classloader
   [junit4]   2> 887665 T3135 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1385314129965/collection1/lib/README' to classloader
   [junit4]   2> 887712 T3135 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 887761 T3135 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 887763 T3135 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 887770 T3135 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 888282 T3135 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 888289 T3135 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 888292 T3135 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 888308 T3135 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 888312 T3135 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 888316 T3135 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 888318 T3135 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 888318 T3135 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 888318 T3135 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 888320 T3135 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 888320 T3135 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 888320 T3135 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 888321 T3135 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1385314129965\collection1\, dataDir=.\org.apache.solr.cloud.BasicDistributedZk2Test-1385314129804/control/data\
   [junit4]   2> 888321 T3135 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c6840d
   [junit4]   2> 888321 T3135 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.BasicDistributedZk2Test-1385314129804/control/data\
   [junit4]   2> 888321 T3135 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.BasicDistributedZk2Test-1385314129804/control/data\index/
   [junit4]   2> 888321 T3135 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.BasicDistributedZk2Test-1385314129804\control\data\index' doesn't exist. Creating new index...
   [junit4]   2> 888321 T3135 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.BasicDistributedZk2Test-1385314129804/control/data\index
   [junit4]   2> 888322 T3135 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=32, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 888322 T3135 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1db132c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@543aeb),segFN=segments_1,generation=1}
   [junit4]   2> 888322 T3135 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 888325 T3135 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 888325 T3135 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 888325 T3135 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 888325 T3135 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 888326 T3135 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 888326 T3135 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 888326 T3135 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 888326 T3135 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 888326 T3135 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 888327 T3135 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 888327 T3135 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 888327 T3135 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 888327 T3135 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 888328 T3135 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 888328 T3135 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 888328 T3135 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 888334 T3135 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 888339 T3135 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 888339 T3135 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 888340 T3135 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=70.072265625, floorSegmentMB=1.74609375, forceMergeDeletesPctAllowed=24.138068295613735, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.43529551960608326
   [junit4]   2> 888340 T3135 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1db132c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@543aeb),segFN=segments_1,generation=1}
   [junit4]   2> 888340 T3135 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 888340 T3135 oass.SolrIndexSearcher.<init> Opening Searcher@fde634 main
   [junit4]   2> 888343 T3136 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@fde634 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 888345 T3135 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 888345 T3135 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49601/lgp collection:control_collection shard:shard1
   [junit4]   2> 888345 T3135 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 888355 T3135 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 888357 T3132 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 888358 T3135 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 888358 T3135 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C602 name=collection1 org.apache.solr.core.SolrCore@18d6982 url=http://127.0.0.1:49601/lgp/collection1 node=127.0.0.1:49601_lgp C602_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:49601/lgp, core=collection1, node_name=127.0.0.1:49601_lgp}
   [junit4]   2> 888358 T3135 C602 P49601 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49601/lgp/collection1/
   [junit4]   2> 888358 T3135 C602 P49601 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 888358 T3135 C602 P49601 oasc.SyncStrategy.syncToMe http://127.0.0.1:49601/lgp/collection1/ has no replicas
   [junit4]   2> 888358 T3135 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49601/lgp/collection1/ shard1
   [junit4]   2> 888358 T3135 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 888361 T3133 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 888365 T3132 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 888367 T3132 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 888372 T3132 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 888447 T3132 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 888478 T3135 oasc.ZkController.register We are http://127.0.0.1:49601/lgp/collection1/ and leader is http://127.0.0.1:49601/lgp/collection1/
   [junit4]   2> 888478 T3135 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49601/lgp
   [junit4]   2> 888478 T3135 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 888478 T3135 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 888478 T3135 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 888480 T3132 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 888480 T3132 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 888480 T3132 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 888481 T3135 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 888483 T3110 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 888484 T3110 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 888483 T3133 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 888486 T3133 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49601/lgp",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49601_lgp",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 888489 T3110 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 888493 T3139 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@53e352 name:ZooKeeperConnection Watcher:127.0.0.1:49594/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 888493 T3132 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 888493 T3110 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 888495 T3110 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 888498 T3110 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 888571 T3139 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 888571 T3132 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 888856 T3110 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 888860 T3110 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49613
   [junit4]   2> 888861 T3110 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 888861 T3110 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 888861 T3110 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..

[...truncated too long message...]

llection1] Closing main searcher on request.
   [junit4]   2> 2861486 T8513 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 2861486 T8513 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-ExpressionTest-1385316103021\ [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-ExpressionTest-1385316103021\;done=false>>]
   [junit4]   2> 2861486 T8513 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-ExpressionTest-1385316103021\
   [junit4]   2> 2861486 T8513 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-ExpressionTest-1385316103021\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-ExpressionTest-1385316103021\index;done=false>>]
   [junit4]   2> 2861486 T8513 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-ExpressionTest-1385316103021\index
   [junit4]   2> NOTE: test params are: codec=Lucene45, sim=DefaultSimilarity, locale=it, timezone=Asia/Thimbu
   [junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_45 (32-bit)/cpus=2,threads=1,free=323072760,total=503316480
   [junit4]   2> NOTE: All tests run in this JVM: [TestFastLRUCache, TestSearchPerf, TestDynamicFieldCollectionResource, BlockCacheTest, AnalysisAfterCoreReloadTest, TestIBSimilarityFactory, HdfsUnloadDistributedZkTest, CoreAdminCreateDiscoverTest, CoreAdminHandlerTest, TestQuerySenderListener, SignatureUpdateProcessorFactoryTest, AbstractAnalyticsStatsTest, PrimUtilsTest, TestIndexingPerformance, TestSolrJ, TestWordDelimiterFilterFactory, JsonLoaderTest, TestSolrXmlPersistence, TestRemoteStreaming, ShowFileRequestHandlerTest, TestBM25SimilarityFactory, TestModifyConfFiles, TestSurroundQueryParser, DefaultValueUpdateProcessorTest, PluginInfoTest, TestLMDirichletSimilarityFactory, TestFieldTypeResource, SliceStateUpdateTest, TestMultiCoreConfBootstrap, TestSolrXMLSerializer, TestLFUCache, TestCollationField, DistributedSuggesterComponentTest, SuggesterWFSTTest, SuggesterFSTTest, SolrTestCaseJ4Test, TestPHPSerializedResponseWriter, TestFoldingMultitermQuery, RAMDirectoryFactoryTest, DebugComponentTest, TestFieldResource, UUIDFieldTest, BlockDirectoryTest, LeaderElectionTest, ReturnFieldsTest, TestValueSourceCache, TestReplicationHandler, ResponseLogComponentTest, DateFieldTest, TestSolrQueryParser, TestUpdate, AlternateDirectoryTest, TestAnalyzedSuggestions, TestTrie, TestRandomMergePolicy, HdfsDirectoryTest, SampleTest, ChangedSchemaMergeTest, ShardRoutingTest, BasicZkTest, ClusterStateTest, StatsComponentTest, HdfsBasicDistributedZk2Test, PrimitiveFieldTypeTest, TestUtils, ZkNodePropsTest, CSVRequestHandlerTest, CacheHeaderTest, QueryResultKeyTest, TestReloadAndDeleteDocs, AliasIntegrationTest, DOMUtilTest, SimplePostToolTest, TestSchemaNameResource, LoggingHandlerTest, TestFiltering, DirectSolrConnectionTest, TestCoreContainer, TestRTGBase, TestCopyFieldCollectionResource, TestRecoveryHdfs, TestCSVResponseWriter, TestSolrQueryParserResource, CopyFieldTest, MigrateRouteKeyTest, TestManagedSchemaFieldResource, TestDistributedSearch, SolrCoreCheckLockOnStartupTest, DocumentBuilderTest, BasicFunctionalityTest, AssignTest, TestXIncludeConfig, TestArbitraryIndexDir, HighlighterTest, ChaosMonkeySafeLeaderTest, FileBasedSpellCheckerTest, TestSerializedLuceneMatchVersion, TestStressReorder, TestWriterPerf, TestNoOpRegenerator, TermVectorComponentDistributedTest, DistributedQueryElevationComponentTest, BasicDistributedZk2Test, ParsingFieldUpdateProcessorsTest, WordBreakSolrSpellCheckerTest, TestDocBasedVersionConstraints, TestCloudManagedSchema, TestDynamicFieldResource, TestDefaultSearchFieldResource, TestRandomDVFaceting, OverseerTest, MoreLikeThisHandlerTest, TestSolrDeletionPolicy1, DistributedSpellCheckComponentTest, SOLR749Test, TestCSVLoader, TestSolr4Spatial, PathHierarchyTokenizerFactoryTest, XsltUpdateRequestHandlerTest, TestReversedWildcardFilterFactory, TestReload, TestCollapseQParserPlugin, TestQueryTypes, CustomCollectionTest, SolrInfoMBeanTest, InfoHandlerTest, NumericFieldsTest, TestRangeQuery, TestClassNameShortening, TestInfoStreamLogging, TestSimpleQParserPlugin, RequestHandlersTest, TestSweetSpotSimilarityFactory, DisMaxRequestHandlerTest, TestFuzzyAnalyzedSuggestions, TestDefaultSimilarityFactory, TestFastWriter, TestAnalyzeInfixSuggestions, TestLMJelinekMercerSimilarityFactory, RangeFacetTest, TestShardHandlerFactory, TestDistribDocBasedVersion, TestPostingsSolrHighlighter, DistanceFunctionTest, TestBinaryField, TestStressVersions, DeleteReplicaTest, TestManagedSchema, SuggestComponentTest, TestSolrIndexConfig, TestLuceneMatchVersion, TermsComponentTest, DateMathParserTest, SimpleFacetsTest, TestSolrQueryParserDefaultOperatorResource, TestElisionMultitermQuery, AutoCommitTest, TestNonNRTOpen, TestSolrXmlPersistor, TestStressUserVersions, TestFunctionQuery, DirectUpdateHandlerOptimizeTest, NotRequiredUniqueKeyTest, PreAnalyzedUpdateProcessorTest, OutputWriterTest, PolyFieldTest, DocValuesTest, QueryFacetTest, SolrIndexConfigTest, EnumFieldTest, BasicDistributedZkTest, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, SyncSliceTest, OpenCloseCoreStressTest, LeaderElectionIntegrationTest, RecoveryZkTest, FullSolrCloudDistribCmdsTest, ClusterStateUpdateTest, TestRandomFaceting, ZkSolrClientTest, TestZkChroot, ZkCLITest, ShardRoutingCustomTest, TestDistributedGrouping, TestFaceting, TestRecovery, TestHashPartitioner, ZkControllerTest, TestRealTimeGet, TestJoin, HardAutoCommitTest, DistributedTermsComponentTest, SolrCoreTest, SpellCheckComponentTest, TestGroupingSearch, SolrCmdDistributorTest, QueryElevationComponentTest, PeerSyncTest, BadIndexSchemaTest, ConvertedLegacyTest, TestSort, TestLazyCores, DirectUpdateHandlerTest, TestBadConfig, OverseerCollectionProcessorTest, TestIndexSearcher, SoftAutoCommitTest, CurrencyFieldOpenExchangeTest, CurrencyFieldXmlFileTest, SolrIndexSplitterTest, TestCoreDiscovery, TestExtendedDismaxParser, SpellCheckCollatorTest, SolrRequestParserTest, SuggesterTSTTest, SuggesterTest, TestStressLucene, SpatialFilterTest, NoCacheHeaderTest, SchemaVersionSpecificBehaviorTest, TestPseudoReturnFields, FieldMutatingUpdateProcessorTest, TestAtomicUpdateErrorCases, QueryEqualityTest, StatelessScriptUpdateProcessorFactoryTest, SortByFunctionTest, DocValuesMultiTest, IndexBasedSpellCheckerTest, LukeRequestHandlerTest, TestQueryUtils, StandardRequestHandlerTest, DirectSolrSpellCheckerTest, DocumentAnalysisRequestHandlerTest, TestOmitPositions, XmlUpdateRequestHandlerTest, TermVectorComponentTest, RequiredFieldsTest, FieldAnalysisRequestHandlerTest, FastVectorHighlighterTest, IndexSchemaRuntimeFieldTest, RegexBoostProcessorTest, SolrPluginUtilsTest, IndexSchemaTest, TestJmxIntegration, UpdateRequestProcessorFactoryTest, JSONWriterTest, MBeansHandlerTest, QueryParsingTest, UniqFieldsUpdateProcessorFactoryTest, BinaryUpdateRequestHandlerTest, TestPartialUpdateDeduplication, PingRequestHandlerTest, TestComponentsName, SearchHandlerTest, CoreContainerCoreInitFailuresTest, TestBinaryResponseWriter, HighlighterConfigTest, UpdateParamsTest, TestQuerySenderNoQuery, BadComponentTest, TestStressRecovery, TestMergePolicyConfig, TestSolrDeletionPolicy2, MultiTermTest, TestDocSet, MinimalSchemaTest, TestConfig, ExternalFileFieldSortTest, TestSolrCoreProperties, TestPhraseSuggestions, SpellPossibilityIteratorTest, TestCharFilters, TestCodecSupport, SynonymTokenizerTest, EchoParamsTest, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestNumberUtils, LegacyHTMLStripCharFilterTest, TestJmxMonitoredMap, TimeZoneUtilsTest, ResourceLoaderTest, TestFastOutputStream, ScriptEngineTest, OpenExchangeRatesOrgProviderTest, URLClassifyProcessorTest, ChaosMonkeyNothingIsSafeTest, PreAnalyzedFieldTest, TestSystemIdResolver, TestSuggestSpellingConverter, SpellingQueryConverterTest, TestLRUCache, TestDocumentBuilder, SliceStateTest, SystemInfoHandlerTest, FileUtilsTest, CircularListTest, NoFacetTest, ExpressionTest]
   [junit4] Completed in 2.11s, 12 tests, 6 errors <<< FAILURES!

[...truncated 140 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:420: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:400: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:492: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1275: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:908: There were test failures: 353 suites, 1558 tests, 7 errors, 1 failure, 40 ignored (12 assumptions)

Total time: 84 minutes 58 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_45 -server -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure